00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 1822 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3083 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.085 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.086 The recommended git tool is: git 00:00:00.086 using credential 00000000-0000-0000-0000-000000000002 00:00:00.088 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.122 Fetching changes from the remote Git repository 00:00:00.127 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.166 Using shallow fetch with depth 1 00:00:00.166 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.166 > git --version # timeout=10 00:00:00.195 > git --version # 'git version 2.39.2' 00:00:00.195 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.195 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.195 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.464 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.476 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.487 Checking out Revision f620ee97e10840540f53609861ee9b86caa3c192 (FETCH_HEAD) 00:00:05.487 > git config core.sparsecheckout # timeout=10 00:00:05.496 > git read-tree -mu HEAD # timeout=10 00:00:05.511 > git checkout -f f620ee97e10840540f53609861ee9b86caa3c192 # timeout=5 00:00:05.527 Commit message: "change IP of vertiv1 PDU" 00:00:05.528 > git rev-list --no-walk f620ee97e10840540f53609861ee9b86caa3c192 # timeout=10 00:00:05.609 [Pipeline] Start of Pipeline 00:00:05.622 [Pipeline] library 00:00:05.623 Loading library shm_lib@master 00:00:05.623 Library shm_lib@master is cached. Copying from home. 00:00:05.637 [Pipeline] node 00:00:05.645 Running on CYP9 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.646 [Pipeline] { 00:00:05.655 [Pipeline] catchError 00:00:05.656 [Pipeline] { 00:00:05.665 [Pipeline] wrap 00:00:05.671 [Pipeline] { 00:00:05.677 [Pipeline] stage 00:00:05.678 [Pipeline] { (Prologue) 00:00:05.850 [Pipeline] sh 00:00:06.135 + logger -p user.info -t JENKINS-CI 00:00:06.151 [Pipeline] echo 00:00:06.152 Node: CYP9 00:00:06.160 [Pipeline] sh 00:00:06.468 [Pipeline] setCustomBuildProperty 00:00:06.478 [Pipeline] echo 00:00:06.479 Cleanup processes 00:00:06.483 [Pipeline] sh 00:00:06.771 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.771 3625335 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.787 [Pipeline] sh 00:00:07.075 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.075 ++ grep -v 'sudo pgrep' 00:00:07.075 ++ awk '{print $1}' 00:00:07.075 + sudo kill -9 00:00:07.075 + true 00:00:07.089 [Pipeline] cleanWs 00:00:07.101 [WS-CLEANUP] Deleting project workspace... 00:00:07.101 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.131 [WS-CLEANUP] done 00:00:07.136 [Pipeline] setCustomBuildProperty 00:00:07.148 [Pipeline] sh 00:00:07.434 + sudo git config --global --replace-all safe.directory '*' 00:00:07.515 [Pipeline] nodesByLabel 00:00:07.516 Found a total of 1 nodes with the 'sorcerer' label 00:00:07.523 [Pipeline] httpRequest 00:00:07.527 HttpMethod: GET 00:00:07.528 URL: http://10.211.164.101/packages/jbp_f620ee97e10840540f53609861ee9b86caa3c192.tar.gz 00:00:07.531 Sending request to url: http://10.211.164.101/packages/jbp_f620ee97e10840540f53609861ee9b86caa3c192.tar.gz 00:00:07.547 Response Code: HTTP/1.1 200 OK 00:00:07.548 Success: Status code 200 is in the accepted range: 200,404 00:00:07.548 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_f620ee97e10840540f53609861ee9b86caa3c192.tar.gz 00:00:12.428 [Pipeline] sh 00:00:12.715 + tar --no-same-owner -xf jbp_f620ee97e10840540f53609861ee9b86caa3c192.tar.gz 00:00:12.737 [Pipeline] httpRequest 00:00:12.742 HttpMethod: GET 00:00:12.742 URL: http://10.211.164.101/packages/spdk_36faa8c312bf9059b86e0f503d7fd6b43c1498e6.tar.gz 00:00:12.743 Sending request to url: http://10.211.164.101/packages/spdk_36faa8c312bf9059b86e0f503d7fd6b43c1498e6.tar.gz 00:00:12.767 Response Code: HTTP/1.1 200 OK 00:00:12.768 Success: Status code 200 is in the accepted range: 200,404 00:00:12.768 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_36faa8c312bf9059b86e0f503d7fd6b43c1498e6.tar.gz 00:01:21.121 [Pipeline] sh 00:01:21.413 + tar --no-same-owner -xf spdk_36faa8c312bf9059b86e0f503d7fd6b43c1498e6.tar.gz 00:01:23.973 [Pipeline] sh 00:01:24.260 + git -C spdk log --oneline -n5 00:01:24.260 36faa8c31 bdev/nvme: Fix the case that namespace was removed during reset 00:01:24.260 e2cb5a5ee bdev/nvme: Factor out nvme_ns active/inactive check into a helper function 00:01:24.260 4b134b4ab bdev/nvme: Delay callbacks when the next operation is a failover 00:01:24.260 d2ea4ecb1 llvm/vfio: Suppress checking leaks for `spdk_nvme_ctrlr_alloc_io_qpair` 00:01:24.260 3b33f4333 test/nvme/cuse: Fix typo 00:01:24.273 [Pipeline] } 00:01:24.290 [Pipeline] // stage 00:01:24.299 [Pipeline] stage 00:01:24.302 [Pipeline] { (Prepare) 00:01:24.321 [Pipeline] writeFile 00:01:24.338 [Pipeline] sh 00:01:24.626 + logger -p user.info -t JENKINS-CI 00:01:24.640 [Pipeline] sh 00:01:24.927 + logger -p user.info -t JENKINS-CI 00:01:24.940 [Pipeline] sh 00:01:25.228 + cat autorun-spdk.conf 00:01:25.228 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.228 SPDK_TEST_NVMF=1 00:01:25.228 SPDK_TEST_NVME_CLI=1 00:01:25.228 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.228 SPDK_TEST_NVMF_NICS=e810 00:01:25.228 SPDK_RUN_UBSAN=1 00:01:25.228 NET_TYPE=phy 00:01:25.237 RUN_NIGHTLY=1 00:01:25.242 [Pipeline] readFile 00:01:25.265 [Pipeline] withEnv 00:01:25.267 [Pipeline] { 00:01:25.281 [Pipeline] sh 00:01:25.570 + set -ex 00:01:25.570 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:25.570 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:25.570 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.570 ++ SPDK_TEST_NVMF=1 00:01:25.570 ++ SPDK_TEST_NVME_CLI=1 00:01:25.570 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.570 ++ SPDK_TEST_NVMF_NICS=e810 00:01:25.570 ++ SPDK_RUN_UBSAN=1 00:01:25.570 ++ NET_TYPE=phy 00:01:25.570 ++ RUN_NIGHTLY=1 00:01:25.570 + case $SPDK_TEST_NVMF_NICS in 00:01:25.570 + DRIVERS=ice 00:01:25.570 + [[ tcp == \r\d\m\a ]] 00:01:25.570 + [[ -n ice ]] 00:01:25.570 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:25.570 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:25.570 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:25.570 rmmod: ERROR: Module irdma is not currently loaded 00:01:25.570 rmmod: ERROR: Module i40iw is not currently loaded 00:01:25.570 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:25.570 + true 00:01:25.570 + for D in $DRIVERS 00:01:25.570 + sudo modprobe ice 00:01:25.570 + exit 0 00:01:25.581 [Pipeline] } 00:01:25.599 [Pipeline] // withEnv 00:01:25.604 [Pipeline] } 00:01:25.619 [Pipeline] // stage 00:01:25.628 [Pipeline] catchError 00:01:25.630 [Pipeline] { 00:01:25.645 [Pipeline] timeout 00:01:25.645 Timeout set to expire in 40 min 00:01:25.647 [Pipeline] { 00:01:25.663 [Pipeline] stage 00:01:25.664 [Pipeline] { (Tests) 00:01:25.680 [Pipeline] sh 00:01:25.967 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.967 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.967 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.967 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:25.967 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.967 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:25.967 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:25.967 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:25.967 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:25.967 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:25.967 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.967 + source /etc/os-release 00:01:25.967 ++ NAME='Fedora Linux' 00:01:25.967 ++ VERSION='38 (Cloud Edition)' 00:01:25.967 ++ ID=fedora 00:01:25.967 ++ VERSION_ID=38 00:01:25.967 ++ VERSION_CODENAME= 00:01:25.967 ++ PLATFORM_ID=platform:f38 00:01:25.967 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:01:25.967 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:25.967 ++ LOGO=fedora-logo-icon 00:01:25.967 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:01:25.967 ++ HOME_URL=https://fedoraproject.org/ 00:01:25.967 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:01:25.967 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:25.967 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:25.967 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:25.967 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:01:25.967 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:25.967 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:01:25.967 ++ SUPPORT_END=2024-05-14 00:01:25.967 ++ VARIANT='Cloud Edition' 00:01:25.967 ++ VARIANT_ID=cloud 00:01:25.967 + uname -a 00:01:25.967 Linux spdk-cyp-09 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:01:25.967 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:29.273 Hugepages 00:01:29.273 node hugesize free / total 00:01:29.273 node0 1048576kB 0 / 0 00:01:29.273 node0 2048kB 0 / 0 00:01:29.273 node1 1048576kB 0 / 0 00:01:29.273 node1 2048kB 0 / 0 00:01:29.273 00:01:29.273 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:29.273 I/OAT 0000:00:01.0 8086 0b00 0 ioatdma - - 00:01:29.273 I/OAT 0000:00:01.1 8086 0b00 0 ioatdma - - 00:01:29.274 I/OAT 0000:00:01.2 8086 0b00 0 ioatdma - - 00:01:29.274 I/OAT 0000:00:01.3 8086 0b00 0 ioatdma - - 00:01:29.274 I/OAT 0000:00:01.4 8086 0b00 0 ioatdma - - 00:01:29.274 I/OAT 0000:00:01.5 8086 0b00 0 ioatdma - - 00:01:29.274 I/OAT 0000:00:01.6 8086 0b00 0 ioatdma - - 00:01:29.274 I/OAT 0000:00:01.7 8086 0b00 0 ioatdma - - 00:01:29.274 NVMe 0000:65:00.0 144d a80a 0 nvme nvme0 nvme0n1 00:01:29.274 I/OAT 0000:80:01.0 8086 0b00 1 ioatdma - - 00:01:29.274 I/OAT 0000:80:01.1 8086 0b00 1 ioatdma - - 00:01:29.274 I/OAT 0000:80:01.2 8086 0b00 1 ioatdma - - 00:01:29.274 I/OAT 0000:80:01.3 8086 0b00 1 ioatdma - - 00:01:29.274 I/OAT 0000:80:01.4 8086 0b00 1 ioatdma - - 00:01:29.274 I/OAT 0000:80:01.5 8086 0b00 1 ioatdma - - 00:01:29.274 I/OAT 0000:80:01.6 8086 0b00 1 ioatdma - - 00:01:29.274 I/OAT 0000:80:01.7 8086 0b00 1 ioatdma - - 00:01:29.274 + rm -f /tmp/spdk-ld-path 00:01:29.274 + source autorun-spdk.conf 00:01:29.274 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.274 ++ SPDK_TEST_NVMF=1 00:01:29.274 ++ SPDK_TEST_NVME_CLI=1 00:01:29.274 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:29.274 ++ SPDK_TEST_NVMF_NICS=e810 00:01:29.274 ++ SPDK_RUN_UBSAN=1 00:01:29.274 ++ NET_TYPE=phy 00:01:29.274 ++ RUN_NIGHTLY=1 00:01:29.274 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:29.274 + [[ -n '' ]] 00:01:29.274 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:29.274 + for M in /var/spdk/build-*-manifest.txt 00:01:29.274 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:29.274 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:29.274 + for M in /var/spdk/build-*-manifest.txt 00:01:29.274 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:29.274 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:29.274 ++ uname 00:01:29.274 + [[ Linux == \L\i\n\u\x ]] 00:01:29.274 + sudo dmesg -T 00:01:29.274 + sudo dmesg --clear 00:01:29.274 + dmesg_pid=3626292 00:01:29.274 + [[ Fedora Linux == FreeBSD ]] 00:01:29.274 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.274 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.274 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:29.274 + export VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:01:29.274 + VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:01:29.274 + [[ -x /usr/src/fio-static/fio ]] 00:01:29.274 + export FIO_BIN=/usr/src/fio-static/fio 00:01:29.274 + FIO_BIN=/usr/src/fio-static/fio 00:01:29.274 + sudo dmesg -Tw 00:01:29.274 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:29.274 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:29.274 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:29.274 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.274 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.274 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:29.274 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.274 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.274 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:29.274 Test configuration: 00:01:29.274 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.274 SPDK_TEST_NVMF=1 00:01:29.274 SPDK_TEST_NVME_CLI=1 00:01:29.274 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:29.274 SPDK_TEST_NVMF_NICS=e810 00:01:29.274 SPDK_RUN_UBSAN=1 00:01:29.274 NET_TYPE=phy 00:01:29.274 RUN_NIGHTLY=1 03:58:43 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:29.274 03:58:43 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:29.274 03:58:43 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:29.274 03:58:43 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:29.274 03:58:43 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.274 03:58:43 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.274 03:58:43 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.274 03:58:43 -- paths/export.sh@5 -- $ export PATH 00:01:29.274 03:58:43 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.274 03:58:43 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:29.274 03:58:43 -- common/autobuild_common.sh@435 -- $ date +%s 00:01:29.274 03:58:43 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1715651923.XXXXXX 00:01:29.274 03:58:43 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1715651923.fV070M 00:01:29.274 03:58:43 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:01:29.274 03:58:43 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:01:29.274 03:58:43 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:29.274 03:58:43 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:29.274 03:58:43 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:29.274 03:58:43 -- common/autobuild_common.sh@451 -- $ get_config_params 00:01:29.274 03:58:43 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:01:29.274 03:58:43 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.274 03:58:43 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:29.274 03:58:43 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:29.274 03:58:43 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:29.274 03:58:43 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:29.274 03:58:43 -- spdk/autobuild.sh@16 -- $ date -u 00:01:29.274 Tue May 14 01:58:43 AM UTC 2024 00:01:29.274 03:58:43 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:29.274 LTS-24-g36faa8c31 00:01:29.274 03:58:43 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:29.274 03:58:43 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:29.274 03:58:43 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:29.274 03:58:43 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:29.274 03:58:43 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:29.274 03:58:43 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.274 ************************************ 00:01:29.274 START TEST ubsan 00:01:29.274 ************************************ 00:01:29.274 03:58:43 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:01:29.274 using ubsan 00:01:29.274 00:01:29.274 real 0m0.000s 00:01:29.274 user 0m0.000s 00:01:29.274 sys 0m0.000s 00:01:29.274 03:58:43 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:01:29.274 03:58:43 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.274 ************************************ 00:01:29.274 END TEST ubsan 00:01:29.274 ************************************ 00:01:29.274 03:58:43 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:29.274 03:58:43 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:29.274 03:58:43 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:29.274 03:58:43 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:29.274 03:58:43 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:29.274 03:58:43 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:29.274 03:58:43 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:29.274 03:58:43 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:29.274 03:58:43 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:29.274 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:29.274 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:29.535 Using 'verbs' RDMA provider 00:01:45.083 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:57.318 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:57.318 Creating mk/config.mk...done. 00:01:57.318 Creating mk/cc.flags.mk...done. 00:01:57.318 Type 'make' to build. 00:01:57.318 03:59:11 -- spdk/autobuild.sh@69 -- $ run_test make make -j144 00:01:57.318 03:59:11 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:57.318 03:59:11 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:57.318 03:59:11 -- common/autotest_common.sh@10 -- $ set +x 00:01:57.318 ************************************ 00:01:57.318 START TEST make 00:01:57.318 ************************************ 00:01:57.318 03:59:11 -- common/autotest_common.sh@1104 -- $ make -j144 00:01:57.318 make[1]: Nothing to be done for 'all'. 00:02:05.452 The Meson build system 00:02:05.452 Version: 1.3.1 00:02:05.452 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:02:05.452 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:02:05.452 Build type: native build 00:02:05.452 Program cat found: YES (/usr/bin/cat) 00:02:05.452 Project name: DPDK 00:02:05.452 Project version: 23.11.0 00:02:05.452 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:02:05.452 C linker for the host machine: cc ld.bfd 2.39-16 00:02:05.452 Host machine cpu family: x86_64 00:02:05.452 Host machine cpu: x86_64 00:02:05.452 Message: ## Building in Developer Mode ## 00:02:05.452 Program pkg-config found: YES (/usr/bin/pkg-config) 00:02:05.452 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:02:05.452 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:02:05.452 Program python3 found: YES (/usr/bin/python3) 00:02:05.452 Program cat found: YES (/usr/bin/cat) 00:02:05.452 Compiler for C supports arguments -march=native: YES 00:02:05.452 Checking for size of "void *" : 8 00:02:05.452 Checking for size of "void *" : 8 (cached) 00:02:05.452 Library m found: YES 00:02:05.452 Library numa found: YES 00:02:05.452 Has header "numaif.h" : YES 00:02:05.452 Library fdt found: NO 00:02:05.452 Library execinfo found: NO 00:02:05.452 Has header "execinfo.h" : YES 00:02:05.452 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:02:05.452 Run-time dependency libarchive found: NO (tried pkgconfig) 00:02:05.452 Run-time dependency libbsd found: NO (tried pkgconfig) 00:02:05.452 Run-time dependency jansson found: NO (tried pkgconfig) 00:02:05.452 Run-time dependency openssl found: YES 3.0.9 00:02:05.452 Run-time dependency libpcap found: YES 1.10.4 00:02:05.452 Has header "pcap.h" with dependency libpcap: YES 00:02:05.452 Compiler for C supports arguments -Wcast-qual: YES 00:02:05.452 Compiler for C supports arguments -Wdeprecated: YES 00:02:05.452 Compiler for C supports arguments -Wformat: YES 00:02:05.452 Compiler for C supports arguments -Wformat-nonliteral: NO 00:02:05.452 Compiler for C supports arguments -Wformat-security: NO 00:02:05.452 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:05.452 Compiler for C supports arguments -Wmissing-prototypes: YES 00:02:05.452 Compiler for C supports arguments -Wnested-externs: YES 00:02:05.452 Compiler for C supports arguments -Wold-style-definition: YES 00:02:05.452 Compiler for C supports arguments -Wpointer-arith: YES 00:02:05.452 Compiler for C supports arguments -Wsign-compare: YES 00:02:05.452 Compiler for C supports arguments -Wstrict-prototypes: YES 00:02:05.452 Compiler for C supports arguments -Wundef: YES 00:02:05.452 Compiler for C supports arguments -Wwrite-strings: YES 00:02:05.452 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:02:05.452 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:02:05.452 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:05.452 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:02:05.452 Program objdump found: YES (/usr/bin/objdump) 00:02:05.452 Compiler for C supports arguments -mavx512f: YES 00:02:05.452 Checking if "AVX512 checking" compiles: YES 00:02:05.452 Fetching value of define "__SSE4_2__" : 1 00:02:05.452 Fetching value of define "__AES__" : 1 00:02:05.452 Fetching value of define "__AVX__" : 1 00:02:05.452 Fetching value of define "__AVX2__" : 1 00:02:05.452 Fetching value of define "__AVX512BW__" : 1 00:02:05.452 Fetching value of define "__AVX512CD__" : 1 00:02:05.452 Fetching value of define "__AVX512DQ__" : 1 00:02:05.452 Fetching value of define "__AVX512F__" : 1 00:02:05.452 Fetching value of define "__AVX512VL__" : 1 00:02:05.452 Fetching value of define "__PCLMUL__" : 1 00:02:05.452 Fetching value of define "__RDRND__" : 1 00:02:05.452 Fetching value of define "__RDSEED__" : 1 00:02:05.452 Fetching value of define "__VPCLMULQDQ__" : 1 00:02:05.452 Fetching value of define "__znver1__" : (undefined) 00:02:05.452 Fetching value of define "__znver2__" : (undefined) 00:02:05.452 Fetching value of define "__znver3__" : (undefined) 00:02:05.452 Fetching value of define "__znver4__" : (undefined) 00:02:05.452 Compiler for C supports arguments -Wno-format-truncation: YES 00:02:05.452 Message: lib/log: Defining dependency "log" 00:02:05.452 Message: lib/kvargs: Defining dependency "kvargs" 00:02:05.452 Message: lib/telemetry: Defining dependency "telemetry" 00:02:05.452 Checking for function "getentropy" : NO 00:02:05.452 Message: lib/eal: Defining dependency "eal" 00:02:05.452 Message: lib/ring: Defining dependency "ring" 00:02:05.452 Message: lib/rcu: Defining dependency "rcu" 00:02:05.452 Message: lib/mempool: Defining dependency "mempool" 00:02:05.452 Message: lib/mbuf: Defining dependency "mbuf" 00:02:05.452 Fetching value of define "__PCLMUL__" : 1 (cached) 00:02:05.452 Fetching value of define "__AVX512F__" : 1 (cached) 00:02:05.452 Fetching value of define "__AVX512BW__" : 1 (cached) 00:02:05.452 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:02:05.452 Fetching value of define "__AVX512VL__" : 1 (cached) 00:02:05.452 Fetching value of define "__VPCLMULQDQ__" : 1 (cached) 00:02:05.452 Compiler for C supports arguments -mpclmul: YES 00:02:05.452 Compiler for C supports arguments -maes: YES 00:02:05.452 Compiler for C supports arguments -mavx512f: YES (cached) 00:02:05.452 Compiler for C supports arguments -mavx512bw: YES 00:02:05.452 Compiler for C supports arguments -mavx512dq: YES 00:02:05.452 Compiler for C supports arguments -mavx512vl: YES 00:02:05.452 Compiler for C supports arguments -mvpclmulqdq: YES 00:02:05.452 Compiler for C supports arguments -mavx2: YES 00:02:05.452 Compiler for C supports arguments -mavx: YES 00:02:05.452 Message: lib/net: Defining dependency "net" 00:02:05.452 Message: lib/meter: Defining dependency "meter" 00:02:05.452 Message: lib/ethdev: Defining dependency "ethdev" 00:02:05.452 Message: lib/pci: Defining dependency "pci" 00:02:05.452 Message: lib/cmdline: Defining dependency "cmdline" 00:02:05.452 Message: lib/hash: Defining dependency "hash" 00:02:05.452 Message: lib/timer: Defining dependency "timer" 00:02:05.452 Message: lib/compressdev: Defining dependency "compressdev" 00:02:05.452 Message: lib/cryptodev: Defining dependency "cryptodev" 00:02:05.452 Message: lib/dmadev: Defining dependency "dmadev" 00:02:05.452 Compiler for C supports arguments -Wno-cast-qual: YES 00:02:05.452 Message: lib/power: Defining dependency "power" 00:02:05.452 Message: lib/reorder: Defining dependency "reorder" 00:02:05.452 Message: lib/security: Defining dependency "security" 00:02:05.452 Has header "linux/userfaultfd.h" : YES 00:02:05.452 Has header "linux/vduse.h" : YES 00:02:05.452 Message: lib/vhost: Defining dependency "vhost" 00:02:05.452 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:02:05.452 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:02:05.452 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:02:05.452 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:02:05.452 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:02:05.453 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:02:05.453 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:02:05.453 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:02:05.453 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:02:05.453 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:02:05.453 Program doxygen found: YES (/usr/bin/doxygen) 00:02:05.453 Configuring doxy-api-html.conf using configuration 00:02:05.453 Configuring doxy-api-man.conf using configuration 00:02:05.453 Program mandb found: YES (/usr/bin/mandb) 00:02:05.453 Program sphinx-build found: NO 00:02:05.453 Configuring rte_build_config.h using configuration 00:02:05.453 Message: 00:02:05.453 ================= 00:02:05.453 Applications Enabled 00:02:05.453 ================= 00:02:05.453 00:02:05.453 apps: 00:02:05.453 00:02:05.453 00:02:05.453 Message: 00:02:05.453 ================= 00:02:05.453 Libraries Enabled 00:02:05.453 ================= 00:02:05.453 00:02:05.453 libs: 00:02:05.453 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:02:05.453 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:02:05.453 cryptodev, dmadev, power, reorder, security, vhost, 00:02:05.453 00:02:05.453 Message: 00:02:05.453 =============== 00:02:05.453 Drivers Enabled 00:02:05.453 =============== 00:02:05.453 00:02:05.453 common: 00:02:05.453 00:02:05.453 bus: 00:02:05.453 pci, vdev, 00:02:05.453 mempool: 00:02:05.453 ring, 00:02:05.453 dma: 00:02:05.453 00:02:05.453 net: 00:02:05.453 00:02:05.453 crypto: 00:02:05.453 00:02:05.453 compress: 00:02:05.453 00:02:05.453 vdpa: 00:02:05.453 00:02:05.453 00:02:05.453 Message: 00:02:05.453 ================= 00:02:05.453 Content Skipped 00:02:05.453 ================= 00:02:05.453 00:02:05.453 apps: 00:02:05.453 dumpcap: explicitly disabled via build config 00:02:05.453 graph: explicitly disabled via build config 00:02:05.453 pdump: explicitly disabled via build config 00:02:05.453 proc-info: explicitly disabled via build config 00:02:05.453 test-acl: explicitly disabled via build config 00:02:05.453 test-bbdev: explicitly disabled via build config 00:02:05.453 test-cmdline: explicitly disabled via build config 00:02:05.453 test-compress-perf: explicitly disabled via build config 00:02:05.453 test-crypto-perf: explicitly disabled via build config 00:02:05.453 test-dma-perf: explicitly disabled via build config 00:02:05.453 test-eventdev: explicitly disabled via build config 00:02:05.453 test-fib: explicitly disabled via build config 00:02:05.453 test-flow-perf: explicitly disabled via build config 00:02:05.453 test-gpudev: explicitly disabled via build config 00:02:05.453 test-mldev: explicitly disabled via build config 00:02:05.453 test-pipeline: explicitly disabled via build config 00:02:05.453 test-pmd: explicitly disabled via build config 00:02:05.453 test-regex: explicitly disabled via build config 00:02:05.453 test-sad: explicitly disabled via build config 00:02:05.453 test-security-perf: explicitly disabled via build config 00:02:05.453 00:02:05.453 libs: 00:02:05.453 metrics: explicitly disabled via build config 00:02:05.453 acl: explicitly disabled via build config 00:02:05.453 bbdev: explicitly disabled via build config 00:02:05.453 bitratestats: explicitly disabled via build config 00:02:05.453 bpf: explicitly disabled via build config 00:02:05.453 cfgfile: explicitly disabled via build config 00:02:05.453 distributor: explicitly disabled via build config 00:02:05.453 efd: explicitly disabled via build config 00:02:05.453 eventdev: explicitly disabled via build config 00:02:05.453 dispatcher: explicitly disabled via build config 00:02:05.453 gpudev: explicitly disabled via build config 00:02:05.453 gro: explicitly disabled via build config 00:02:05.453 gso: explicitly disabled via build config 00:02:05.453 ip_frag: explicitly disabled via build config 00:02:05.453 jobstats: explicitly disabled via build config 00:02:05.453 latencystats: explicitly disabled via build config 00:02:05.453 lpm: explicitly disabled via build config 00:02:05.453 member: explicitly disabled via build config 00:02:05.453 pcapng: explicitly disabled via build config 00:02:05.453 rawdev: explicitly disabled via build config 00:02:05.453 regexdev: explicitly disabled via build config 00:02:05.453 mldev: explicitly disabled via build config 00:02:05.453 rib: explicitly disabled via build config 00:02:05.453 sched: explicitly disabled via build config 00:02:05.453 stack: explicitly disabled via build config 00:02:05.453 ipsec: explicitly disabled via build config 00:02:05.453 pdcp: explicitly disabled via build config 00:02:05.453 fib: explicitly disabled via build config 00:02:05.453 port: explicitly disabled via build config 00:02:05.453 pdump: explicitly disabled via build config 00:02:05.453 table: explicitly disabled via build config 00:02:05.453 pipeline: explicitly disabled via build config 00:02:05.453 graph: explicitly disabled via build config 00:02:05.453 node: explicitly disabled via build config 00:02:05.453 00:02:05.453 drivers: 00:02:05.453 common/cpt: not in enabled drivers build config 00:02:05.453 common/dpaax: not in enabled drivers build config 00:02:05.453 common/iavf: not in enabled drivers build config 00:02:05.453 common/idpf: not in enabled drivers build config 00:02:05.453 common/mvep: not in enabled drivers build config 00:02:05.453 common/octeontx: not in enabled drivers build config 00:02:05.453 bus/auxiliary: not in enabled drivers build config 00:02:05.453 bus/cdx: not in enabled drivers build config 00:02:05.453 bus/dpaa: not in enabled drivers build config 00:02:05.453 bus/fslmc: not in enabled drivers build config 00:02:05.453 bus/ifpga: not in enabled drivers build config 00:02:05.453 bus/platform: not in enabled drivers build config 00:02:05.453 bus/vmbus: not in enabled drivers build config 00:02:05.453 common/cnxk: not in enabled drivers build config 00:02:05.453 common/mlx5: not in enabled drivers build config 00:02:05.453 common/nfp: not in enabled drivers build config 00:02:05.453 common/qat: not in enabled drivers build config 00:02:05.453 common/sfc_efx: not in enabled drivers build config 00:02:05.453 mempool/bucket: not in enabled drivers build config 00:02:05.453 mempool/cnxk: not in enabled drivers build config 00:02:05.453 mempool/dpaa: not in enabled drivers build config 00:02:05.453 mempool/dpaa2: not in enabled drivers build config 00:02:05.453 mempool/octeontx: not in enabled drivers build config 00:02:05.453 mempool/stack: not in enabled drivers build config 00:02:05.453 dma/cnxk: not in enabled drivers build config 00:02:05.453 dma/dpaa: not in enabled drivers build config 00:02:05.453 dma/dpaa2: not in enabled drivers build config 00:02:05.453 dma/hisilicon: not in enabled drivers build config 00:02:05.453 dma/idxd: not in enabled drivers build config 00:02:05.453 dma/ioat: not in enabled drivers build config 00:02:05.453 dma/skeleton: not in enabled drivers build config 00:02:05.453 net/af_packet: not in enabled drivers build config 00:02:05.453 net/af_xdp: not in enabled drivers build config 00:02:05.453 net/ark: not in enabled drivers build config 00:02:05.453 net/atlantic: not in enabled drivers build config 00:02:05.453 net/avp: not in enabled drivers build config 00:02:05.453 net/axgbe: not in enabled drivers build config 00:02:05.453 net/bnx2x: not in enabled drivers build config 00:02:05.453 net/bnxt: not in enabled drivers build config 00:02:05.453 net/bonding: not in enabled drivers build config 00:02:05.453 net/cnxk: not in enabled drivers build config 00:02:05.453 net/cpfl: not in enabled drivers build config 00:02:05.453 net/cxgbe: not in enabled drivers build config 00:02:05.453 net/dpaa: not in enabled drivers build config 00:02:05.453 net/dpaa2: not in enabled drivers build config 00:02:05.453 net/e1000: not in enabled drivers build config 00:02:05.453 net/ena: not in enabled drivers build config 00:02:05.453 net/enetc: not in enabled drivers build config 00:02:05.453 net/enetfec: not in enabled drivers build config 00:02:05.453 net/enic: not in enabled drivers build config 00:02:05.453 net/failsafe: not in enabled drivers build config 00:02:05.453 net/fm10k: not in enabled drivers build config 00:02:05.453 net/gve: not in enabled drivers build config 00:02:05.453 net/hinic: not in enabled drivers build config 00:02:05.453 net/hns3: not in enabled drivers build config 00:02:05.453 net/i40e: not in enabled drivers build config 00:02:05.453 net/iavf: not in enabled drivers build config 00:02:05.453 net/ice: not in enabled drivers build config 00:02:05.453 net/idpf: not in enabled drivers build config 00:02:05.453 net/igc: not in enabled drivers build config 00:02:05.453 net/ionic: not in enabled drivers build config 00:02:05.453 net/ipn3ke: not in enabled drivers build config 00:02:05.454 net/ixgbe: not in enabled drivers build config 00:02:05.454 net/mana: not in enabled drivers build config 00:02:05.454 net/memif: not in enabled drivers build config 00:02:05.454 net/mlx4: not in enabled drivers build config 00:02:05.454 net/mlx5: not in enabled drivers build config 00:02:05.454 net/mvneta: not in enabled drivers build config 00:02:05.454 net/mvpp2: not in enabled drivers build config 00:02:05.454 net/netvsc: not in enabled drivers build config 00:02:05.454 net/nfb: not in enabled drivers build config 00:02:05.454 net/nfp: not in enabled drivers build config 00:02:05.454 net/ngbe: not in enabled drivers build config 00:02:05.454 net/null: not in enabled drivers build config 00:02:05.454 net/octeontx: not in enabled drivers build config 00:02:05.454 net/octeon_ep: not in enabled drivers build config 00:02:05.454 net/pcap: not in enabled drivers build config 00:02:05.454 net/pfe: not in enabled drivers build config 00:02:05.454 net/qede: not in enabled drivers build config 00:02:05.454 net/ring: not in enabled drivers build config 00:02:05.454 net/sfc: not in enabled drivers build config 00:02:05.454 net/softnic: not in enabled drivers build config 00:02:05.454 net/tap: not in enabled drivers build config 00:02:05.454 net/thunderx: not in enabled drivers build config 00:02:05.454 net/txgbe: not in enabled drivers build config 00:02:05.454 net/vdev_netvsc: not in enabled drivers build config 00:02:05.454 net/vhost: not in enabled drivers build config 00:02:05.454 net/virtio: not in enabled drivers build config 00:02:05.454 net/vmxnet3: not in enabled drivers build config 00:02:05.454 raw/*: missing internal dependency, "rawdev" 00:02:05.454 crypto/armv8: not in enabled drivers build config 00:02:05.454 crypto/bcmfs: not in enabled drivers build config 00:02:05.454 crypto/caam_jr: not in enabled drivers build config 00:02:05.454 crypto/ccp: not in enabled drivers build config 00:02:05.454 crypto/cnxk: not in enabled drivers build config 00:02:05.454 crypto/dpaa_sec: not in enabled drivers build config 00:02:05.454 crypto/dpaa2_sec: not in enabled drivers build config 00:02:05.454 crypto/ipsec_mb: not in enabled drivers build config 00:02:05.454 crypto/mlx5: not in enabled drivers build config 00:02:05.454 crypto/mvsam: not in enabled drivers build config 00:02:05.454 crypto/nitrox: not in enabled drivers build config 00:02:05.454 crypto/null: not in enabled drivers build config 00:02:05.454 crypto/octeontx: not in enabled drivers build config 00:02:05.454 crypto/openssl: not in enabled drivers build config 00:02:05.454 crypto/scheduler: not in enabled drivers build config 00:02:05.454 crypto/uadk: not in enabled drivers build config 00:02:05.454 crypto/virtio: not in enabled drivers build config 00:02:05.454 compress/isal: not in enabled drivers build config 00:02:05.454 compress/mlx5: not in enabled drivers build config 00:02:05.454 compress/octeontx: not in enabled drivers build config 00:02:05.454 compress/zlib: not in enabled drivers build config 00:02:05.454 regex/*: missing internal dependency, "regexdev" 00:02:05.454 ml/*: missing internal dependency, "mldev" 00:02:05.454 vdpa/ifc: not in enabled drivers build config 00:02:05.454 vdpa/mlx5: not in enabled drivers build config 00:02:05.454 vdpa/nfp: not in enabled drivers build config 00:02:05.454 vdpa/sfc: not in enabled drivers build config 00:02:05.454 event/*: missing internal dependency, "eventdev" 00:02:05.454 baseband/*: missing internal dependency, "bbdev" 00:02:05.454 gpu/*: missing internal dependency, "gpudev" 00:02:05.454 00:02:05.454 00:02:05.454 Build targets in project: 84 00:02:05.454 00:02:05.454 DPDK 23.11.0 00:02:05.454 00:02:05.454 User defined options 00:02:05.454 buildtype : debug 00:02:05.454 default_library : shared 00:02:05.454 libdir : lib 00:02:05.454 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:02:05.454 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:02:05.454 c_link_args : 00:02:05.454 cpu_instruction_set: native 00:02:05.454 disable_apps : test-sad,graph,test-regex,dumpcap,test-eventdev,test-compress-perf,pdump,test-security-perf,test-pmd,test-flow-perf,test-pipeline,test-crypto-perf,test-gpudev,test-cmdline,test-dma-perf,proc-info,test-bbdev,test-acl,test,test-mldev,test-fib 00:02:05.454 disable_libs : sched,port,dispatcher,graph,rawdev,pdcp,bitratestats,ipsec,pcapng,pdump,gso,cfgfile,gpudev,ip_frag,node,distributor,mldev,lpm,acl,bpf,latencystats,eventdev,regexdev,gro,stack,fib,pipeline,bbdev,table,metrics,member,jobstats,efd,rib 00:02:05.454 enable_docs : false 00:02:05.454 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:02:05.454 enable_kmods : false 00:02:05.454 tests : false 00:02:05.454 00:02:05.454 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:05.454 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:02:05.454 [1/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:02:05.454 [2/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:02:05.454 [3/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:02:05.454 [4/264] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:02:05.454 [5/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:02:05.454 [6/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:02:05.454 [7/264] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:02:05.454 [8/264] Linking static target lib/librte_kvargs.a 00:02:05.454 [9/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:02:05.454 [10/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:02:05.454 [11/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:02:05.454 [12/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:02:05.454 [13/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:02:05.454 [14/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:02:05.454 [15/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:02:05.454 [16/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:02:05.454 [17/264] Compiling C object lib/librte_log.a.p/log_log.c.o 00:02:05.454 [18/264] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:02:05.454 [19/264] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:02:05.454 [20/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:02:05.454 [21/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:02:05.454 [22/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:02:05.454 [23/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:02:05.454 [24/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:02:05.454 [25/264] Linking static target lib/librte_log.a 00:02:05.454 [26/264] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:02:05.454 [27/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:02:05.454 [28/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:02:05.454 [29/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:02:05.454 [30/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:02:05.454 [31/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:02:05.454 [32/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:02:05.454 [33/264] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:02:05.454 [34/264] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:02:05.454 [35/264] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:02:05.454 [36/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:02:05.454 [37/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:02:05.454 [38/264] Linking static target lib/librte_pci.a 00:02:05.454 [39/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:02:05.454 [40/264] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:05.454 [41/264] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:02:05.716 [42/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:05.716 [43/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:02:05.716 [44/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:02:05.716 [45/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:02:05.716 [46/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:02:05.716 [47/264] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.716 [48/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:02:05.716 [49/264] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:02:05.716 [50/264] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:02:05.716 [51/264] Linking static target lib/librte_ring.a 00:02:05.716 [52/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:02:05.716 [53/264] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.716 [54/264] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:02:05.716 [55/264] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:02:05.716 [56/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:02:05.716 [57/264] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:02:05.716 [58/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:02:05.716 [59/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:02:05.716 [60/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:02:05.716 [61/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:02:05.716 [62/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:02:05.717 [63/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:02:05.717 [64/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:02:05.717 [65/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:02:05.717 [66/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:02:05.717 [67/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:02:05.717 [68/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:02:05.717 [69/264] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:02:05.717 [70/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:02:05.717 [71/264] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:05.717 [72/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:02:05.717 [73/264] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:02:05.717 [74/264] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:02:05.717 [75/264] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:02:05.717 [76/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:02:05.717 [77/264] Linking static target lib/librte_meter.a 00:02:05.717 [78/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:02:05.717 [79/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:02:05.717 [80/264] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:02:05.717 [81/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:05.977 [82/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:02:05.977 [83/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:02:05.977 [84/264] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:02:05.977 [85/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:02:05.977 [86/264] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:05.977 [87/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:02:05.977 [88/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:02:05.977 [89/264] Linking static target lib/librte_telemetry.a 00:02:05.977 [90/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:02:05.977 [91/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:02:05.977 [92/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:05.977 [93/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:02:05.977 [94/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:02:05.977 [95/264] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:02:05.977 [96/264] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:02:05.977 [97/264] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:02:05.977 [98/264] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:02:05.977 [99/264] Linking static target lib/librte_timer.a 00:02:05.977 [100/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:02:05.977 [101/264] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:02:05.977 [102/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:02:05.977 [103/264] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:05.977 [104/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:02:05.977 [105/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:02:05.977 [106/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:02:05.977 [107/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:02:05.977 [108/264] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:02:05.977 [109/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:02:05.977 [110/264] Linking static target lib/librte_compressdev.a 00:02:05.977 [111/264] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:02:05.977 [112/264] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:05.977 [113/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:02:05.977 [114/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:02:05.977 [115/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:02:05.978 [116/264] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:02:05.978 [117/264] Compiling C object lib/librte_net.a.p/net_net_crc_avx512.c.o 00:02:05.978 [118/264] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:02:05.978 [119/264] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:02:05.978 [120/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:02:05.978 [121/264] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:02:05.978 [122/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:02:05.978 [123/264] Linking static target lib/librte_dmadev.a 00:02:05.978 [124/264] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:02:05.978 [125/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:02:05.978 [126/264] Linking static target lib/librte_rcu.a 00:02:05.978 [127/264] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:05.978 [128/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:02:05.978 [129/264] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:05.978 [130/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:02:05.978 [131/264] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:02:05.978 [132/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:02:05.978 [133/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:02:05.978 [134/264] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:02:05.978 [135/264] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:02:05.978 [136/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:02:05.978 [137/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:02:05.978 [138/264] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:02:05.978 [139/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:02:05.978 [140/264] Linking static target lib/librte_cmdline.a 00:02:05.978 [141/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:02:05.978 [142/264] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:02:05.978 [143/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:02:05.978 [144/264] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:05.978 [145/264] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.978 [146/264] Linking static target lib/librte_net.a 00:02:05.978 [147/264] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:02:05.978 [148/264] Linking static target lib/librte_power.a 00:02:05.978 [149/264] Linking static target lib/librte_mempool.a 00:02:05.978 [150/264] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:02:05.978 [151/264] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.978 [152/264] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:05.978 [153/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:02:05.978 [154/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:02:05.978 [155/264] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:05.978 [156/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:02:05.978 [157/264] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:02:05.978 [158/264] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:05.978 [159/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:02:05.978 [160/264] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:05.978 [161/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:05.978 [162/264] Linking static target lib/librte_reorder.a 00:02:05.978 [163/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:05.978 [164/264] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:02:05.978 [165/264] Linking target lib/librte_log.so.24.0 00:02:06.240 [166/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:02:06.240 [167/264] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:02:06.240 [168/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:02:06.240 [169/264] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:06.240 [170/264] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:06.240 [171/264] Linking static target lib/librte_eal.a 00:02:06.240 [172/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:06.240 [173/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:02:06.240 [174/264] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:06.240 [175/264] Linking static target lib/librte_security.a 00:02:06.240 [176/264] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:06.240 [177/264] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:06.240 [178/264] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:06.240 [179/264] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:06.240 [180/264] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:02:06.240 [181/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:02:06.240 [182/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:06.240 [183/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:02:06.240 [184/264] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:06.240 [185/264] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:06.240 [186/264] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:06.240 [187/264] Linking static target lib/librte_mbuf.a 00:02:06.240 [188/264] Linking static target lib/librte_hash.a 00:02:06.240 [189/264] Linking static target drivers/librte_bus_vdev.a 00:02:06.240 [190/264] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:06.240 [191/264] Linking target lib/librte_kvargs.so.24.0 00:02:06.240 [192/264] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:06.240 [193/264] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:06.240 [194/264] Linking static target lib/librte_cryptodev.a 00:02:06.240 [195/264] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:06.240 [196/264] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.240 [197/264] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:06.240 [198/264] Linking static target drivers/librte_mempool_ring.a 00:02:06.240 [199/264] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.240 [200/264] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:06.240 [201/264] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.501 [202/264] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:06.502 [203/264] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:06.502 [204/264] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.502 [205/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:06.502 [206/264] Linking static target drivers/librte_bus_pci.a 00:02:06.502 [207/264] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:02:06.502 [208/264] Linking target lib/librte_telemetry.so.24.0 00:02:06.502 [209/264] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.502 [210/264] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.502 [211/264] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:02:06.502 [212/264] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.763 [213/264] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:06.763 [214/264] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:06.763 [215/264] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.025 [216/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:07.025 [217/264] Linking static target lib/librte_ethdev.a 00:02:07.025 [218/264] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.025 [219/264] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.025 [220/264] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.025 [221/264] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.285 [222/264] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.285 [223/264] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.858 [224/264] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:07.858 [225/264] Linking static target lib/librte_vhost.a 00:02:08.432 [226/264] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:10.350 [227/264] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.944 [228/264] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:17.889 [229/264] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:17.889 [230/264] Linking target lib/librte_eal.so.24.0 00:02:17.889 [231/264] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:18.154 [232/264] Linking target lib/librte_dmadev.so.24.0 00:02:18.154 [233/264] Linking target lib/librte_timer.so.24.0 00:02:18.154 [234/264] Linking target lib/librte_ring.so.24.0 00:02:18.154 [235/264] Linking target lib/librte_meter.so.24.0 00:02:18.154 [236/264] Linking target lib/librte_pci.so.24.0 00:02:18.154 [237/264] Linking target drivers/librte_bus_vdev.so.24.0 00:02:18.154 [238/264] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:18.154 [239/264] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:18.154 [240/264] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:18.154 [241/264] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:18.154 [242/264] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:18.154 [243/264] Linking target drivers/librte_bus_pci.so.24.0 00:02:18.154 [244/264] Linking target lib/librte_rcu.so.24.0 00:02:18.154 [245/264] Linking target lib/librte_mempool.so.24.0 00:02:18.437 [246/264] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:18.437 [247/264] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:18.437 [248/264] Linking target drivers/librte_mempool_ring.so.24.0 00:02:18.437 [249/264] Linking target lib/librte_mbuf.so.24.0 00:02:18.712 [250/264] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:18.712 [251/264] Linking target lib/librte_cryptodev.so.24.0 00:02:18.712 [252/264] Linking target lib/librte_reorder.so.24.0 00:02:18.712 [253/264] Linking target lib/librte_compressdev.so.24.0 00:02:18.712 [254/264] Linking target lib/librte_net.so.24.0 00:02:18.712 [255/264] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:18.712 [256/264] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:18.712 [257/264] Linking target lib/librte_security.so.24.0 00:02:18.712 [258/264] Linking target lib/librte_cmdline.so.24.0 00:02:18.712 [259/264] Linking target lib/librte_hash.so.24.0 00:02:18.973 [260/264] Linking target lib/librte_ethdev.so.24.0 00:02:18.974 [261/264] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:18.974 [262/264] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:18.974 [263/264] Linking target lib/librte_vhost.so.24.0 00:02:18.974 [264/264] Linking target lib/librte_power.so.24.0 00:02:18.974 INFO: autodetecting backend as ninja 00:02:18.974 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 144 00:02:19.918 CC lib/ut/ut.o 00:02:19.918 CC lib/ut_mock/mock.o 00:02:19.918 CC lib/log/log.o 00:02:19.918 CC lib/log/log_flags.o 00:02:19.918 CC lib/log/log_deprecated.o 00:02:20.179 LIB libspdk_ut_mock.a 00:02:20.179 LIB libspdk_ut.a 00:02:20.179 LIB libspdk_log.a 00:02:20.179 SO libspdk_ut.so.1.0 00:02:20.179 SO libspdk_ut_mock.so.5.0 00:02:20.179 SO libspdk_log.so.6.1 00:02:20.179 SYMLINK libspdk_ut.so 00:02:20.179 SYMLINK libspdk_ut_mock.so 00:02:20.179 SYMLINK libspdk_log.so 00:02:20.441 CXX lib/trace_parser/trace.o 00:02:20.441 CC lib/dma/dma.o 00:02:20.441 CC lib/util/base64.o 00:02:20.441 CC lib/util/bit_array.o 00:02:20.441 CC lib/util/cpuset.o 00:02:20.441 CC lib/ioat/ioat.o 00:02:20.441 CC lib/util/crc16.o 00:02:20.441 CC lib/util/crc32.o 00:02:20.441 CC lib/util/crc32c.o 00:02:20.441 CC lib/util/crc32_ieee.o 00:02:20.441 CC lib/util/crc64.o 00:02:20.441 CC lib/util/dif.o 00:02:20.441 CC lib/util/fd.o 00:02:20.441 CC lib/util/file.o 00:02:20.441 CC lib/util/hexlify.o 00:02:20.441 CC lib/util/iov.o 00:02:20.441 CC lib/util/math.o 00:02:20.441 CC lib/util/pipe.o 00:02:20.441 CC lib/util/strerror_tls.o 00:02:20.441 CC lib/util/string.o 00:02:20.441 CC lib/util/uuid.o 00:02:20.441 CC lib/util/fd_group.o 00:02:20.441 CC lib/util/xor.o 00:02:20.441 CC lib/util/zipf.o 00:02:20.701 CC lib/vfio_user/host/vfio_user_pci.o 00:02:20.701 CC lib/vfio_user/host/vfio_user.o 00:02:20.701 LIB libspdk_dma.a 00:02:20.701 SO libspdk_dma.so.3.0 00:02:20.701 SYMLINK libspdk_dma.so 00:02:20.701 LIB libspdk_ioat.a 00:02:20.701 SO libspdk_ioat.so.6.0 00:02:20.701 LIB libspdk_vfio_user.a 00:02:20.701 LIB libspdk_util.a 00:02:20.701 SYMLINK libspdk_ioat.so 00:02:20.961 SO libspdk_vfio_user.so.4.0 00:02:20.961 SO libspdk_util.so.8.0 00:02:20.961 SYMLINK libspdk_vfio_user.so 00:02:20.961 SYMLINK libspdk_util.so 00:02:21.222 LIB libspdk_trace_parser.a 00:02:21.222 SO libspdk_trace_parser.so.4.0 00:02:21.222 CC lib/conf/conf.o 00:02:21.222 CC lib/rdma/common.o 00:02:21.222 CC lib/rdma/rdma_verbs.o 00:02:21.222 CC lib/json/json_parse.o 00:02:21.222 CC lib/json/json_util.o 00:02:21.222 CC lib/idxd/idxd.o 00:02:21.222 CC lib/idxd/idxd_user.o 00:02:21.222 CC lib/json/json_write.o 00:02:21.222 CC lib/vmd/vmd.o 00:02:21.222 CC lib/env_dpdk/env.o 00:02:21.222 CC lib/vmd/led.o 00:02:21.222 CC lib/env_dpdk/memory.o 00:02:21.222 CC lib/env_dpdk/init.o 00:02:21.222 CC lib/env_dpdk/pci.o 00:02:21.222 CC lib/env_dpdk/threads.o 00:02:21.222 CC lib/env_dpdk/pci_ioat.o 00:02:21.222 CC lib/env_dpdk/pci_vmd.o 00:02:21.222 CC lib/env_dpdk/pci_virtio.o 00:02:21.223 CC lib/env_dpdk/pci_idxd.o 00:02:21.223 CC lib/env_dpdk/pci_event.o 00:02:21.223 CC lib/env_dpdk/sigbus_handler.o 00:02:21.223 CC lib/env_dpdk/pci_dpdk.o 00:02:21.223 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:21.223 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:21.223 SYMLINK libspdk_trace_parser.so 00:02:21.484 LIB libspdk_conf.a 00:02:21.484 SO libspdk_conf.so.5.0 00:02:21.484 LIB libspdk_rdma.a 00:02:21.484 LIB libspdk_json.a 00:02:21.484 SO libspdk_rdma.so.5.0 00:02:21.746 SYMLINK libspdk_conf.so 00:02:21.746 SO libspdk_json.so.5.1 00:02:21.746 SYMLINK libspdk_rdma.so 00:02:21.746 SYMLINK libspdk_json.so 00:02:21.746 LIB libspdk_idxd.a 00:02:21.746 SO libspdk_idxd.so.11.0 00:02:21.746 LIB libspdk_vmd.a 00:02:22.008 SYMLINK libspdk_idxd.so 00:02:22.008 SO libspdk_vmd.so.5.0 00:02:22.008 CC lib/jsonrpc/jsonrpc_server.o 00:02:22.008 CC lib/jsonrpc/jsonrpc_client.o 00:02:22.008 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:22.008 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:22.008 SYMLINK libspdk_vmd.so 00:02:22.270 LIB libspdk_jsonrpc.a 00:02:22.270 SO libspdk_jsonrpc.so.5.1 00:02:22.270 SYMLINK libspdk_jsonrpc.so 00:02:22.530 LIB libspdk_env_dpdk.a 00:02:22.530 CC lib/rpc/rpc.o 00:02:22.530 SO libspdk_env_dpdk.so.13.0 00:02:22.791 SYMLINK libspdk_env_dpdk.so 00:02:22.791 LIB libspdk_rpc.a 00:02:22.791 SO libspdk_rpc.so.5.0 00:02:22.791 SYMLINK libspdk_rpc.so 00:02:23.052 CC lib/sock/sock.o 00:02:23.052 CC lib/sock/sock_rpc.o 00:02:23.052 CC lib/notify/notify.o 00:02:23.052 CC lib/trace/trace.o 00:02:23.052 CC lib/notify/notify_rpc.o 00:02:23.052 CC lib/trace/trace_flags.o 00:02:23.052 CC lib/trace/trace_rpc.o 00:02:23.315 LIB libspdk_notify.a 00:02:23.315 LIB libspdk_trace.a 00:02:23.315 SO libspdk_notify.so.5.0 00:02:23.315 SO libspdk_trace.so.9.0 00:02:23.315 SYMLINK libspdk_notify.so 00:02:23.315 SYMLINK libspdk_trace.so 00:02:23.315 LIB libspdk_sock.a 00:02:23.315 SO libspdk_sock.so.8.0 00:02:23.576 SYMLINK libspdk_sock.so 00:02:23.576 CC lib/thread/thread.o 00:02:23.576 CC lib/thread/iobuf.o 00:02:23.838 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:23.838 CC lib/nvme/nvme_ctrlr.o 00:02:23.838 CC lib/nvme/nvme_fabric.o 00:02:23.838 CC lib/nvme/nvme_ns_cmd.o 00:02:23.838 CC lib/nvme/nvme_ns.o 00:02:23.838 CC lib/nvme/nvme_pcie_common.o 00:02:23.838 CC lib/nvme/nvme_pcie.o 00:02:23.838 CC lib/nvme/nvme_qpair.o 00:02:23.838 CC lib/nvme/nvme.o 00:02:23.838 CC lib/nvme/nvme_quirks.o 00:02:23.838 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:23.838 CC lib/nvme/nvme_transport.o 00:02:23.838 CC lib/nvme/nvme_discovery.o 00:02:23.838 CC lib/nvme/nvme_opal.o 00:02:23.838 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:23.838 CC lib/nvme/nvme_tcp.o 00:02:23.838 CC lib/nvme/nvme_io_msg.o 00:02:23.838 CC lib/nvme/nvme_poll_group.o 00:02:23.838 CC lib/nvme/nvme_zns.o 00:02:23.838 CC lib/nvme/nvme_cuse.o 00:02:23.838 CC lib/nvme/nvme_vfio_user.o 00:02:23.838 CC lib/nvme/nvme_rdma.o 00:02:25.228 LIB libspdk_thread.a 00:02:25.228 SO libspdk_thread.so.9.0 00:02:25.228 SYMLINK libspdk_thread.so 00:02:25.228 CC lib/accel/accel.o 00:02:25.228 CC lib/accel/accel_rpc.o 00:02:25.228 CC lib/blob/blobstore.o 00:02:25.228 CC lib/accel/accel_sw.o 00:02:25.228 CC lib/blob/request.o 00:02:25.228 CC lib/blob/zeroes.o 00:02:25.228 CC lib/blob/blob_bs_dev.o 00:02:25.228 CC lib/init/json_config.o 00:02:25.228 CC lib/init/subsystem.o 00:02:25.228 CC lib/init/subsystem_rpc.o 00:02:25.228 CC lib/init/rpc.o 00:02:25.228 CC lib/virtio/virtio.o 00:02:25.228 CC lib/virtio/virtio_vhost_user.o 00:02:25.228 CC lib/virtio/virtio_vfio_user.o 00:02:25.228 CC lib/virtio/virtio_pci.o 00:02:25.489 LIB libspdk_init.a 00:02:25.489 SO libspdk_init.so.4.0 00:02:25.489 LIB libspdk_virtio.a 00:02:25.489 LIB libspdk_nvme.a 00:02:25.489 SO libspdk_virtio.so.6.0 00:02:25.489 SYMLINK libspdk_init.so 00:02:25.749 SYMLINK libspdk_virtio.so 00:02:25.749 SO libspdk_nvme.so.12.0 00:02:25.749 CC lib/event/app.o 00:02:25.749 CC lib/event/reactor.o 00:02:25.749 CC lib/event/log_rpc.o 00:02:25.749 CC lib/event/app_rpc.o 00:02:25.749 CC lib/event/scheduler_static.o 00:02:26.011 SYMLINK libspdk_nvme.so 00:02:26.011 LIB libspdk_accel.a 00:02:26.272 SO libspdk_accel.so.14.0 00:02:26.272 LIB libspdk_event.a 00:02:26.272 SYMLINK libspdk_accel.so 00:02:26.272 SO libspdk_event.so.12.0 00:02:26.272 SYMLINK libspdk_event.so 00:02:26.533 CC lib/bdev/bdev.o 00:02:26.533 CC lib/bdev/bdev_rpc.o 00:02:26.533 CC lib/bdev/part.o 00:02:26.533 CC lib/bdev/bdev_zone.o 00:02:26.533 CC lib/bdev/scsi_nvme.o 00:02:27.476 LIB libspdk_blob.a 00:02:27.736 SO libspdk_blob.so.10.1 00:02:27.736 SYMLINK libspdk_blob.so 00:02:27.998 CC lib/blobfs/blobfs.o 00:02:27.998 CC lib/blobfs/tree.o 00:02:27.998 CC lib/lvol/lvol.o 00:02:28.571 LIB libspdk_blobfs.a 00:02:28.571 LIB libspdk_bdev.a 00:02:28.571 SO libspdk_blobfs.so.9.0 00:02:28.571 SO libspdk_bdev.so.14.0 00:02:28.832 LIB libspdk_lvol.a 00:02:28.832 SO libspdk_lvol.so.9.1 00:02:28.832 SYMLINK libspdk_blobfs.so 00:02:28.832 SYMLINK libspdk_bdev.so 00:02:28.832 SYMLINK libspdk_lvol.so 00:02:29.097 CC lib/ftl/ftl_core.o 00:02:29.098 CC lib/ftl/ftl_init.o 00:02:29.098 CC lib/ftl/ftl_layout.o 00:02:29.098 CC lib/ftl/ftl_debug.o 00:02:29.098 CC lib/ftl/ftl_io.o 00:02:29.098 CC lib/ftl/ftl_sb.o 00:02:29.098 CC lib/ftl/ftl_l2p.o 00:02:29.098 CC lib/ftl/ftl_l2p_flat.o 00:02:29.098 CC lib/ftl/ftl_nv_cache.o 00:02:29.098 CC lib/ftl/ftl_band.o 00:02:29.098 CC lib/ftl/ftl_band_ops.o 00:02:29.098 CC lib/ftl/ftl_writer.o 00:02:29.098 CC lib/ftl/ftl_rq.o 00:02:29.098 CC lib/ftl/ftl_reloc.o 00:02:29.098 CC lib/ftl/ftl_l2p_cache.o 00:02:29.098 CC lib/ftl/ftl_p2l.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:29.098 CC lib/nvmf/ctrlr.o 00:02:29.098 CC lib/ublk/ublk.o 00:02:29.098 CC lib/nvmf/ctrlr_discovery.o 00:02:29.098 CC lib/nvmf/ctrlr_bdev.o 00:02:29.098 CC lib/nvmf/subsystem.o 00:02:29.098 CC lib/ublk/ublk_rpc.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:29.098 CC lib/nvmf/nvmf.o 00:02:29.098 CC lib/scsi/dev.o 00:02:29.098 CC lib/nvmf/transport.o 00:02:29.098 CC lib/scsi/lun.o 00:02:29.098 CC lib/nvmf/nvmf_rpc.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:29.098 CC lib/scsi/port.o 00:02:29.098 CC lib/nvmf/tcp.o 00:02:29.098 CC lib/scsi/scsi.o 00:02:29.098 CC lib/nvmf/rdma.o 00:02:29.098 CC lib/nbd/nbd.o 00:02:29.098 CC lib/scsi/scsi_bdev.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:29.098 CC lib/nbd/nbd_rpc.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:29.098 CC lib/scsi/scsi_rpc.o 00:02:29.098 CC lib/scsi/scsi_pr.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:29.098 CC lib/scsi/task.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:29.098 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:29.098 CC lib/ftl/utils/ftl_conf.o 00:02:29.098 CC lib/ftl/utils/ftl_md.o 00:02:29.098 CC lib/ftl/utils/ftl_mempool.o 00:02:29.098 CC lib/ftl/utils/ftl_bitmap.o 00:02:29.098 CC lib/ftl/utils/ftl_property.o 00:02:29.098 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:29.098 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:29.098 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:29.098 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:29.098 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:29.098 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:29.098 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:29.098 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:29.098 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:29.098 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:29.098 CC lib/ftl/base/ftl_base_dev.o 00:02:29.098 CC lib/ftl/base/ftl_base_bdev.o 00:02:29.098 CC lib/ftl/ftl_trace.o 00:02:29.672 LIB libspdk_nbd.a 00:02:29.672 SO libspdk_nbd.so.6.0 00:02:29.672 LIB libspdk_scsi.a 00:02:29.672 SO libspdk_scsi.so.8.0 00:02:29.672 SYMLINK libspdk_nbd.so 00:02:29.672 LIB libspdk_ublk.a 00:02:29.672 SYMLINK libspdk_scsi.so 00:02:29.672 SO libspdk_ublk.so.2.0 00:02:29.933 SYMLINK libspdk_ublk.so 00:02:29.933 LIB libspdk_ftl.a 00:02:29.933 CC lib/iscsi/conn.o 00:02:29.933 CC lib/iscsi/iscsi.o 00:02:29.933 CC lib/iscsi/init_grp.o 00:02:29.933 CC lib/vhost/vhost.o 00:02:29.933 CC lib/vhost/vhost_scsi.o 00:02:29.933 CC lib/vhost/vhost_rpc.o 00:02:29.933 CC lib/iscsi/md5.o 00:02:29.933 CC lib/vhost/rte_vhost_user.o 00:02:29.933 CC lib/iscsi/param.o 00:02:29.933 CC lib/vhost/vhost_blk.o 00:02:29.933 CC lib/iscsi/portal_grp.o 00:02:29.933 CC lib/iscsi/iscsi_subsystem.o 00:02:29.933 CC lib/iscsi/tgt_node.o 00:02:29.933 CC lib/iscsi/iscsi_rpc.o 00:02:29.933 CC lib/iscsi/task.o 00:02:30.194 SO libspdk_ftl.so.8.0 00:02:30.194 SYMLINK libspdk_ftl.so 00:02:30.766 LIB libspdk_nvmf.a 00:02:30.766 SO libspdk_nvmf.so.17.0 00:02:30.766 LIB libspdk_vhost.a 00:02:31.027 SO libspdk_vhost.so.7.1 00:02:31.027 SYMLINK libspdk_nvmf.so 00:02:31.027 LIB libspdk_iscsi.a 00:02:31.027 SYMLINK libspdk_vhost.so 00:02:31.027 SO libspdk_iscsi.so.7.0 00:02:31.288 SYMLINK libspdk_iscsi.so 00:02:31.549 CC module/env_dpdk/env_dpdk_rpc.o 00:02:31.810 CC module/sock/posix/posix.o 00:02:31.810 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:31.810 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:31.810 CC module/accel/dsa/accel_dsa.o 00:02:31.810 CC module/accel/dsa/accel_dsa_rpc.o 00:02:31.810 CC module/blob/bdev/blob_bdev.o 00:02:31.810 CC module/accel/ioat/accel_ioat.o 00:02:31.810 CC module/accel/error/accel_error.o 00:02:31.810 CC module/accel/error/accel_error_rpc.o 00:02:31.810 CC module/accel/ioat/accel_ioat_rpc.o 00:02:31.810 CC module/scheduler/gscheduler/gscheduler.o 00:02:31.810 CC module/accel/iaa/accel_iaa.o 00:02:31.810 CC module/accel/iaa/accel_iaa_rpc.o 00:02:31.810 LIB libspdk_env_dpdk_rpc.a 00:02:31.810 SO libspdk_env_dpdk_rpc.so.5.0 00:02:31.810 SYMLINK libspdk_env_dpdk_rpc.so 00:02:31.810 LIB libspdk_scheduler_dpdk_governor.a 00:02:31.810 LIB libspdk_scheduler_gscheduler.a 00:02:32.072 LIB libspdk_scheduler_dynamic.a 00:02:32.072 LIB libspdk_accel_error.a 00:02:32.072 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:32.072 LIB libspdk_accel_ioat.a 00:02:32.072 SO libspdk_scheduler_gscheduler.so.3.0 00:02:32.072 LIB libspdk_accel_iaa.a 00:02:32.072 LIB libspdk_accel_dsa.a 00:02:32.072 SO libspdk_accel_error.so.1.0 00:02:32.072 SO libspdk_scheduler_dynamic.so.3.0 00:02:32.072 SO libspdk_accel_ioat.so.5.0 00:02:32.072 SYMLINK libspdk_scheduler_gscheduler.so 00:02:32.072 SO libspdk_accel_iaa.so.2.0 00:02:32.072 LIB libspdk_blob_bdev.a 00:02:32.072 SO libspdk_accel_dsa.so.4.0 00:02:32.072 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:32.072 SO libspdk_blob_bdev.so.10.1 00:02:32.072 SYMLINK libspdk_scheduler_dynamic.so 00:02:32.072 SYMLINK libspdk_accel_error.so 00:02:32.072 SYMLINK libspdk_accel_ioat.so 00:02:32.072 SYMLINK libspdk_accel_iaa.so 00:02:32.072 SYMLINK libspdk_accel_dsa.so 00:02:32.072 SYMLINK libspdk_blob_bdev.so 00:02:32.334 LIB libspdk_sock_posix.a 00:02:32.334 SO libspdk_sock_posix.so.5.0 00:02:32.592 CC module/bdev/delay/vbdev_delay.o 00:02:32.592 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:32.592 CC module/bdev/gpt/gpt.o 00:02:32.592 CC module/bdev/raid/bdev_raid.o 00:02:32.592 CC module/bdev/null/bdev_null.o 00:02:32.592 CC module/bdev/gpt/vbdev_gpt.o 00:02:32.592 CC module/bdev/raid/bdev_raid_sb.o 00:02:32.592 CC module/blobfs/bdev/blobfs_bdev.o 00:02:32.592 CC module/bdev/raid/bdev_raid_rpc.o 00:02:32.592 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:32.592 CC module/bdev/null/bdev_null_rpc.o 00:02:32.592 CC module/bdev/raid/raid0.o 00:02:32.592 SYMLINK libspdk_sock_posix.so 00:02:32.592 CC module/bdev/error/vbdev_error.o 00:02:32.592 CC module/bdev/error/vbdev_error_rpc.o 00:02:32.592 CC module/bdev/raid/raid1.o 00:02:32.592 CC module/bdev/raid/concat.o 00:02:32.592 CC module/bdev/lvol/vbdev_lvol.o 00:02:32.592 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:32.592 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:32.592 CC module/bdev/nvme/bdev_nvme.o 00:02:32.592 CC module/bdev/passthru/vbdev_passthru.o 00:02:32.592 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:32.592 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:32.592 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:32.592 CC module/bdev/split/vbdev_split.o 00:02:32.592 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:32.592 CC module/bdev/iscsi/bdev_iscsi.o 00:02:32.592 CC module/bdev/nvme/nvme_rpc.o 00:02:32.592 CC module/bdev/malloc/bdev_malloc.o 00:02:32.592 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:32.592 CC module/bdev/aio/bdev_aio.o 00:02:32.592 CC module/bdev/nvme/bdev_mdns_client.o 00:02:32.592 CC module/bdev/split/vbdev_split_rpc.o 00:02:32.592 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:32.592 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:32.592 CC module/bdev/nvme/vbdev_opal.o 00:02:32.592 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:32.592 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:32.592 CC module/bdev/aio/bdev_aio_rpc.o 00:02:32.592 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:32.592 CC module/bdev/ftl/bdev_ftl.o 00:02:32.592 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:32.853 LIB libspdk_blobfs_bdev.a 00:02:32.853 LIB libspdk_bdev_null.a 00:02:32.853 LIB libspdk_bdev_gpt.a 00:02:32.853 LIB libspdk_bdev_split.a 00:02:32.853 SO libspdk_blobfs_bdev.so.5.0 00:02:32.853 SO libspdk_bdev_null.so.5.0 00:02:32.853 SO libspdk_bdev_gpt.so.5.0 00:02:32.853 LIB libspdk_bdev_error.a 00:02:32.853 SO libspdk_bdev_split.so.5.0 00:02:32.853 LIB libspdk_bdev_passthru.a 00:02:32.853 LIB libspdk_bdev_ftl.a 00:02:32.853 LIB libspdk_bdev_zone_block.a 00:02:32.853 LIB libspdk_bdev_aio.a 00:02:32.853 SYMLINK libspdk_blobfs_bdev.so 00:02:32.853 SYMLINK libspdk_bdev_null.so 00:02:32.853 LIB libspdk_bdev_delay.a 00:02:32.853 SO libspdk_bdev_error.so.5.0 00:02:32.853 SO libspdk_bdev_passthru.so.5.0 00:02:32.853 SO libspdk_bdev_zone_block.so.5.0 00:02:32.853 SO libspdk_bdev_ftl.so.5.0 00:02:32.853 SYMLINK libspdk_bdev_split.so 00:02:32.853 SO libspdk_bdev_aio.so.5.0 00:02:32.853 SYMLINK libspdk_bdev_gpt.so 00:02:32.853 LIB libspdk_bdev_malloc.a 00:02:32.853 SO libspdk_bdev_delay.so.5.0 00:02:32.853 LIB libspdk_bdev_iscsi.a 00:02:32.853 SO libspdk_bdev_malloc.so.5.0 00:02:32.853 SYMLINK libspdk_bdev_error.so 00:02:32.853 SYMLINK libspdk_bdev_passthru.so 00:02:32.853 SYMLINK libspdk_bdev_zone_block.so 00:02:32.853 SO libspdk_bdev_iscsi.so.5.0 00:02:32.853 SYMLINK libspdk_bdev_ftl.so 00:02:32.853 SYMLINK libspdk_bdev_aio.so 00:02:33.114 SYMLINK libspdk_bdev_delay.so 00:02:33.114 LIB libspdk_bdev_lvol.a 00:02:33.114 SYMLINK libspdk_bdev_malloc.so 00:02:33.114 LIB libspdk_bdev_virtio.a 00:02:33.114 SO libspdk_bdev_lvol.so.5.0 00:02:33.114 SYMLINK libspdk_bdev_iscsi.so 00:02:33.114 SO libspdk_bdev_virtio.so.5.0 00:02:33.114 SYMLINK libspdk_bdev_lvol.so 00:02:33.114 SYMLINK libspdk_bdev_virtio.so 00:02:33.375 LIB libspdk_bdev_raid.a 00:02:33.375 SO libspdk_bdev_raid.so.5.0 00:02:33.375 SYMLINK libspdk_bdev_raid.so 00:02:34.317 LIB libspdk_bdev_nvme.a 00:02:34.577 SO libspdk_bdev_nvme.so.6.0 00:02:34.577 SYMLINK libspdk_bdev_nvme.so 00:02:35.192 CC module/event/subsystems/iobuf/iobuf.o 00:02:35.192 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:35.192 CC module/event/subsystems/sock/sock.o 00:02:35.192 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:35.192 CC module/event/subsystems/vmd/vmd.o 00:02:35.192 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:35.192 CC module/event/subsystems/scheduler/scheduler.o 00:02:35.192 LIB libspdk_event_sock.a 00:02:35.192 LIB libspdk_event_vhost_blk.a 00:02:35.192 LIB libspdk_event_scheduler.a 00:02:35.192 LIB libspdk_event_vmd.a 00:02:35.192 LIB libspdk_event_iobuf.a 00:02:35.192 SO libspdk_event_sock.so.4.0 00:02:35.192 SO libspdk_event_vhost_blk.so.2.0 00:02:35.192 SO libspdk_event_scheduler.so.3.0 00:02:35.192 SO libspdk_event_vmd.so.5.0 00:02:35.192 SO libspdk_event_iobuf.so.2.0 00:02:35.454 SYMLINK libspdk_event_sock.so 00:02:35.454 SYMLINK libspdk_event_vhost_blk.so 00:02:35.454 SYMLINK libspdk_event_vmd.so 00:02:35.454 SYMLINK libspdk_event_scheduler.so 00:02:35.454 SYMLINK libspdk_event_iobuf.so 00:02:35.454 CC module/event/subsystems/accel/accel.o 00:02:35.716 LIB libspdk_event_accel.a 00:02:35.716 SO libspdk_event_accel.so.5.0 00:02:35.716 SYMLINK libspdk_event_accel.so 00:02:35.976 CC module/event/subsystems/bdev/bdev.o 00:02:36.237 LIB libspdk_event_bdev.a 00:02:36.237 SO libspdk_event_bdev.so.5.0 00:02:36.237 SYMLINK libspdk_event_bdev.so 00:02:36.498 CC module/event/subsystems/scsi/scsi.o 00:02:36.498 CC module/event/subsystems/ublk/ublk.o 00:02:36.498 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:36.498 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:36.498 CC module/event/subsystems/nbd/nbd.o 00:02:36.760 LIB libspdk_event_scsi.a 00:02:36.760 LIB libspdk_event_ublk.a 00:02:36.760 LIB libspdk_event_nbd.a 00:02:36.760 SO libspdk_event_scsi.so.5.0 00:02:36.760 SO libspdk_event_nbd.so.5.0 00:02:36.760 SO libspdk_event_ublk.so.2.0 00:02:36.760 LIB libspdk_event_nvmf.a 00:02:36.760 SO libspdk_event_nvmf.so.5.0 00:02:36.760 SYMLINK libspdk_event_scsi.so 00:02:36.760 SYMLINK libspdk_event_nbd.so 00:02:36.760 SYMLINK libspdk_event_ublk.so 00:02:36.760 SYMLINK libspdk_event_nvmf.so 00:02:37.021 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:37.021 CC module/event/subsystems/iscsi/iscsi.o 00:02:37.282 LIB libspdk_event_vhost_scsi.a 00:02:37.282 LIB libspdk_event_iscsi.a 00:02:37.282 SO libspdk_event_vhost_scsi.so.2.0 00:02:37.282 SO libspdk_event_iscsi.so.5.0 00:02:37.282 SYMLINK libspdk_event_vhost_scsi.so 00:02:37.282 SYMLINK libspdk_event_iscsi.so 00:02:37.543 SO libspdk.so.5.0 00:02:37.543 SYMLINK libspdk.so 00:02:37.815 CC app/spdk_lspci/spdk_lspci.o 00:02:37.815 TEST_HEADER include/spdk/accel.h 00:02:37.815 TEST_HEADER include/spdk/assert.h 00:02:37.815 TEST_HEADER include/spdk/accel_module.h 00:02:37.815 TEST_HEADER include/spdk/barrier.h 00:02:37.815 TEST_HEADER include/spdk/base64.h 00:02:37.815 TEST_HEADER include/spdk/bdev.h 00:02:37.815 TEST_HEADER include/spdk/bdev_module.h 00:02:37.815 TEST_HEADER include/spdk/bdev_zone.h 00:02:37.815 TEST_HEADER include/spdk/bit_pool.h 00:02:37.815 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:37.815 CXX app/trace/trace.o 00:02:37.815 TEST_HEADER include/spdk/bit_array.h 00:02:37.815 TEST_HEADER include/spdk/blobfs.h 00:02:37.815 TEST_HEADER include/spdk/blob_bdev.h 00:02:37.815 CC app/trace_record/trace_record.o 00:02:37.815 TEST_HEADER include/spdk/blob.h 00:02:37.815 TEST_HEADER include/spdk/conf.h 00:02:37.815 TEST_HEADER include/spdk/config.h 00:02:37.815 CC app/spdk_nvme_discover/discovery_aer.o 00:02:37.815 TEST_HEADER include/spdk/crc32.h 00:02:37.815 CC test/rpc_client/rpc_client_test.o 00:02:37.815 TEST_HEADER include/spdk/crc64.h 00:02:37.815 TEST_HEADER include/spdk/crc16.h 00:02:37.815 TEST_HEADER include/spdk/cpuset.h 00:02:37.815 TEST_HEADER include/spdk/dif.h 00:02:37.815 CC app/spdk_top/spdk_top.o 00:02:37.815 CC app/spdk_nvme_perf/perf.o 00:02:37.815 TEST_HEADER include/spdk/dma.h 00:02:37.815 TEST_HEADER include/spdk/endian.h 00:02:37.815 TEST_HEADER include/spdk/env.h 00:02:37.815 TEST_HEADER include/spdk/env_dpdk.h 00:02:37.815 TEST_HEADER include/spdk/fd_group.h 00:02:37.815 TEST_HEADER include/spdk/fd.h 00:02:37.815 TEST_HEADER include/spdk/event.h 00:02:37.815 TEST_HEADER include/spdk/file.h 00:02:37.815 TEST_HEADER include/spdk/ftl.h 00:02:37.815 CC app/spdk_nvme_identify/identify.o 00:02:37.815 TEST_HEADER include/spdk/gpt_spec.h 00:02:37.815 TEST_HEADER include/spdk/hexlify.h 00:02:37.815 TEST_HEADER include/spdk/histogram_data.h 00:02:37.815 TEST_HEADER include/spdk/idxd_spec.h 00:02:37.815 TEST_HEADER include/spdk/idxd.h 00:02:37.815 TEST_HEADER include/spdk/init.h 00:02:37.815 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:37.815 TEST_HEADER include/spdk/ioat_spec.h 00:02:37.815 TEST_HEADER include/spdk/iscsi_spec.h 00:02:37.815 TEST_HEADER include/spdk/ioat.h 00:02:37.815 TEST_HEADER include/spdk/json.h 00:02:37.815 CC app/spdk_dd/spdk_dd.o 00:02:37.815 TEST_HEADER include/spdk/likely.h 00:02:37.815 CC app/iscsi_tgt/iscsi_tgt.o 00:02:37.815 TEST_HEADER include/spdk/jsonrpc.h 00:02:37.815 TEST_HEADER include/spdk/log.h 00:02:37.815 TEST_HEADER include/spdk/lvol.h 00:02:37.815 TEST_HEADER include/spdk/memory.h 00:02:37.815 TEST_HEADER include/spdk/mmio.h 00:02:37.815 TEST_HEADER include/spdk/nbd.h 00:02:37.815 TEST_HEADER include/spdk/notify.h 00:02:37.815 TEST_HEADER include/spdk/nvme_intel.h 00:02:37.815 TEST_HEADER include/spdk/nvme.h 00:02:37.815 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:37.815 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:37.815 TEST_HEADER include/spdk/nvme_spec.h 00:02:37.815 CC app/vhost/vhost.o 00:02:37.815 TEST_HEADER include/spdk/nvme_zns.h 00:02:37.815 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:37.815 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:37.815 CC app/nvmf_tgt/nvmf_main.o 00:02:37.815 TEST_HEADER include/spdk/nvmf_spec.h 00:02:37.815 TEST_HEADER include/spdk/nvmf_transport.h 00:02:37.815 TEST_HEADER include/spdk/nvmf.h 00:02:37.815 TEST_HEADER include/spdk/opal.h 00:02:37.815 TEST_HEADER include/spdk/opal_spec.h 00:02:37.815 CC app/spdk_tgt/spdk_tgt.o 00:02:37.815 TEST_HEADER include/spdk/pci_ids.h 00:02:37.815 TEST_HEADER include/spdk/pipe.h 00:02:37.815 TEST_HEADER include/spdk/reduce.h 00:02:37.815 TEST_HEADER include/spdk/queue.h 00:02:37.815 TEST_HEADER include/spdk/rpc.h 00:02:37.815 TEST_HEADER include/spdk/scheduler.h 00:02:37.815 TEST_HEADER include/spdk/scsi_spec.h 00:02:37.815 TEST_HEADER include/spdk/sock.h 00:02:37.815 TEST_HEADER include/spdk/scsi.h 00:02:37.815 TEST_HEADER include/spdk/stdinc.h 00:02:37.815 TEST_HEADER include/spdk/string.h 00:02:37.815 TEST_HEADER include/spdk/thread.h 00:02:37.815 TEST_HEADER include/spdk/trace_parser.h 00:02:37.815 TEST_HEADER include/spdk/tree.h 00:02:37.815 TEST_HEADER include/spdk/trace.h 00:02:37.815 TEST_HEADER include/spdk/ublk.h 00:02:37.815 TEST_HEADER include/spdk/uuid.h 00:02:37.815 TEST_HEADER include/spdk/util.h 00:02:37.815 TEST_HEADER include/spdk/version.h 00:02:37.815 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:37.815 CC test/app/stub/stub.o 00:02:37.815 TEST_HEADER include/spdk/vhost.h 00:02:37.815 TEST_HEADER include/spdk/vmd.h 00:02:37.815 TEST_HEADER include/spdk/xor.h 00:02:37.815 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:37.815 CXX test/cpp_headers/accel.o 00:02:37.815 TEST_HEADER include/spdk/zipf.h 00:02:37.815 CXX test/cpp_headers/accel_module.o 00:02:37.815 CXX test/cpp_headers/assert.o 00:02:37.815 CXX test/cpp_headers/barrier.o 00:02:37.815 CXX test/cpp_headers/base64.o 00:02:37.815 CXX test/cpp_headers/bdev.o 00:02:37.815 CXX test/cpp_headers/bdev_module.o 00:02:37.815 CXX test/cpp_headers/bit_array.o 00:02:37.815 CXX test/cpp_headers/bdev_zone.o 00:02:37.815 CXX test/cpp_headers/blob_bdev.o 00:02:37.815 CXX test/cpp_headers/bit_pool.o 00:02:37.815 CXX test/cpp_headers/blobfs.o 00:02:37.815 CXX test/cpp_headers/blobfs_bdev.o 00:02:37.815 CC test/app/histogram_perf/histogram_perf.o 00:02:37.815 CXX test/cpp_headers/blob.o 00:02:37.815 CXX test/cpp_headers/conf.o 00:02:37.815 CXX test/cpp_headers/cpuset.o 00:02:37.815 CXX test/cpp_headers/config.o 00:02:37.815 CC test/nvme/startup/startup.o 00:02:37.815 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:37.815 CXX test/cpp_headers/crc16.o 00:02:37.815 CXX test/cpp_headers/crc64.o 00:02:37.815 CXX test/cpp_headers/endian.o 00:02:37.815 CC test/nvme/fdp/fdp.o 00:02:37.815 CXX test/cpp_headers/crc32.o 00:02:37.815 CXX test/cpp_headers/dma.o 00:02:37.815 CXX test/cpp_headers/dif.o 00:02:37.815 CC test/env/vtophys/vtophys.o 00:02:37.815 CXX test/cpp_headers/env_dpdk.o 00:02:37.815 CXX test/cpp_headers/fd_group.o 00:02:37.815 CXX test/cpp_headers/env.o 00:02:37.815 CXX test/cpp_headers/event.o 00:02:37.815 CC test/nvme/simple_copy/simple_copy.o 00:02:37.815 CC test/thread/poller_perf/poller_perf.o 00:02:37.815 CC test/app/jsoncat/jsoncat.o 00:02:37.815 CXX test/cpp_headers/fd.o 00:02:37.815 CXX test/cpp_headers/file.o 00:02:37.815 CC test/nvme/fused_ordering/fused_ordering.o 00:02:37.815 CC test/nvme/err_injection/err_injection.o 00:02:37.815 CC test/nvme/overhead/overhead.o 00:02:37.815 CC test/nvme/sgl/sgl.o 00:02:37.815 CC test/nvme/e2edp/nvme_dp.o 00:02:37.815 CC test/env/pci/pci_ut.o 00:02:37.815 CXX test/cpp_headers/hexlify.o 00:02:37.815 CXX test/cpp_headers/gpt_spec.o 00:02:37.815 CXX test/cpp_headers/ftl.o 00:02:37.815 CC test/nvme/boot_partition/boot_partition.o 00:02:37.815 CXX test/cpp_headers/histogram_data.o 00:02:37.815 CXX test/cpp_headers/idxd_spec.o 00:02:37.815 CXX test/cpp_headers/ioat_spec.o 00:02:37.815 CXX test/cpp_headers/idxd.o 00:02:37.815 CXX test/cpp_headers/init.o 00:02:37.815 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:37.815 CXX test/cpp_headers/json.o 00:02:37.815 CXX test/cpp_headers/ioat.o 00:02:37.815 CC test/nvme/reserve/reserve.o 00:02:37.815 CXX test/cpp_headers/jsonrpc.o 00:02:37.816 CXX test/cpp_headers/iscsi_spec.o 00:02:37.816 CC examples/ioat/perf/perf.o 00:02:37.816 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:37.816 CXX test/cpp_headers/likely.o 00:02:37.816 CC test/env/memory/memory_ut.o 00:02:37.816 CXX test/cpp_headers/log.o 00:02:37.816 CXX test/cpp_headers/lvol.o 00:02:37.816 CXX test/cpp_headers/memory.o 00:02:37.816 CXX test/cpp_headers/mmio.o 00:02:37.816 CC examples/nvme/hello_world/hello_world.o 00:02:37.816 CC examples/nvme/arbitration/arbitration.o 00:02:37.816 CC examples/nvme/reconnect/reconnect.o 00:02:37.816 CXX test/cpp_headers/nvme.o 00:02:37.816 CXX test/cpp_headers/nbd.o 00:02:37.816 CC test/nvme/compliance/nvme_compliance.o 00:02:37.816 CXX test/cpp_headers/notify.o 00:02:37.816 CC test/nvme/aer/aer.o 00:02:37.816 CC examples/util/zipf/zipf.o 00:02:37.816 CXX test/cpp_headers/nvme_ocssd.o 00:02:37.816 CXX test/cpp_headers/nvme_intel.o 00:02:37.816 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:37.816 CC test/nvme/cuse/cuse.o 00:02:37.816 CC examples/nvme/abort/abort.o 00:02:37.816 CC test/nvme/reset/reset.o 00:02:37.816 CXX test/cpp_headers/nvme_zns.o 00:02:37.816 CXX test/cpp_headers/nvme_spec.o 00:02:37.816 CC test/event/event_perf/event_perf.o 00:02:37.816 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:37.816 CXX test/cpp_headers/nvmf_cmd.o 00:02:37.816 CC test/app/bdev_svc/bdev_svc.o 00:02:37.816 CC examples/sock/hello_world/hello_sock.o 00:02:37.816 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:37.816 CC examples/nvme/hotplug/hotplug.o 00:02:37.816 CXX test/cpp_headers/nvmf.o 00:02:37.816 CXX test/cpp_headers/nvmf_spec.o 00:02:37.816 CXX test/cpp_headers/nvmf_transport.o 00:02:37.816 CC test/accel/dif/dif.o 00:02:37.816 CC test/event/reactor_perf/reactor_perf.o 00:02:37.816 CXX test/cpp_headers/opal.o 00:02:37.816 CC examples/vmd/led/led.o 00:02:37.816 CXX test/cpp_headers/opal_spec.o 00:02:37.816 CXX test/cpp_headers/pci_ids.o 00:02:37.816 CC examples/ioat/verify/verify.o 00:02:37.816 CXX test/cpp_headers/pipe.o 00:02:37.816 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:37.816 CXX test/cpp_headers/queue.o 00:02:37.816 CC test/bdev/bdevio/bdevio.o 00:02:37.816 CC app/fio/nvme/fio_plugin.o 00:02:37.816 CC examples/accel/perf/accel_perf.o 00:02:37.816 CXX test/cpp_headers/reduce.o 00:02:37.816 CC test/event/reactor/reactor.o 00:02:37.816 CC test/nvme/connect_stress/connect_stress.o 00:02:37.816 CC examples/bdev/hello_world/hello_bdev.o 00:02:37.816 CXX test/cpp_headers/rpc.o 00:02:37.816 CC examples/idxd/perf/perf.o 00:02:37.816 CC test/event/app_repeat/app_repeat.o 00:02:37.816 CXX test/cpp_headers/scheduler.o 00:02:38.089 CC examples/vmd/lsvmd/lsvmd.o 00:02:38.089 CC examples/bdev/bdevperf/bdevperf.o 00:02:38.089 CC test/blobfs/mkfs/mkfs.o 00:02:38.089 CC test/dma/test_dma/test_dma.o 00:02:38.089 CXX test/cpp_headers/scsi.o 00:02:38.089 CC examples/blob/hello_world/hello_blob.o 00:02:38.089 CC test/event/scheduler/scheduler.o 00:02:38.089 CC examples/blob/cli/blobcli.o 00:02:38.089 CC app/fio/bdev/fio_plugin.o 00:02:38.089 CXX test/cpp_headers/scsi_spec.o 00:02:38.089 CC examples/thread/thread/thread_ex.o 00:02:38.089 LINK spdk_lspci 00:02:38.089 CC examples/nvmf/nvmf/nvmf.o 00:02:38.089 CXX test/cpp_headers/sock.o 00:02:38.089 CC test/env/mem_callbacks/mem_callbacks.o 00:02:38.089 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:38.089 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:38.089 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:38.089 CC test/lvol/esnap/esnap.o 00:02:38.360 LINK interrupt_tgt 00:02:38.360 LINK rpc_client_test 00:02:38.360 LINK spdk_nvme_discover 00:02:38.360 LINK histogram_perf 00:02:38.360 LINK nvmf_tgt 00:02:38.360 LINK stub 00:02:38.360 LINK event_perf 00:02:38.360 LINK reactor_perf 00:02:38.360 LINK jsoncat 00:02:38.360 LINK startup 00:02:38.360 LINK led 00:02:38.360 LINK zipf 00:02:38.360 LINK reactor 00:02:38.360 LINK iscsi_tgt 00:02:38.360 LINK cmb_copy 00:02:38.619 LINK fused_ordering 00:02:38.619 LINK doorbell_aers 00:02:38.619 LINK vhost 00:02:38.619 LINK err_injection 00:02:38.619 LINK lsvmd 00:02:38.619 LINK vtophys 00:02:38.619 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:38.619 LINK bdev_svc 00:02:38.619 LINK env_dpdk_post_init 00:02:38.619 LINK reserve 00:02:38.619 LINK poller_perf 00:02:38.619 LINK spdk_trace_record 00:02:38.619 LINK spdk_tgt 00:02:38.619 LINK ioat_perf 00:02:38.619 CXX test/cpp_headers/stdinc.o 00:02:38.619 LINK hello_world 00:02:38.619 LINK app_repeat 00:02:38.619 CXX test/cpp_headers/string.o 00:02:38.619 LINK spdk_dd 00:02:38.619 CXX test/cpp_headers/thread.o 00:02:38.619 LINK nvme_dp 00:02:38.619 LINK hotplug 00:02:38.619 CXX test/cpp_headers/trace.o 00:02:38.619 LINK hello_blob 00:02:38.619 CXX test/cpp_headers/trace_parser.o 00:02:38.619 LINK hello_bdev 00:02:38.619 CXX test/cpp_headers/ublk.o 00:02:38.619 CXX test/cpp_headers/tree.o 00:02:38.619 CXX test/cpp_headers/util.o 00:02:38.619 LINK boot_partition 00:02:38.619 CXX test/cpp_headers/uuid.o 00:02:38.619 CXX test/cpp_headers/version.o 00:02:38.619 CXX test/cpp_headers/vfio_user_pci.o 00:02:38.619 CXX test/cpp_headers/vfio_user_spec.o 00:02:38.619 CXX test/cpp_headers/vhost.o 00:02:38.619 CXX test/cpp_headers/vmd.o 00:02:38.619 CXX test/cpp_headers/xor.o 00:02:38.619 CXX test/cpp_headers/zipf.o 00:02:38.619 LINK connect_stress 00:02:38.619 LINK thread 00:02:38.619 LINK simple_copy 00:02:38.619 LINK mkfs 00:02:38.877 LINK pmr_persistence 00:02:38.877 LINK aer 00:02:38.877 LINK hello_sock 00:02:38.877 LINK sgl 00:02:38.877 LINK scheduler 00:02:38.877 LINK reset 00:02:38.877 LINK nvme_compliance 00:02:38.877 LINK dif 00:02:38.877 LINK abort 00:02:38.877 LINK spdk_trace 00:02:38.877 LINK verify 00:02:38.877 LINK bdevio 00:02:38.877 LINK overhead 00:02:38.877 LINK fdp 00:02:38.877 LINK nvme_manage 00:02:38.877 LINK nvmf 00:02:38.877 LINK arbitration 00:02:38.877 LINK idxd_perf 00:02:38.877 LINK reconnect 00:02:38.877 LINK spdk_bdev 00:02:38.877 LINK nvme_fuzz 00:02:39.137 LINK blobcli 00:02:39.137 LINK pci_ut 00:02:39.137 LINK accel_perf 00:02:39.137 LINK test_dma 00:02:39.137 LINK spdk_nvme 00:02:39.137 LINK spdk_nvme_identify 00:02:39.137 LINK vhost_fuzz 00:02:39.137 LINK spdk_top 00:02:39.398 LINK spdk_nvme_perf 00:02:39.398 LINK mem_callbacks 00:02:39.398 LINK bdevperf 00:02:39.398 LINK memory_ut 00:02:39.398 LINK cuse 00:02:39.971 LINK iscsi_fuzz 00:02:42.517 LINK esnap 00:02:42.779 00:02:42.779 real 0m45.835s 00:02:42.779 user 6m16.172s 00:02:42.779 sys 4m26.510s 00:02:42.779 03:59:57 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:02:42.779 03:59:57 -- common/autotest_common.sh@10 -- $ set +x 00:02:42.779 ************************************ 00:02:42.779 END TEST make 00:02:42.779 ************************************ 00:02:42.779 03:59:57 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:42.779 03:59:57 -- nvmf/common.sh@7 -- # uname -s 00:02:42.779 03:59:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:42.779 03:59:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:42.779 03:59:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:42.779 03:59:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:42.779 03:59:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:42.779 03:59:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:42.779 03:59:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:42.779 03:59:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:42.779 03:59:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:42.779 03:59:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:42.779 03:59:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:02:42.779 03:59:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:02:42.779 03:59:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:42.779 03:59:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:42.779 03:59:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:42.779 03:59:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:42.779 03:59:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:42.779 03:59:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:42.779 03:59:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:42.779 03:59:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:42.779 03:59:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:42.779 03:59:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:42.779 03:59:57 -- paths/export.sh@5 -- # export PATH 00:02:42.779 03:59:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:42.779 03:59:57 -- nvmf/common.sh@46 -- # : 0 00:02:42.779 03:59:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:42.779 03:59:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:42.779 03:59:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:42.779 03:59:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:42.779 03:59:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:42.779 03:59:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:42.779 03:59:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:42.779 03:59:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:42.779 03:59:57 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:42.779 03:59:57 -- spdk/autotest.sh@32 -- # uname -s 00:02:42.779 03:59:57 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:42.779 03:59:57 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:42.779 03:59:57 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:42.779 03:59:57 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:42.779 03:59:57 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:42.779 03:59:57 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:42.779 03:59:57 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:42.779 03:59:57 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:42.779 03:59:57 -- spdk/autotest.sh@48 -- # udevadm_pid=3668593 00:02:42.779 03:59:57 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:42.779 03:59:57 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:42.779 03:59:57 -- spdk/autotest.sh@54 -- # echo 3668595 00:02:42.779 03:59:57 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:42.779 03:59:57 -- spdk/autotest.sh@56 -- # echo 3668596 00:02:42.779 03:59:57 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:42.779 03:59:57 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:42.779 03:59:57 -- spdk/autotest.sh@60 -- # echo 3668597 00:02:42.779 03:59:57 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:42.779 03:59:57 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:42.779 03:59:57 -- spdk/autotest.sh@62 -- # echo 3668598 00:02:42.779 03:59:57 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:42.779 03:59:57 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:42.779 03:59:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:42.779 03:59:57 -- common/autotest_common.sh@10 -- # set +x 00:02:42.779 03:59:57 -- spdk/autotest.sh@70 -- # create_test_list 00:02:42.779 03:59:57 -- common/autotest_common.sh@736 -- # xtrace_disable 00:02:42.779 03:59:57 -- common/autotest_common.sh@10 -- # set +x 00:02:42.779 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:42.779 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:42.779 03:59:57 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:43.041 03:59:57 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:43.041 03:59:57 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:43.041 03:59:57 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:43.041 03:59:57 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:43.041 03:59:57 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:43.041 03:59:57 -- common/autotest_common.sh@1440 -- # uname 00:02:43.041 03:59:57 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:02:43.041 03:59:57 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:43.041 03:59:57 -- common/autotest_common.sh@1460 -- # uname 00:02:43.041 03:59:57 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:02:43.041 03:59:57 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:02:43.041 03:59:57 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:02:43.041 03:59:57 -- spdk/autotest.sh@83 -- # hash lcov 00:02:43.041 03:59:57 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:43.041 03:59:57 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:02:43.041 --rc lcov_branch_coverage=1 00:02:43.041 --rc lcov_function_coverage=1 00:02:43.041 --rc genhtml_branch_coverage=1 00:02:43.041 --rc genhtml_function_coverage=1 00:02:43.041 --rc genhtml_legend=1 00:02:43.041 --rc geninfo_all_blocks=1 00:02:43.041 ' 00:02:43.041 03:59:57 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:02:43.041 --rc lcov_branch_coverage=1 00:02:43.041 --rc lcov_function_coverage=1 00:02:43.041 --rc genhtml_branch_coverage=1 00:02:43.041 --rc genhtml_function_coverage=1 00:02:43.041 --rc genhtml_legend=1 00:02:43.041 --rc geninfo_all_blocks=1 00:02:43.041 ' 00:02:43.041 03:59:57 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:02:43.041 --rc lcov_branch_coverage=1 00:02:43.041 --rc lcov_function_coverage=1 00:02:43.041 --rc genhtml_branch_coverage=1 00:02:43.041 --rc genhtml_function_coverage=1 00:02:43.041 --rc genhtml_legend=1 00:02:43.041 --rc geninfo_all_blocks=1 00:02:43.041 --no-external' 00:02:43.041 03:59:57 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:02:43.041 --rc lcov_branch_coverage=1 00:02:43.041 --rc lcov_function_coverage=1 00:02:43.041 --rc genhtml_branch_coverage=1 00:02:43.041 --rc genhtml_function_coverage=1 00:02:43.041 --rc genhtml_legend=1 00:02:43.041 --rc geninfo_all_blocks=1 00:02:43.041 --no-external' 00:02:43.041 03:59:57 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:43.041 lcov: LCOV version 1.14 00:02:43.041 03:59:57 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:55.288 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:55.288 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:55.288 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:55.288 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:55.288 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:55.288 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:03:10.214 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:03:10.214 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:03:10.215 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:03:10.215 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:03:10.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:03:10.216 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:03:10.216 04:00:24 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:03:10.216 04:00:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:10.216 04:00:24 -- common/autotest_common.sh@10 -- # set +x 00:03:10.216 04:00:24 -- spdk/autotest.sh@102 -- # rm -f 00:03:10.216 04:00:24 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:13.520 0000:80:01.6 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:80:01.7 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:80:01.4 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:80:01.5 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:80:01.2 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:80:01.3 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:80:01.0 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:80:01.1 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:65:00.0 (144d a80a): Already using the nvme driver 00:03:13.520 0000:00:01.6 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:00:01.7 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:00:01.4 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:00:01.5 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:00:01.2 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:00:01.3 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:00:01.0 (8086 0b00): Already using the ioatdma driver 00:03:13.520 0000:00:01.1 (8086 0b00): Already using the ioatdma driver 00:03:13.781 04:00:28 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:03:13.781 04:00:28 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:13.781 04:00:28 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:13.781 04:00:28 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:13.781 04:00:28 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:13.781 04:00:28 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:13.781 04:00:28 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:13.781 04:00:28 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:13.781 04:00:28 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:13.781 04:00:28 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:03:13.781 04:00:28 -- spdk/autotest.sh@121 -- # grep -v p 00:03:13.781 04:00:28 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:03:13.781 04:00:28 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:13.781 04:00:28 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:03:13.781 04:00:28 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:03:13.781 04:00:28 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:13.781 04:00:28 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:13.781 No valid GPT data, bailing 00:03:13.781 04:00:28 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:13.781 04:00:28 -- scripts/common.sh@393 -- # pt= 00:03:13.781 04:00:28 -- scripts/common.sh@394 -- # return 1 00:03:13.781 04:00:28 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:13.781 1+0 records in 00:03:13.781 1+0 records out 00:03:13.781 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00198265 s, 529 MB/s 00:03:13.781 04:00:28 -- spdk/autotest.sh@129 -- # sync 00:03:13.781 04:00:28 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:13.781 04:00:28 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:13.781 04:00:28 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:21.970 04:00:35 -- spdk/autotest.sh@135 -- # uname -s 00:03:21.970 04:00:35 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:03:21.970 04:00:35 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:21.970 04:00:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:21.970 04:00:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:21.970 04:00:35 -- common/autotest_common.sh@10 -- # set +x 00:03:21.970 ************************************ 00:03:21.971 START TEST setup.sh 00:03:21.971 ************************************ 00:03:21.971 04:00:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:21.971 * Looking for test storage... 00:03:21.971 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:21.971 04:00:35 -- setup/test-setup.sh@10 -- # uname -s 00:03:21.971 04:00:35 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:21.971 04:00:35 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:21.971 04:00:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:21.971 04:00:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:21.971 04:00:35 -- common/autotest_common.sh@10 -- # set +x 00:03:21.971 ************************************ 00:03:21.971 START TEST acl 00:03:21.971 ************************************ 00:03:21.971 04:00:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:21.971 * Looking for test storage... 00:03:21.971 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:21.971 04:00:35 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:21.971 04:00:35 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:21.971 04:00:35 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:21.971 04:00:35 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:21.971 04:00:35 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:21.971 04:00:35 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:21.971 04:00:35 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:21.971 04:00:35 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:21.971 04:00:35 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:21.971 04:00:35 -- setup/acl.sh@12 -- # devs=() 00:03:21.971 04:00:35 -- setup/acl.sh@12 -- # declare -a devs 00:03:21.971 04:00:35 -- setup/acl.sh@13 -- # drivers=() 00:03:21.971 04:00:35 -- setup/acl.sh@13 -- # declare -A drivers 00:03:21.971 04:00:35 -- setup/acl.sh@51 -- # setup reset 00:03:21.971 04:00:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:21.971 04:00:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:25.274 04:00:39 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:25.274 04:00:39 -- setup/acl.sh@16 -- # local dev driver 00:03:25.274 04:00:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:25.274 04:00:39 -- setup/acl.sh@15 -- # setup output status 00:03:25.274 04:00:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.274 04:00:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:28.575 Hugepages 00:03:28.575 node hugesize free / total 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 00:03:28.575 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 0000:00:01.0 == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 0000:00:01.1 == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 0000:00:01.2 == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 0000:00:01.3 == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 0000:00:01.4 == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 0000:00:01.5 == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 0000:00:01.6 == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:42 -- setup/acl.sh@19 -- # [[ 0000:00:01.7 == *:*:*.* ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:42 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:42 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@19 -- # [[ 0000:65:00.0 == *:*:*.* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:28.575 04:00:43 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\6\5\:\0\0\.\0* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:28.575 04:00:43 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:28.575 04:00:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@19 -- # [[ 0000:80:01.0 == *:*:*.* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@19 -- # [[ 0000:80:01.1 == *:*:*.* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@19 -- # [[ 0000:80:01.2 == *:*:*.* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@19 -- # [[ 0000:80:01.3 == *:*:*.* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@19 -- # [[ 0000:80:01.4 == *:*:*.* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@19 -- # [[ 0000:80:01.5 == *:*:*.* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@19 -- # [[ 0000:80:01.6 == *:*:*.* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@19 -- # [[ 0000:80:01.7 == *:*:*.* ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:28.575 04:00:43 -- setup/acl.sh@20 -- # continue 00:03:28.575 04:00:43 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:28.575 04:00:43 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:28.575 04:00:43 -- setup/acl.sh@54 -- # run_test denied denied 00:03:28.575 04:00:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:28.575 04:00:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:28.575 04:00:43 -- common/autotest_common.sh@10 -- # set +x 00:03:28.575 ************************************ 00:03:28.575 START TEST denied 00:03:28.575 ************************************ 00:03:28.575 04:00:43 -- common/autotest_common.sh@1104 -- # denied 00:03:28.575 04:00:43 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:65:00.0' 00:03:28.575 04:00:43 -- setup/acl.sh@38 -- # setup output config 00:03:28.575 04:00:43 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:65:00.0' 00:03:28.575 04:00:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:28.575 04:00:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:32.797 0000:65:00.0 (144d a80a): Skipping denied controller at 0000:65:00.0 00:03:32.797 04:00:46 -- setup/acl.sh@40 -- # verify 0000:65:00.0 00:03:32.797 04:00:46 -- setup/acl.sh@28 -- # local dev driver 00:03:32.797 04:00:46 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:32.797 04:00:46 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:65:00.0 ]] 00:03:32.797 04:00:46 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:65:00.0/driver 00:03:32.797 04:00:46 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:32.797 04:00:46 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:32.797 04:00:46 -- setup/acl.sh@41 -- # setup reset 00:03:32.797 04:00:46 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:32.797 04:00:46 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:38.087 00:03:38.087 real 0m8.639s 00:03:38.087 user 0m2.898s 00:03:38.087 sys 0m5.026s 00:03:38.087 04:00:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:38.087 04:00:51 -- common/autotest_common.sh@10 -- # set +x 00:03:38.087 ************************************ 00:03:38.087 END TEST denied 00:03:38.087 ************************************ 00:03:38.087 04:00:51 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:38.087 04:00:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:38.087 04:00:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:38.087 04:00:51 -- common/autotest_common.sh@10 -- # set +x 00:03:38.087 ************************************ 00:03:38.087 START TEST allowed 00:03:38.087 ************************************ 00:03:38.087 04:00:51 -- common/autotest_common.sh@1104 -- # allowed 00:03:38.087 04:00:51 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:65:00.0 00:03:38.087 04:00:51 -- setup/acl.sh@45 -- # setup output config 00:03:38.087 04:00:51 -- setup/acl.sh@46 -- # grep -E '0000:65:00.0 .*: nvme -> .*' 00:03:38.087 04:00:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:38.087 04:00:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:43.380 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:03:43.380 04:00:57 -- setup/acl.sh@47 -- # verify 00:03:43.380 04:00:57 -- setup/acl.sh@28 -- # local dev driver 00:03:43.380 04:00:57 -- setup/acl.sh@48 -- # setup reset 00:03:43.380 04:00:57 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:43.380 04:00:57 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:47.594 00:03:47.594 real 0m9.652s 00:03:47.594 user 0m2.953s 00:03:47.594 sys 0m4.970s 00:03:47.594 04:01:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:47.594 04:01:01 -- common/autotest_common.sh@10 -- # set +x 00:03:47.594 ************************************ 00:03:47.594 END TEST allowed 00:03:47.594 ************************************ 00:03:47.594 00:03:47.594 real 0m25.580s 00:03:47.594 user 0m8.554s 00:03:47.594 sys 0m14.718s 00:03:47.594 04:01:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:47.594 04:01:01 -- common/autotest_common.sh@10 -- # set +x 00:03:47.594 ************************************ 00:03:47.594 END TEST acl 00:03:47.594 ************************************ 00:03:47.594 04:01:01 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:47.594 04:01:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:47.594 04:01:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:47.594 04:01:01 -- common/autotest_common.sh@10 -- # set +x 00:03:47.594 ************************************ 00:03:47.594 START TEST hugepages 00:03:47.594 ************************************ 00:03:47.594 04:01:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:47.594 * Looking for test storage... 00:03:47.594 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:47.594 04:01:01 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:47.594 04:01:01 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:47.594 04:01:01 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:47.594 04:01:01 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:47.594 04:01:01 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:47.594 04:01:01 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:47.594 04:01:01 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:47.594 04:01:01 -- setup/common.sh@18 -- # local node= 00:03:47.594 04:01:01 -- setup/common.sh@19 -- # local var val 00:03:47.594 04:01:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:47.594 04:01:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:47.594 04:01:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:47.594 04:01:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:47.594 04:01:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:47.594 04:01:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 98616848 kB' 'MemAvailable: 103120536 kB' 'Buffers: 2696 kB' 'Cached: 18842380 kB' 'SwapCached: 0 kB' 'Active: 14937644 kB' 'Inactive: 4471840 kB' 'Active(anon): 14265316 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 567704 kB' 'Mapped: 228824 kB' 'Shmem: 13700908 kB' 'KReclaimable: 367700 kB' 'Slab: 1252544 kB' 'SReclaimable: 367700 kB' 'SUnreclaim: 884844 kB' 'KernelStack: 26832 kB' 'PageTables: 9012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69460856 kB' 'Committed_AS: 15716716 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235052 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.594 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.594 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # continue 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:47.595 04:01:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:47.595 04:01:01 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:47.595 04:01:01 -- setup/common.sh@33 -- # echo 2048 00:03:47.595 04:01:01 -- setup/common.sh@33 -- # return 0 00:03:47.595 04:01:01 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:47.595 04:01:01 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:47.596 04:01:01 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:47.596 04:01:01 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:47.596 04:01:01 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:47.596 04:01:01 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:47.596 04:01:01 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:47.596 04:01:01 -- setup/hugepages.sh@207 -- # get_nodes 00:03:47.596 04:01:01 -- setup/hugepages.sh@27 -- # local node 00:03:47.596 04:01:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:47.596 04:01:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:47.596 04:01:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:47.596 04:01:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:47.596 04:01:01 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:47.596 04:01:01 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:47.596 04:01:01 -- setup/hugepages.sh@208 -- # clear_hp 00:03:47.596 04:01:01 -- setup/hugepages.sh@37 -- # local node hp 00:03:47.596 04:01:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:47.596 04:01:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:47.596 04:01:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:47.596 04:01:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:47.596 04:01:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:47.596 04:01:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:47.596 04:01:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:47.596 04:01:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:47.596 04:01:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:47.596 04:01:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:47.596 04:01:01 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:47.596 04:01:01 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:47.596 04:01:01 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:47.596 04:01:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:47.596 04:01:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:47.596 04:01:01 -- common/autotest_common.sh@10 -- # set +x 00:03:47.596 ************************************ 00:03:47.596 START TEST default_setup 00:03:47.596 ************************************ 00:03:47.596 04:01:01 -- common/autotest_common.sh@1104 -- # default_setup 00:03:47.596 04:01:01 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:47.596 04:01:01 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:47.596 04:01:01 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:47.596 04:01:01 -- setup/hugepages.sh@51 -- # shift 00:03:47.596 04:01:01 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:47.596 04:01:01 -- setup/hugepages.sh@52 -- # local node_ids 00:03:47.596 04:01:01 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:47.596 04:01:01 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:47.596 04:01:01 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:47.596 04:01:01 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:47.596 04:01:01 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:47.596 04:01:01 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:47.596 04:01:01 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:47.596 04:01:01 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:47.596 04:01:01 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:47.596 04:01:01 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:47.596 04:01:01 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:47.596 04:01:01 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:47.596 04:01:01 -- setup/hugepages.sh@73 -- # return 0 00:03:47.596 04:01:01 -- setup/hugepages.sh@137 -- # setup output 00:03:47.596 04:01:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:47.596 04:01:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:50.955 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:03:50.955 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:03:50.955 04:01:05 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:50.955 04:01:05 -- setup/hugepages.sh@89 -- # local node 00:03:50.955 04:01:05 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:50.955 04:01:05 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:50.955 04:01:05 -- setup/hugepages.sh@92 -- # local surp 00:03:50.955 04:01:05 -- setup/hugepages.sh@93 -- # local resv 00:03:50.955 04:01:05 -- setup/hugepages.sh@94 -- # local anon 00:03:50.955 04:01:05 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:50.955 04:01:05 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:50.955 04:01:05 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:50.955 04:01:05 -- setup/common.sh@18 -- # local node= 00:03:50.955 04:01:05 -- setup/common.sh@19 -- # local var val 00:03:50.955 04:01:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:50.955 04:01:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:50.955 04:01:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:50.955 04:01:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:50.955 04:01:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:50.955 04:01:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100784536 kB' 'MemAvailable: 105288192 kB' 'Buffers: 2696 kB' 'Cached: 18842504 kB' 'SwapCached: 0 kB' 'Active: 14941432 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269104 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571544 kB' 'Mapped: 228112 kB' 'Shmem: 13701032 kB' 'KReclaimable: 367636 kB' 'Slab: 1250652 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883016 kB' 'KernelStack: 26976 kB' 'PageTables: 9216 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15722824 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 234824 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.955 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.955 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # continue 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:50.956 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:50.956 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.221 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.221 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.221 04:01:05 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.221 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.221 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.221 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.221 04:01:05 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.221 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.221 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.222 04:01:05 -- setup/common.sh@33 -- # echo 0 00:03:51.222 04:01:05 -- setup/common.sh@33 -- # return 0 00:03:51.222 04:01:05 -- setup/hugepages.sh@97 -- # anon=0 00:03:51.222 04:01:05 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:51.222 04:01:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:51.222 04:01:05 -- setup/common.sh@18 -- # local node= 00:03:51.222 04:01:05 -- setup/common.sh@19 -- # local var val 00:03:51.222 04:01:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.222 04:01:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.222 04:01:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:51.222 04:01:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:51.222 04:01:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.222 04:01:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100785832 kB' 'MemAvailable: 105289488 kB' 'Buffers: 2696 kB' 'Cached: 18842508 kB' 'SwapCached: 0 kB' 'Active: 14941616 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269288 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571732 kB' 'Mapped: 228028 kB' 'Shmem: 13701036 kB' 'KReclaimable: 367636 kB' 'Slab: 1250688 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883052 kB' 'KernelStack: 26960 kB' 'PageTables: 9124 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15722836 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 234808 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.222 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.222 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.223 04:01:05 -- setup/common.sh@33 -- # echo 0 00:03:51.223 04:01:05 -- setup/common.sh@33 -- # return 0 00:03:51.223 04:01:05 -- setup/hugepages.sh@99 -- # surp=0 00:03:51.223 04:01:05 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:51.223 04:01:05 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:51.223 04:01:05 -- setup/common.sh@18 -- # local node= 00:03:51.223 04:01:05 -- setup/common.sh@19 -- # local var val 00:03:51.223 04:01:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.223 04:01:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.223 04:01:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:51.223 04:01:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:51.223 04:01:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.223 04:01:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100786480 kB' 'MemAvailable: 105290136 kB' 'Buffers: 2696 kB' 'Cached: 18842520 kB' 'SwapCached: 0 kB' 'Active: 14941624 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269296 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571732 kB' 'Mapped: 228028 kB' 'Shmem: 13701048 kB' 'KReclaimable: 367636 kB' 'Slab: 1250688 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883052 kB' 'KernelStack: 26960 kB' 'PageTables: 9124 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15722852 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 234808 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.223 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.223 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.224 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.224 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.225 04:01:05 -- setup/common.sh@33 -- # echo 0 00:03:51.225 04:01:05 -- setup/common.sh@33 -- # return 0 00:03:51.225 04:01:05 -- setup/hugepages.sh@100 -- # resv=0 00:03:51.225 04:01:05 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:51.225 nr_hugepages=1024 00:03:51.225 04:01:05 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:51.225 resv_hugepages=0 00:03:51.225 04:01:05 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:51.225 surplus_hugepages=0 00:03:51.225 04:01:05 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:51.225 anon_hugepages=0 00:03:51.225 04:01:05 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:51.225 04:01:05 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:51.225 04:01:05 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:51.225 04:01:05 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:51.225 04:01:05 -- setup/common.sh@18 -- # local node= 00:03:51.225 04:01:05 -- setup/common.sh@19 -- # local var val 00:03:51.225 04:01:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.225 04:01:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.225 04:01:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:51.225 04:01:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:51.225 04:01:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.225 04:01:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.225 04:01:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100786560 kB' 'MemAvailable: 105290216 kB' 'Buffers: 2696 kB' 'Cached: 18842536 kB' 'SwapCached: 0 kB' 'Active: 14942724 kB' 'Inactive: 4471840 kB' 'Active(anon): 14270396 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 572912 kB' 'Mapped: 228028 kB' 'Shmem: 13701064 kB' 'KReclaimable: 367636 kB' 'Slab: 1250688 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883052 kB' 'KernelStack: 27024 kB' 'PageTables: 9332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15726056 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 234808 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.225 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.225 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.226 04:01:05 -- setup/common.sh@33 -- # echo 1024 00:03:51.226 04:01:05 -- setup/common.sh@33 -- # return 0 00:03:51.226 04:01:05 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:51.226 04:01:05 -- setup/hugepages.sh@112 -- # get_nodes 00:03:51.226 04:01:05 -- setup/hugepages.sh@27 -- # local node 00:03:51.226 04:01:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:51.226 04:01:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:51.226 04:01:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:51.226 04:01:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:51.226 04:01:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:51.226 04:01:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:51.226 04:01:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:51.226 04:01:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:51.226 04:01:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:51.226 04:01:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:51.226 04:01:05 -- setup/common.sh@18 -- # local node=0 00:03:51.226 04:01:05 -- setup/common.sh@19 -- # local var val 00:03:51.226 04:01:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.226 04:01:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.226 04:01:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:51.226 04:01:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:51.226 04:01:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.226 04:01:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 57973616 kB' 'MemUsed: 7685392 kB' 'SwapCached: 0 kB' 'Active: 3332928 kB' 'Inactive: 185548 kB' 'Active(anon): 2795872 kB' 'Inactive(anon): 0 kB' 'Active(file): 537056 kB' 'Inactive(file): 185548 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3211944 kB' 'Mapped: 150048 kB' 'AnonPages: 309748 kB' 'Shmem: 2489340 kB' 'KernelStack: 14136 kB' 'PageTables: 5112 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 174140 kB' 'Slab: 664696 kB' 'SReclaimable: 174140 kB' 'SUnreclaim: 490556 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.226 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.226 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # continue 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.227 04:01:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.227 04:01:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.227 04:01:05 -- setup/common.sh@33 -- # echo 0 00:03:51.227 04:01:05 -- setup/common.sh@33 -- # return 0 00:03:51.227 04:01:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:51.227 04:01:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:51.227 04:01:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:51.227 04:01:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:51.227 04:01:05 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:51.227 node0=1024 expecting 1024 00:03:51.227 04:01:05 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:51.227 00:03:51.227 real 0m4.022s 00:03:51.227 user 0m1.563s 00:03:51.227 sys 0m2.462s 00:03:51.227 04:01:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:51.227 04:01:05 -- common/autotest_common.sh@10 -- # set +x 00:03:51.227 ************************************ 00:03:51.227 END TEST default_setup 00:03:51.227 ************************************ 00:03:51.227 04:01:05 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:51.227 04:01:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:51.227 04:01:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:51.227 04:01:05 -- common/autotest_common.sh@10 -- # set +x 00:03:51.227 ************************************ 00:03:51.227 START TEST per_node_1G_alloc 00:03:51.227 ************************************ 00:03:51.227 04:01:05 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:03:51.227 04:01:05 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:51.227 04:01:05 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:51.227 04:01:05 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:51.227 04:01:05 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:51.227 04:01:05 -- setup/hugepages.sh@51 -- # shift 00:03:51.227 04:01:05 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:51.227 04:01:05 -- setup/hugepages.sh@52 -- # local node_ids 00:03:51.227 04:01:05 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:51.227 04:01:05 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:51.227 04:01:05 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:51.227 04:01:05 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:51.228 04:01:05 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:51.228 04:01:05 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:51.228 04:01:05 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:51.228 04:01:05 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:51.228 04:01:05 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:51.228 04:01:05 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:51.228 04:01:05 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:51.228 04:01:05 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:51.228 04:01:05 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:51.228 04:01:05 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:51.228 04:01:05 -- setup/hugepages.sh@73 -- # return 0 00:03:51.228 04:01:05 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:51.228 04:01:05 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:51.228 04:01:05 -- setup/hugepages.sh@146 -- # setup output 00:03:51.228 04:01:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:51.228 04:01:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:54.530 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:54.530 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:54.530 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:55.117 04:01:09 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:55.117 04:01:09 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:55.117 04:01:09 -- setup/hugepages.sh@89 -- # local node 00:03:55.117 04:01:09 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:55.117 04:01:09 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:55.117 04:01:09 -- setup/hugepages.sh@92 -- # local surp 00:03:55.117 04:01:09 -- setup/hugepages.sh@93 -- # local resv 00:03:55.117 04:01:09 -- setup/hugepages.sh@94 -- # local anon 00:03:55.117 04:01:09 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:55.117 04:01:09 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:55.117 04:01:09 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:55.117 04:01:09 -- setup/common.sh@18 -- # local node= 00:03:55.117 04:01:09 -- setup/common.sh@19 -- # local var val 00:03:55.117 04:01:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.117 04:01:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.117 04:01:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.117 04:01:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.117 04:01:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.117 04:01:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100818632 kB' 'MemAvailable: 105322288 kB' 'Buffers: 2696 kB' 'Cached: 18842644 kB' 'SwapCached: 0 kB' 'Active: 14942248 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269920 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571952 kB' 'Mapped: 227080 kB' 'Shmem: 13701172 kB' 'KReclaimable: 367636 kB' 'Slab: 1251232 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883596 kB' 'KernelStack: 27088 kB' 'PageTables: 9048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15714660 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235208 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.117 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.117 04:01:09 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.118 04:01:09 -- setup/common.sh@33 -- # echo 0 00:03:55.118 04:01:09 -- setup/common.sh@33 -- # return 0 00:03:55.118 04:01:09 -- setup/hugepages.sh@97 -- # anon=0 00:03:55.118 04:01:09 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:55.118 04:01:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:55.118 04:01:09 -- setup/common.sh@18 -- # local node= 00:03:55.118 04:01:09 -- setup/common.sh@19 -- # local var val 00:03:55.118 04:01:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.118 04:01:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.118 04:01:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.118 04:01:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.118 04:01:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.118 04:01:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.118 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.118 04:01:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100824928 kB' 'MemAvailable: 105328584 kB' 'Buffers: 2696 kB' 'Cached: 18842644 kB' 'SwapCached: 0 kB' 'Active: 14942208 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269880 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571996 kB' 'Mapped: 226996 kB' 'Shmem: 13701172 kB' 'KReclaimable: 367636 kB' 'Slab: 1251232 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883596 kB' 'KernelStack: 27216 kB' 'PageTables: 9376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15714672 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235240 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.118 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.119 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.119 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.120 04:01:09 -- setup/common.sh@33 -- # echo 0 00:03:55.120 04:01:09 -- setup/common.sh@33 -- # return 0 00:03:55.120 04:01:09 -- setup/hugepages.sh@99 -- # surp=0 00:03:55.120 04:01:09 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:55.120 04:01:09 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:55.120 04:01:09 -- setup/common.sh@18 -- # local node= 00:03:55.120 04:01:09 -- setup/common.sh@19 -- # local var val 00:03:55.120 04:01:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.120 04:01:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.120 04:01:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.120 04:01:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.120 04:01:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.120 04:01:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100825476 kB' 'MemAvailable: 105329132 kB' 'Buffers: 2696 kB' 'Cached: 18842656 kB' 'SwapCached: 0 kB' 'Active: 14941780 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269452 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 572064 kB' 'Mapped: 226952 kB' 'Shmem: 13701184 kB' 'KReclaimable: 367636 kB' 'Slab: 1251204 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883568 kB' 'KernelStack: 27120 kB' 'PageTables: 9400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15712916 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235048 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.120 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.120 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.121 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.121 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.122 04:01:09 -- setup/common.sh@33 -- # echo 0 00:03:55.122 04:01:09 -- setup/common.sh@33 -- # return 0 00:03:55.122 04:01:09 -- setup/hugepages.sh@100 -- # resv=0 00:03:55.122 04:01:09 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:55.122 nr_hugepages=1024 00:03:55.122 04:01:09 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:55.122 resv_hugepages=0 00:03:55.122 04:01:09 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:55.122 surplus_hugepages=0 00:03:55.122 04:01:09 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:55.122 anon_hugepages=0 00:03:55.122 04:01:09 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:55.122 04:01:09 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:55.122 04:01:09 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:55.122 04:01:09 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:55.122 04:01:09 -- setup/common.sh@18 -- # local node= 00:03:55.122 04:01:09 -- setup/common.sh@19 -- # local var val 00:03:55.122 04:01:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.122 04:01:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.122 04:01:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.122 04:01:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.122 04:01:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.122 04:01:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100824976 kB' 'MemAvailable: 105328632 kB' 'Buffers: 2696 kB' 'Cached: 18842656 kB' 'SwapCached: 0 kB' 'Active: 14942028 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269700 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571780 kB' 'Mapped: 226952 kB' 'Shmem: 13701184 kB' 'KReclaimable: 367636 kB' 'Slab: 1251236 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883600 kB' 'KernelStack: 26960 kB' 'PageTables: 9048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15714452 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235144 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.122 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.122 04:01:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.123 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.123 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.123 04:01:09 -- setup/common.sh@33 -- # echo 1024 00:03:55.123 04:01:09 -- setup/common.sh@33 -- # return 0 00:03:55.124 04:01:09 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:55.124 04:01:09 -- setup/hugepages.sh@112 -- # get_nodes 00:03:55.124 04:01:09 -- setup/hugepages.sh@27 -- # local node 00:03:55.124 04:01:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:55.124 04:01:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:55.124 04:01:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:55.124 04:01:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:55.124 04:01:09 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:55.124 04:01:09 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:55.124 04:01:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:55.124 04:01:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:55.124 04:01:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:55.124 04:01:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:55.124 04:01:09 -- setup/common.sh@18 -- # local node=0 00:03:55.124 04:01:09 -- setup/common.sh@19 -- # local var val 00:03:55.124 04:01:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.124 04:01:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.124 04:01:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:55.124 04:01:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:55.124 04:01:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.124 04:01:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 59053048 kB' 'MemUsed: 6605960 kB' 'SwapCached: 0 kB' 'Active: 3334196 kB' 'Inactive: 185548 kB' 'Active(anon): 2797140 kB' 'Inactive(anon): 0 kB' 'Active(file): 537056 kB' 'Inactive(file): 185548 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3211980 kB' 'Mapped: 150124 kB' 'AnonPages: 310944 kB' 'Shmem: 2489376 kB' 'KernelStack: 14376 kB' 'PageTables: 5716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 174140 kB' 'Slab: 665280 kB' 'SReclaimable: 174140 kB' 'SUnreclaim: 491140 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.124 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.124 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@33 -- # echo 0 00:03:55.125 04:01:09 -- setup/common.sh@33 -- # return 0 00:03:55.125 04:01:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:55.125 04:01:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:55.125 04:01:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:55.125 04:01:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:55.125 04:01:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:55.125 04:01:09 -- setup/common.sh@18 -- # local node=1 00:03:55.125 04:01:09 -- setup/common.sh@19 -- # local var val 00:03:55.125 04:01:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.125 04:01:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.125 04:01:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:55.125 04:01:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:55.125 04:01:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.125 04:01:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679804 kB' 'MemFree: 41773324 kB' 'MemUsed: 18906480 kB' 'SwapCached: 0 kB' 'Active: 11608120 kB' 'Inactive: 4286292 kB' 'Active(anon): 11472848 kB' 'Inactive(anon): 0 kB' 'Active(file): 135272 kB' 'Inactive(file): 4286292 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 15633420 kB' 'Mapped: 76828 kB' 'AnonPages: 261064 kB' 'Shmem: 11211856 kB' 'KernelStack: 12776 kB' 'PageTables: 3816 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 193496 kB' 'Slab: 585956 kB' 'SReclaimable: 193496 kB' 'SUnreclaim: 392460 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.125 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.125 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # continue 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.126 04:01:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.126 04:01:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.126 04:01:09 -- setup/common.sh@33 -- # echo 0 00:03:55.126 04:01:09 -- setup/common.sh@33 -- # return 0 00:03:55.126 04:01:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:55.126 04:01:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:55.126 04:01:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:55.126 04:01:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:55.126 04:01:09 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:55.126 node0=512 expecting 512 00:03:55.126 04:01:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:55.126 04:01:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:55.126 04:01:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:55.126 04:01:09 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:55.126 node1=512 expecting 512 00:03:55.126 04:01:09 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:55.126 00:03:55.126 real 0m3.871s 00:03:55.126 user 0m1.483s 00:03:55.126 sys 0m2.436s 00:03:55.126 04:01:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:55.126 04:01:09 -- common/autotest_common.sh@10 -- # set +x 00:03:55.126 ************************************ 00:03:55.126 END TEST per_node_1G_alloc 00:03:55.126 ************************************ 00:03:55.126 04:01:09 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:55.126 04:01:09 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:55.126 04:01:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:55.126 04:01:09 -- common/autotest_common.sh@10 -- # set +x 00:03:55.126 ************************************ 00:03:55.126 START TEST even_2G_alloc 00:03:55.126 ************************************ 00:03:55.126 04:01:09 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:03:55.126 04:01:09 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:55.126 04:01:09 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:55.126 04:01:09 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:55.126 04:01:09 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:55.126 04:01:09 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:55.126 04:01:09 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:55.126 04:01:09 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:55.126 04:01:09 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:55.126 04:01:09 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:55.126 04:01:09 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:55.126 04:01:09 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:55.126 04:01:09 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:55.126 04:01:09 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:55.126 04:01:09 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:55.126 04:01:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:55.126 04:01:09 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:55.126 04:01:09 -- setup/hugepages.sh@83 -- # : 512 00:03:55.126 04:01:09 -- setup/hugepages.sh@84 -- # : 1 00:03:55.126 04:01:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:55.126 04:01:09 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:55.126 04:01:09 -- setup/hugepages.sh@83 -- # : 0 00:03:55.126 04:01:09 -- setup/hugepages.sh@84 -- # : 0 00:03:55.126 04:01:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:55.126 04:01:09 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:55.126 04:01:09 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:55.126 04:01:09 -- setup/hugepages.sh@153 -- # setup output 00:03:55.126 04:01:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:55.126 04:01:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:58.431 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:58.431 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:58.431 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:58.694 04:01:13 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:58.694 04:01:13 -- setup/hugepages.sh@89 -- # local node 00:03:58.694 04:01:13 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:58.694 04:01:13 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:58.694 04:01:13 -- setup/hugepages.sh@92 -- # local surp 00:03:58.694 04:01:13 -- setup/hugepages.sh@93 -- # local resv 00:03:58.694 04:01:13 -- setup/hugepages.sh@94 -- # local anon 00:03:58.694 04:01:13 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:58.694 04:01:13 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:58.694 04:01:13 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:58.694 04:01:13 -- setup/common.sh@18 -- # local node= 00:03:58.694 04:01:13 -- setup/common.sh@19 -- # local var val 00:03:58.694 04:01:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:58.694 04:01:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:58.694 04:01:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:58.694 04:01:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:58.694 04:01:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:58.694 04:01:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.694 04:01:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100827052 kB' 'MemAvailable: 105330708 kB' 'Buffers: 2696 kB' 'Cached: 18842804 kB' 'SwapCached: 0 kB' 'Active: 14941972 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269644 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571564 kB' 'Mapped: 226976 kB' 'Shmem: 13701332 kB' 'KReclaimable: 367636 kB' 'Slab: 1251020 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883384 kB' 'KernelStack: 26960 kB' 'PageTables: 8772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15715360 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235384 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.694 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.694 04:01:13 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.695 04:01:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.695 04:01:13 -- setup/common.sh@33 -- # echo 0 00:03:58.695 04:01:13 -- setup/common.sh@33 -- # return 0 00:03:58.695 04:01:13 -- setup/hugepages.sh@97 -- # anon=0 00:03:58.695 04:01:13 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:58.695 04:01:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:58.695 04:01:13 -- setup/common.sh@18 -- # local node= 00:03:58.695 04:01:13 -- setup/common.sh@19 -- # local var val 00:03:58.695 04:01:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:58.695 04:01:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:58.695 04:01:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:58.695 04:01:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:58.695 04:01:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:58.695 04:01:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.695 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100834040 kB' 'MemAvailable: 105337696 kB' 'Buffers: 2696 kB' 'Cached: 18842808 kB' 'SwapCached: 0 kB' 'Active: 14942212 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269884 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571800 kB' 'Mapped: 226904 kB' 'Shmem: 13701336 kB' 'KReclaimable: 367636 kB' 'Slab: 1250924 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883288 kB' 'KernelStack: 26992 kB' 'PageTables: 8824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15711180 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235176 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.696 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.696 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.962 04:01:13 -- setup/common.sh@33 -- # echo 0 00:03:58.962 04:01:13 -- setup/common.sh@33 -- # return 0 00:03:58.962 04:01:13 -- setup/hugepages.sh@99 -- # surp=0 00:03:58.962 04:01:13 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:58.962 04:01:13 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:58.962 04:01:13 -- setup/common.sh@18 -- # local node= 00:03:58.962 04:01:13 -- setup/common.sh@19 -- # local var val 00:03:58.962 04:01:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:58.962 04:01:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:58.962 04:01:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:58.962 04:01:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:58.962 04:01:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:58.962 04:01:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100834960 kB' 'MemAvailable: 105338616 kB' 'Buffers: 2696 kB' 'Cached: 18842820 kB' 'SwapCached: 0 kB' 'Active: 14941712 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269384 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571364 kB' 'Mapped: 226904 kB' 'Shmem: 13701348 kB' 'KReclaimable: 367636 kB' 'Slab: 1250884 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883248 kB' 'KernelStack: 26928 kB' 'PageTables: 8924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15711196 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235176 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.962 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.962 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.963 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.963 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.963 04:01:13 -- setup/common.sh@33 -- # echo 0 00:03:58.963 04:01:13 -- setup/common.sh@33 -- # return 0 00:03:58.963 04:01:13 -- setup/hugepages.sh@100 -- # resv=0 00:03:58.963 04:01:13 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:58.963 nr_hugepages=1024 00:03:58.963 04:01:13 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:58.963 resv_hugepages=0 00:03:58.963 04:01:13 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:58.963 surplus_hugepages=0 00:03:58.963 04:01:13 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:58.963 anon_hugepages=0 00:03:58.963 04:01:13 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:58.963 04:01:13 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:58.963 04:01:13 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:58.963 04:01:13 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:58.963 04:01:13 -- setup/common.sh@18 -- # local node= 00:03:58.963 04:01:13 -- setup/common.sh@19 -- # local var val 00:03:58.964 04:01:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:58.964 04:01:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:58.964 04:01:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:58.964 04:01:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:58.964 04:01:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:58.964 04:01:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100835108 kB' 'MemAvailable: 105338764 kB' 'Buffers: 2696 kB' 'Cached: 18842832 kB' 'SwapCached: 0 kB' 'Active: 14941712 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269384 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571360 kB' 'Mapped: 226904 kB' 'Shmem: 13701360 kB' 'KReclaimable: 367636 kB' 'Slab: 1250884 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883248 kB' 'KernelStack: 26928 kB' 'PageTables: 8924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15711208 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235176 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.964 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.964 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:58.965 04:01:13 -- setup/common.sh@33 -- # echo 1024 00:03:58.965 04:01:13 -- setup/common.sh@33 -- # return 0 00:03:58.965 04:01:13 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:58.965 04:01:13 -- setup/hugepages.sh@112 -- # get_nodes 00:03:58.965 04:01:13 -- setup/hugepages.sh@27 -- # local node 00:03:58.965 04:01:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:58.965 04:01:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:58.965 04:01:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:58.965 04:01:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:58.965 04:01:13 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:58.965 04:01:13 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:58.965 04:01:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:58.965 04:01:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:58.965 04:01:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:58.965 04:01:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:58.965 04:01:13 -- setup/common.sh@18 -- # local node=0 00:03:58.965 04:01:13 -- setup/common.sh@19 -- # local var val 00:03:58.965 04:01:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:58.965 04:01:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:58.965 04:01:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:58.965 04:01:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:58.965 04:01:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:58.965 04:01:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 59054924 kB' 'MemUsed: 6604084 kB' 'SwapCached: 0 kB' 'Active: 3332460 kB' 'Inactive: 185548 kB' 'Active(anon): 2795404 kB' 'Inactive(anon): 0 kB' 'Active(file): 537056 kB' 'Inactive(file): 185548 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3211988 kB' 'Mapped: 150076 kB' 'AnonPages: 309184 kB' 'Shmem: 2489384 kB' 'KernelStack: 14104 kB' 'PageTables: 4956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 174140 kB' 'Slab: 664812 kB' 'SReclaimable: 174140 kB' 'SUnreclaim: 490672 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.965 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.965 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@33 -- # echo 0 00:03:58.966 04:01:13 -- setup/common.sh@33 -- # return 0 00:03:58.966 04:01:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:58.966 04:01:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:58.966 04:01:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:58.966 04:01:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:58.966 04:01:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:58.966 04:01:13 -- setup/common.sh@18 -- # local node=1 00:03:58.966 04:01:13 -- setup/common.sh@19 -- # local var val 00:03:58.966 04:01:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:58.966 04:01:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:58.966 04:01:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:58.966 04:01:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:58.966 04:01:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:58.966 04:01:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679804 kB' 'MemFree: 41780864 kB' 'MemUsed: 18898940 kB' 'SwapCached: 0 kB' 'Active: 11609280 kB' 'Inactive: 4286292 kB' 'Active(anon): 11474008 kB' 'Inactive(anon): 0 kB' 'Active(file): 135272 kB' 'Inactive(file): 4286292 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 15633568 kB' 'Mapped: 76828 kB' 'AnonPages: 262172 kB' 'Shmem: 11212004 kB' 'KernelStack: 12824 kB' 'PageTables: 3968 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 193496 kB' 'Slab: 586072 kB' 'SReclaimable: 193496 kB' 'SUnreclaim: 392576 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.966 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.966 04:01:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # continue 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.967 04:01:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.967 04:01:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.967 04:01:13 -- setup/common.sh@33 -- # echo 0 00:03:58.967 04:01:13 -- setup/common.sh@33 -- # return 0 00:03:58.967 04:01:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:58.967 04:01:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:58.967 04:01:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:58.967 04:01:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:58.967 04:01:13 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:58.967 node0=512 expecting 512 00:03:58.967 04:01:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:58.967 04:01:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:58.967 04:01:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:58.967 04:01:13 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:58.967 node1=512 expecting 512 00:03:58.967 04:01:13 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:58.967 00:03:58.967 real 0m3.767s 00:03:58.967 user 0m1.555s 00:03:58.967 sys 0m2.270s 00:03:58.967 04:01:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:58.967 04:01:13 -- common/autotest_common.sh@10 -- # set +x 00:03:58.967 ************************************ 00:03:58.967 END TEST even_2G_alloc 00:03:58.967 ************************************ 00:03:58.967 04:01:13 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:58.967 04:01:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:58.967 04:01:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:58.967 04:01:13 -- common/autotest_common.sh@10 -- # set +x 00:03:58.967 ************************************ 00:03:58.967 START TEST odd_alloc 00:03:58.967 ************************************ 00:03:58.967 04:01:13 -- common/autotest_common.sh@1104 -- # odd_alloc 00:03:58.967 04:01:13 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:58.967 04:01:13 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:58.967 04:01:13 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:58.967 04:01:13 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:58.967 04:01:13 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:58.967 04:01:13 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:58.967 04:01:13 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:58.967 04:01:13 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:58.967 04:01:13 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:58.967 04:01:13 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:58.967 04:01:13 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:58.967 04:01:13 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:58.967 04:01:13 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:58.967 04:01:13 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:58.967 04:01:13 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:58.967 04:01:13 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:58.967 04:01:13 -- setup/hugepages.sh@83 -- # : 513 00:03:58.967 04:01:13 -- setup/hugepages.sh@84 -- # : 1 00:03:58.967 04:01:13 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:58.967 04:01:13 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:58.967 04:01:13 -- setup/hugepages.sh@83 -- # : 0 00:03:58.967 04:01:13 -- setup/hugepages.sh@84 -- # : 0 00:03:58.967 04:01:13 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:58.967 04:01:13 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:58.967 04:01:13 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:58.967 04:01:13 -- setup/hugepages.sh@160 -- # setup output 00:03:58.967 04:01:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:58.967 04:01:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:02.275 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:04:02.275 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:04:02.275 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:04:02.536 04:01:17 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:02.536 04:01:17 -- setup/hugepages.sh@89 -- # local node 00:04:02.536 04:01:17 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:02.536 04:01:17 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:02.536 04:01:17 -- setup/hugepages.sh@92 -- # local surp 00:04:02.536 04:01:17 -- setup/hugepages.sh@93 -- # local resv 00:04:02.536 04:01:17 -- setup/hugepages.sh@94 -- # local anon 00:04:02.536 04:01:17 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:02.536 04:01:17 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:02.536 04:01:17 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:02.536 04:01:17 -- setup/common.sh@18 -- # local node= 00:04:02.536 04:01:17 -- setup/common.sh@19 -- # local var val 00:04:02.536 04:01:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:02.536 04:01:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:02.536 04:01:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:02.536 04:01:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:02.536 04:01:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:02.536 04:01:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:02.536 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.536 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.537 04:01:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100807540 kB' 'MemAvailable: 105311196 kB' 'Buffers: 2696 kB' 'Cached: 18842948 kB' 'SwapCached: 0 kB' 'Active: 14942812 kB' 'Inactive: 4471840 kB' 'Active(anon): 14270484 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571908 kB' 'Mapped: 227116 kB' 'Shmem: 13701476 kB' 'KReclaimable: 367636 kB' 'Slab: 1250992 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883356 kB' 'KernelStack: 26944 kB' 'PageTables: 9012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508408 kB' 'Committed_AS: 15712092 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235240 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.537 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.537 04:01:17 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.805 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.805 04:01:17 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.806 04:01:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:02.806 04:01:17 -- setup/common.sh@33 -- # echo 0 00:04:02.806 04:01:17 -- setup/common.sh@33 -- # return 0 00:04:02.806 04:01:17 -- setup/hugepages.sh@97 -- # anon=0 00:04:02.806 04:01:17 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:02.806 04:01:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:02.806 04:01:17 -- setup/common.sh@18 -- # local node= 00:04:02.806 04:01:17 -- setup/common.sh@19 -- # local var val 00:04:02.806 04:01:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:02.806 04:01:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:02.806 04:01:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:02.806 04:01:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:02.806 04:01:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:02.806 04:01:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.806 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100808440 kB' 'MemAvailable: 105312096 kB' 'Buffers: 2696 kB' 'Cached: 18842948 kB' 'SwapCached: 0 kB' 'Active: 14943400 kB' 'Inactive: 4471840 kB' 'Active(anon): 14271072 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 572444 kB' 'Mapped: 227076 kB' 'Shmem: 13701476 kB' 'KReclaimable: 367636 kB' 'Slab: 1250992 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883356 kB' 'KernelStack: 26928 kB' 'PageTables: 8952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508408 kB' 'Committed_AS: 15712104 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235208 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.807 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.807 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.808 04:01:17 -- setup/common.sh@33 -- # echo 0 00:04:02.808 04:01:17 -- setup/common.sh@33 -- # return 0 00:04:02.808 04:01:17 -- setup/hugepages.sh@99 -- # surp=0 00:04:02.808 04:01:17 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:02.808 04:01:17 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:02.808 04:01:17 -- setup/common.sh@18 -- # local node= 00:04:02.808 04:01:17 -- setup/common.sh@19 -- # local var val 00:04:02.808 04:01:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:02.808 04:01:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:02.808 04:01:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:02.808 04:01:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:02.808 04:01:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:02.808 04:01:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100808644 kB' 'MemAvailable: 105312300 kB' 'Buffers: 2696 kB' 'Cached: 18842960 kB' 'SwapCached: 0 kB' 'Active: 14942240 kB' 'Inactive: 4471840 kB' 'Active(anon): 14269912 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 571692 kB' 'Mapped: 227000 kB' 'Shmem: 13701488 kB' 'KReclaimable: 367636 kB' 'Slab: 1250964 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883328 kB' 'KernelStack: 26912 kB' 'PageTables: 8888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508408 kB' 'Committed_AS: 15712120 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235224 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.808 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.808 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:02.809 04:01:17 -- setup/common.sh@33 -- # echo 0 00:04:02.809 04:01:17 -- setup/common.sh@33 -- # return 0 00:04:02.809 04:01:17 -- setup/hugepages.sh@100 -- # resv=0 00:04:02.809 04:01:17 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:02.809 nr_hugepages=1025 00:04:02.809 04:01:17 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:02.809 resv_hugepages=0 00:04:02.809 04:01:17 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:02.809 surplus_hugepages=0 00:04:02.809 04:01:17 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:02.809 anon_hugepages=0 00:04:02.809 04:01:17 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:02.809 04:01:17 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:02.809 04:01:17 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:02.809 04:01:17 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:02.809 04:01:17 -- setup/common.sh@18 -- # local node= 00:04:02.809 04:01:17 -- setup/common.sh@19 -- # local var val 00:04:02.809 04:01:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:02.809 04:01:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:02.809 04:01:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:02.809 04:01:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:02.809 04:01:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:02.809 04:01:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100808896 kB' 'MemAvailable: 105312552 kB' 'Buffers: 2696 kB' 'Cached: 18842960 kB' 'SwapCached: 0 kB' 'Active: 14942620 kB' 'Inactive: 4471840 kB' 'Active(anon): 14270292 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 572112 kB' 'Mapped: 227000 kB' 'Shmem: 13701488 kB' 'KReclaimable: 367636 kB' 'Slab: 1250964 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883328 kB' 'KernelStack: 26928 kB' 'PageTables: 8944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508408 kB' 'Committed_AS: 15712136 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235224 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.809 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.809 04:01:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.810 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.810 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.811 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:02.811 04:01:17 -- setup/common.sh@33 -- # echo 1025 00:04:02.811 04:01:17 -- setup/common.sh@33 -- # return 0 00:04:02.811 04:01:17 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:02.811 04:01:17 -- setup/hugepages.sh@112 -- # get_nodes 00:04:02.811 04:01:17 -- setup/hugepages.sh@27 -- # local node 00:04:02.811 04:01:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:02.811 04:01:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:02.811 04:01:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:02.811 04:01:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:02.811 04:01:17 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:02.811 04:01:17 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:02.811 04:01:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:02.811 04:01:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:02.811 04:01:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:02.811 04:01:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:02.811 04:01:17 -- setup/common.sh@18 -- # local node=0 00:04:02.811 04:01:17 -- setup/common.sh@19 -- # local var val 00:04:02.811 04:01:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:02.811 04:01:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:02.811 04:01:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:02.811 04:01:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:02.811 04:01:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:02.811 04:01:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.811 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 59035128 kB' 'MemUsed: 6623880 kB' 'SwapCached: 0 kB' 'Active: 3332948 kB' 'Inactive: 185548 kB' 'Active(anon): 2795892 kB' 'Inactive(anon): 0 kB' 'Active(file): 537056 kB' 'Inactive(file): 185548 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3212020 kB' 'Mapped: 150156 kB' 'AnonPages: 309700 kB' 'Shmem: 2489416 kB' 'KernelStack: 14120 kB' 'PageTables: 5012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 174140 kB' 'Slab: 664876 kB' 'SReclaimable: 174140 kB' 'SUnreclaim: 490736 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.812 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.812 04:01:17 -- setup/common.sh@33 -- # echo 0 00:04:02.812 04:01:17 -- setup/common.sh@33 -- # return 0 00:04:02.812 04:01:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:02.812 04:01:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:02.812 04:01:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:02.812 04:01:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:02.812 04:01:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:02.812 04:01:17 -- setup/common.sh@18 -- # local node=1 00:04:02.812 04:01:17 -- setup/common.sh@19 -- # local var val 00:04:02.812 04:01:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:02.812 04:01:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:02.812 04:01:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:02.812 04:01:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:02.812 04:01:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:02.812 04:01:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.812 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679804 kB' 'MemFree: 41773776 kB' 'MemUsed: 18906028 kB' 'SwapCached: 0 kB' 'Active: 11609632 kB' 'Inactive: 4286292 kB' 'Active(anon): 11474360 kB' 'Inactive(anon): 0 kB' 'Active(file): 135272 kB' 'Inactive(file): 4286292 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 15633668 kB' 'Mapped: 76844 kB' 'AnonPages: 262328 kB' 'Shmem: 11212104 kB' 'KernelStack: 12776 kB' 'PageTables: 3820 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 193496 kB' 'Slab: 586088 kB' 'SReclaimable: 193496 kB' 'SUnreclaim: 392592 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # continue 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:02.813 04:01:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:02.813 04:01:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:02.813 04:01:17 -- setup/common.sh@33 -- # echo 0 00:04:02.813 04:01:17 -- setup/common.sh@33 -- # return 0 00:04:02.813 04:01:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:02.813 04:01:17 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:02.813 04:01:17 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:02.813 04:01:17 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:02.814 04:01:17 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:02.814 node0=512 expecting 513 00:04:02.814 04:01:17 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:02.814 04:01:17 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:02.814 04:01:17 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:02.814 04:01:17 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:02.814 node1=513 expecting 512 00:04:02.814 04:01:17 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:02.814 00:04:02.814 real 0m3.847s 00:04:02.814 user 0m1.504s 00:04:02.814 sys 0m2.393s 00:04:02.814 04:01:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:02.814 04:01:17 -- common/autotest_common.sh@10 -- # set +x 00:04:02.814 ************************************ 00:04:02.814 END TEST odd_alloc 00:04:02.814 ************************************ 00:04:02.814 04:01:17 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:02.814 04:01:17 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:02.814 04:01:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:02.814 04:01:17 -- common/autotest_common.sh@10 -- # set +x 00:04:02.814 ************************************ 00:04:02.814 START TEST custom_alloc 00:04:02.814 ************************************ 00:04:02.814 04:01:17 -- common/autotest_common.sh@1104 -- # custom_alloc 00:04:02.814 04:01:17 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:02.814 04:01:17 -- setup/hugepages.sh@169 -- # local node 00:04:02.814 04:01:17 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:02.814 04:01:17 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:02.814 04:01:17 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:02.814 04:01:17 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:02.814 04:01:17 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:02.814 04:01:17 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:02.814 04:01:17 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:02.814 04:01:17 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:02.814 04:01:17 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:02.814 04:01:17 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:02.814 04:01:17 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:02.814 04:01:17 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:02.814 04:01:17 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:02.814 04:01:17 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:02.814 04:01:17 -- setup/hugepages.sh@83 -- # : 256 00:04:02.814 04:01:17 -- setup/hugepages.sh@84 -- # : 1 00:04:02.814 04:01:17 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:02.814 04:01:17 -- setup/hugepages.sh@83 -- # : 0 00:04:02.814 04:01:17 -- setup/hugepages.sh@84 -- # : 0 00:04:02.814 04:01:17 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:02.814 04:01:17 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:02.814 04:01:17 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:02.814 04:01:17 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:02.814 04:01:17 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:02.814 04:01:17 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:02.814 04:01:17 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:02.814 04:01:17 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:02.814 04:01:17 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:02.814 04:01:17 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:02.814 04:01:17 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:02.814 04:01:17 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:02.814 04:01:17 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:02.814 04:01:17 -- setup/hugepages.sh@78 -- # return 0 00:04:02.814 04:01:17 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:02.814 04:01:17 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:02.814 04:01:17 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:02.814 04:01:17 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:02.814 04:01:17 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:02.814 04:01:17 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:02.814 04:01:17 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:02.814 04:01:17 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:02.814 04:01:17 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:02.814 04:01:17 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:02.814 04:01:17 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:02.814 04:01:17 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:02.814 04:01:17 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:02.814 04:01:17 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:02.814 04:01:17 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:02.814 04:01:17 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:02.814 04:01:17 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:02.814 04:01:17 -- setup/hugepages.sh@78 -- # return 0 00:04:02.814 04:01:17 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:02.814 04:01:17 -- setup/hugepages.sh@187 -- # setup output 00:04:02.814 04:01:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:02.814 04:01:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:06.119 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:04:06.119 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:04:06.119 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:04:06.695 04:01:20 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:06.695 04:01:20 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:06.695 04:01:20 -- setup/hugepages.sh@89 -- # local node 00:04:06.695 04:01:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:06.695 04:01:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:06.695 04:01:20 -- setup/hugepages.sh@92 -- # local surp 00:04:06.695 04:01:20 -- setup/hugepages.sh@93 -- # local resv 00:04:06.695 04:01:20 -- setup/hugepages.sh@94 -- # local anon 00:04:06.695 04:01:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:06.695 04:01:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:06.695 04:01:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:06.695 04:01:20 -- setup/common.sh@18 -- # local node= 00:04:06.695 04:01:20 -- setup/common.sh@19 -- # local var val 00:04:06.695 04:01:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.695 04:01:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.695 04:01:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.695 04:01:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.695 04:01:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.695 04:01:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.695 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.695 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 99767944 kB' 'MemAvailable: 104271600 kB' 'Buffers: 2696 kB' 'Cached: 18851288 kB' 'SwapCached: 0 kB' 'Active: 14953148 kB' 'Inactive: 4471840 kB' 'Active(anon): 14280820 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 574120 kB' 'Mapped: 227060 kB' 'Shmem: 13709816 kB' 'KReclaimable: 367636 kB' 'Slab: 1251396 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883760 kB' 'KernelStack: 26912 kB' 'PageTables: 8920 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985144 kB' 'Committed_AS: 15721084 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235240 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.696 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.696 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.697 04:01:20 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.697 04:01:21 -- setup/common.sh@33 -- # echo 0 00:04:06.697 04:01:21 -- setup/common.sh@33 -- # return 0 00:04:06.697 04:01:21 -- setup/hugepages.sh@97 -- # anon=0 00:04:06.697 04:01:21 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:06.697 04:01:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:06.697 04:01:21 -- setup/common.sh@18 -- # local node= 00:04:06.697 04:01:21 -- setup/common.sh@19 -- # local var val 00:04:06.697 04:01:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.697 04:01:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.697 04:01:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.697 04:01:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.697 04:01:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.697 04:01:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 99770256 kB' 'MemAvailable: 104273912 kB' 'Buffers: 2696 kB' 'Cached: 18851292 kB' 'SwapCached: 0 kB' 'Active: 14952520 kB' 'Inactive: 4471840 kB' 'Active(anon): 14280192 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 573948 kB' 'Mapped: 226944 kB' 'Shmem: 13709820 kB' 'KReclaimable: 367636 kB' 'Slab: 1251380 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883744 kB' 'KernelStack: 26896 kB' 'PageTables: 8852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985144 kB' 'Committed_AS: 15721096 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235224 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.697 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.697 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.698 04:01:21 -- setup/common.sh@33 -- # echo 0 00:04:06.698 04:01:21 -- setup/common.sh@33 -- # return 0 00:04:06.698 04:01:21 -- setup/hugepages.sh@99 -- # surp=0 00:04:06.698 04:01:21 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:06.698 04:01:21 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:06.698 04:01:21 -- setup/common.sh@18 -- # local node= 00:04:06.698 04:01:21 -- setup/common.sh@19 -- # local var val 00:04:06.698 04:01:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.698 04:01:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.698 04:01:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.698 04:01:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.698 04:01:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.698 04:01:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 99771056 kB' 'MemAvailable: 104274712 kB' 'Buffers: 2696 kB' 'Cached: 18851304 kB' 'SwapCached: 0 kB' 'Active: 14953180 kB' 'Inactive: 4471840 kB' 'Active(anon): 14280852 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 574688 kB' 'Mapped: 226944 kB' 'Shmem: 13709832 kB' 'KReclaimable: 367636 kB' 'Slab: 1251380 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883744 kB' 'KernelStack: 26928 kB' 'PageTables: 8964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985144 kB' 'Committed_AS: 15725232 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235208 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.698 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.698 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.699 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.699 04:01:21 -- setup/common.sh@33 -- # echo 0 00:04:06.699 04:01:21 -- setup/common.sh@33 -- # return 0 00:04:06.699 04:01:21 -- setup/hugepages.sh@100 -- # resv=0 00:04:06.699 04:01:21 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:06.699 nr_hugepages=1536 00:04:06.699 04:01:21 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:06.699 resv_hugepages=0 00:04:06.699 04:01:21 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:06.699 surplus_hugepages=0 00:04:06.699 04:01:21 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:06.699 anon_hugepages=0 00:04:06.699 04:01:21 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:06.699 04:01:21 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:06.699 04:01:21 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:06.699 04:01:21 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:06.699 04:01:21 -- setup/common.sh@18 -- # local node= 00:04:06.699 04:01:21 -- setup/common.sh@19 -- # local var val 00:04:06.699 04:01:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.699 04:01:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.699 04:01:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.699 04:01:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.699 04:01:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.699 04:01:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.699 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 99771312 kB' 'MemAvailable: 104274968 kB' 'Buffers: 2696 kB' 'Cached: 18851328 kB' 'SwapCached: 0 kB' 'Active: 14952260 kB' 'Inactive: 4471840 kB' 'Active(anon): 14279932 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 573620 kB' 'Mapped: 226944 kB' 'Shmem: 13709856 kB' 'KReclaimable: 367636 kB' 'Slab: 1251380 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883744 kB' 'KernelStack: 26864 kB' 'PageTables: 8744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985144 kB' 'Committed_AS: 15721124 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235176 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.700 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.700 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.701 04:01:21 -- setup/common.sh@33 -- # echo 1536 00:04:06.701 04:01:21 -- setup/common.sh@33 -- # return 0 00:04:06.701 04:01:21 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:06.701 04:01:21 -- setup/hugepages.sh@112 -- # get_nodes 00:04:06.701 04:01:21 -- setup/hugepages.sh@27 -- # local node 00:04:06.701 04:01:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:06.701 04:01:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:06.701 04:01:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:06.701 04:01:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:06.701 04:01:21 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:06.701 04:01:21 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:06.701 04:01:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:06.701 04:01:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:06.701 04:01:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:06.701 04:01:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:06.701 04:01:21 -- setup/common.sh@18 -- # local node=0 00:04:06.701 04:01:21 -- setup/common.sh@19 -- # local var val 00:04:06.701 04:01:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.701 04:01:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.701 04:01:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:06.701 04:01:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:06.701 04:01:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.701 04:01:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 59040212 kB' 'MemUsed: 6618796 kB' 'SwapCached: 0 kB' 'Active: 3342072 kB' 'Inactive: 185548 kB' 'Active(anon): 2805016 kB' 'Inactive(anon): 0 kB' 'Active(file): 537056 kB' 'Inactive(file): 185548 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3220332 kB' 'Mapped: 150116 kB' 'AnonPages: 310636 kB' 'Shmem: 2497728 kB' 'KernelStack: 14072 kB' 'PageTables: 4876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 174140 kB' 'Slab: 664976 kB' 'SReclaimable: 174140 kB' 'SUnreclaim: 490836 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.701 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.701 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@33 -- # echo 0 00:04:06.702 04:01:21 -- setup/common.sh@33 -- # return 0 00:04:06.702 04:01:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:06.702 04:01:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:06.702 04:01:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:06.702 04:01:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:06.702 04:01:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:06.702 04:01:21 -- setup/common.sh@18 -- # local node=1 00:04:06.702 04:01:21 -- setup/common.sh@19 -- # local var val 00:04:06.702 04:01:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.702 04:01:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.702 04:01:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:06.702 04:01:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:06.702 04:01:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.702 04:01:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679804 kB' 'MemFree: 40731264 kB' 'MemUsed: 19948540 kB' 'SwapCached: 0 kB' 'Active: 11610116 kB' 'Inactive: 4286292 kB' 'Active(anon): 11474844 kB' 'Inactive(anon): 0 kB' 'Active(file): 135272 kB' 'Inactive(file): 4286292 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 15633708 kB' 'Mapped: 76828 kB' 'AnonPages: 262908 kB' 'Shmem: 11212144 kB' 'KernelStack: 12808 kB' 'PageTables: 3912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 193496 kB' 'Slab: 586404 kB' 'SReclaimable: 193496 kB' 'SUnreclaim: 392908 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.702 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.702 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.703 04:01:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.703 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.703 04:01:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.703 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.703 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.703 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.703 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.703 04:01:21 -- setup/common.sh@32 -- # continue 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.703 04:01:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.703 04:01:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.703 04:01:21 -- setup/common.sh@33 -- # echo 0 00:04:06.703 04:01:21 -- setup/common.sh@33 -- # return 0 00:04:06.703 04:01:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:06.703 04:01:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:06.703 04:01:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:06.703 04:01:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:06.703 04:01:21 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:06.703 node0=512 expecting 512 00:04:06.703 04:01:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:06.703 04:01:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:06.703 04:01:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:06.703 04:01:21 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:06.703 node1=1024 expecting 1024 00:04:06.703 04:01:21 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:06.703 00:04:06.703 real 0m3.838s 00:04:06.703 user 0m1.551s 00:04:06.703 sys 0m2.341s 00:04:06.703 04:01:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:06.703 04:01:21 -- common/autotest_common.sh@10 -- # set +x 00:04:06.703 ************************************ 00:04:06.703 END TEST custom_alloc 00:04:06.703 ************************************ 00:04:06.703 04:01:21 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:06.703 04:01:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:06.703 04:01:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:06.703 04:01:21 -- common/autotest_common.sh@10 -- # set +x 00:04:06.703 ************************************ 00:04:06.703 START TEST no_shrink_alloc 00:04:06.703 ************************************ 00:04:06.703 04:01:21 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:04:06.703 04:01:21 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:06.703 04:01:21 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:06.703 04:01:21 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:06.703 04:01:21 -- setup/hugepages.sh@51 -- # shift 00:04:06.703 04:01:21 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:06.703 04:01:21 -- setup/hugepages.sh@52 -- # local node_ids 00:04:06.703 04:01:21 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:06.703 04:01:21 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:06.703 04:01:21 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:06.703 04:01:21 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:06.703 04:01:21 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:06.703 04:01:21 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:06.703 04:01:21 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:06.703 04:01:21 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:06.703 04:01:21 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:06.703 04:01:21 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:06.703 04:01:21 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:06.703 04:01:21 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:06.703 04:01:21 -- setup/hugepages.sh@73 -- # return 0 00:04:06.703 04:01:21 -- setup/hugepages.sh@198 -- # setup output 00:04:06.703 04:01:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:06.703 04:01:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:10.006 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:04:10.006 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:04:10.006 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:04:10.267 04:01:24 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:10.267 04:01:24 -- setup/hugepages.sh@89 -- # local node 00:04:10.267 04:01:24 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:10.267 04:01:24 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:10.267 04:01:24 -- setup/hugepages.sh@92 -- # local surp 00:04:10.267 04:01:24 -- setup/hugepages.sh@93 -- # local resv 00:04:10.267 04:01:24 -- setup/hugepages.sh@94 -- # local anon 00:04:10.267 04:01:24 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:10.267 04:01:24 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:10.267 04:01:24 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:10.267 04:01:24 -- setup/common.sh@18 -- # local node= 00:04:10.267 04:01:24 -- setup/common.sh@19 -- # local var val 00:04:10.267 04:01:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.267 04:01:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.267 04:01:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:10.267 04:01:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:10.267 04:01:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.267 04:01:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100832948 kB' 'MemAvailable: 105336604 kB' 'Buffers: 2696 kB' 'Cached: 18851436 kB' 'SwapCached: 0 kB' 'Active: 14953916 kB' 'Inactive: 4471840 kB' 'Active(anon): 14281588 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 575216 kB' 'Mapped: 227020 kB' 'Shmem: 13709964 kB' 'KReclaimable: 367636 kB' 'Slab: 1251324 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883688 kB' 'KernelStack: 27024 kB' 'PageTables: 8956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15725292 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235304 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.531 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.531 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.532 04:01:24 -- setup/common.sh@33 -- # echo 0 00:04:10.532 04:01:24 -- setup/common.sh@33 -- # return 0 00:04:10.532 04:01:24 -- setup/hugepages.sh@97 -- # anon=0 00:04:10.532 04:01:24 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:10.532 04:01:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:10.532 04:01:24 -- setup/common.sh@18 -- # local node= 00:04:10.532 04:01:24 -- setup/common.sh@19 -- # local var val 00:04:10.532 04:01:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.532 04:01:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.532 04:01:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:10.532 04:01:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:10.532 04:01:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.532 04:01:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100835124 kB' 'MemAvailable: 105338780 kB' 'Buffers: 2696 kB' 'Cached: 18851444 kB' 'SwapCached: 0 kB' 'Active: 14954344 kB' 'Inactive: 4471840 kB' 'Active(anon): 14282016 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 575652 kB' 'Mapped: 227020 kB' 'Shmem: 13709972 kB' 'KReclaimable: 367636 kB' 'Slab: 1251128 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883492 kB' 'KernelStack: 27088 kB' 'PageTables: 9048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15726952 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235288 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.532 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.532 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.533 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.533 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.534 04:01:24 -- setup/common.sh@33 -- # echo 0 00:04:10.534 04:01:24 -- setup/common.sh@33 -- # return 0 00:04:10.534 04:01:24 -- setup/hugepages.sh@99 -- # surp=0 00:04:10.534 04:01:24 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:10.534 04:01:24 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:10.534 04:01:24 -- setup/common.sh@18 -- # local node= 00:04:10.534 04:01:24 -- setup/common.sh@19 -- # local var val 00:04:10.534 04:01:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.534 04:01:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.534 04:01:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:10.534 04:01:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:10.534 04:01:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.534 04:01:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100835644 kB' 'MemAvailable: 105339300 kB' 'Buffers: 2696 kB' 'Cached: 18851456 kB' 'SwapCached: 0 kB' 'Active: 14953924 kB' 'Inactive: 4471840 kB' 'Active(anon): 14281596 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 575128 kB' 'Mapped: 226972 kB' 'Shmem: 13709984 kB' 'KReclaimable: 367636 kB' 'Slab: 1251060 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883424 kB' 'KernelStack: 26928 kB' 'PageTables: 8824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15725324 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235240 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.534 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.534 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.535 04:01:24 -- setup/common.sh@33 -- # echo 0 00:04:10.535 04:01:24 -- setup/common.sh@33 -- # return 0 00:04:10.535 04:01:24 -- setup/hugepages.sh@100 -- # resv=0 00:04:10.535 04:01:24 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:10.535 nr_hugepages=1024 00:04:10.535 04:01:24 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:10.535 resv_hugepages=0 00:04:10.535 04:01:24 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:10.535 surplus_hugepages=0 00:04:10.535 04:01:24 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:10.535 anon_hugepages=0 00:04:10.535 04:01:24 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:10.535 04:01:24 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:10.535 04:01:24 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:10.535 04:01:24 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:10.535 04:01:24 -- setup/common.sh@18 -- # local node= 00:04:10.535 04:01:24 -- setup/common.sh@19 -- # local var val 00:04:10.535 04:01:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.535 04:01:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.535 04:01:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:10.535 04:01:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:10.535 04:01:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.535 04:01:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100835452 kB' 'MemAvailable: 105339108 kB' 'Buffers: 2696 kB' 'Cached: 18851468 kB' 'SwapCached: 0 kB' 'Active: 14954340 kB' 'Inactive: 4471840 kB' 'Active(anon): 14282012 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 575560 kB' 'Mapped: 226972 kB' 'Shmem: 13709996 kB' 'KReclaimable: 367636 kB' 'Slab: 1251060 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 883424 kB' 'KernelStack: 27072 kB' 'PageTables: 9064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15725340 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235288 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.535 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.535 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.536 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.536 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.537 04:01:24 -- setup/common.sh@33 -- # echo 1024 00:04:10.537 04:01:24 -- setup/common.sh@33 -- # return 0 00:04:10.537 04:01:24 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:10.537 04:01:24 -- setup/hugepages.sh@112 -- # get_nodes 00:04:10.537 04:01:24 -- setup/hugepages.sh@27 -- # local node 00:04:10.537 04:01:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:10.537 04:01:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:10.537 04:01:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:10.537 04:01:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:10.537 04:01:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:10.537 04:01:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:10.537 04:01:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:10.537 04:01:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:10.537 04:01:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:10.537 04:01:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:10.537 04:01:24 -- setup/common.sh@18 -- # local node=0 00:04:10.537 04:01:24 -- setup/common.sh@19 -- # local var val 00:04:10.537 04:01:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.537 04:01:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.537 04:01:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:10.537 04:01:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:10.537 04:01:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.537 04:01:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.537 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 58016044 kB' 'MemUsed: 7642964 kB' 'SwapCached: 0 kB' 'Active: 3344208 kB' 'Inactive: 185548 kB' 'Active(anon): 2807152 kB' 'Inactive(anon): 0 kB' 'Active(file): 537056 kB' 'Inactive(file): 185548 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3220460 kB' 'Mapped: 150144 kB' 'AnonPages: 312600 kB' 'Shmem: 2497856 kB' 'KernelStack: 14136 kB' 'PageTables: 5092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 174140 kB' 'Slab: 664612 kB' 'SReclaimable: 174140 kB' 'SUnreclaim: 490472 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:10.537 04:01:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:24 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.537 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.537 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.538 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.538 04:01:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.538 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.538 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.538 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.538 04:01:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.538 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.538 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.538 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.538 04:01:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.538 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.538 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.538 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.538 04:01:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.538 04:01:25 -- setup/common.sh@32 -- # continue 00:04:10.538 04:01:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.538 04:01:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.538 04:01:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.538 04:01:25 -- setup/common.sh@33 -- # echo 0 00:04:10.538 04:01:25 -- setup/common.sh@33 -- # return 0 00:04:10.538 04:01:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:10.538 04:01:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:10.538 04:01:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:10.538 04:01:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:10.538 04:01:25 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:10.538 node0=1024 expecting 1024 00:04:10.538 04:01:25 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:10.538 04:01:25 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:10.538 04:01:25 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:10.538 04:01:25 -- setup/hugepages.sh@202 -- # setup output 00:04:10.538 04:01:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:10.538 04:01:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:13.843 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:04:13.843 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:04:13.843 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:04:14.123 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:14.123 04:01:28 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:14.123 04:01:28 -- setup/hugepages.sh@89 -- # local node 00:04:14.123 04:01:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:14.123 04:01:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:14.123 04:01:28 -- setup/hugepages.sh@92 -- # local surp 00:04:14.123 04:01:28 -- setup/hugepages.sh@93 -- # local resv 00:04:14.123 04:01:28 -- setup/hugepages.sh@94 -- # local anon 00:04:14.123 04:01:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:14.123 04:01:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:14.123 04:01:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:14.123 04:01:28 -- setup/common.sh@18 -- # local node= 00:04:14.123 04:01:28 -- setup/common.sh@19 -- # local var val 00:04:14.123 04:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:14.123 04:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:14.123 04:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:14.123 04:01:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:14.123 04:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:14.123 04:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100817736 kB' 'MemAvailable: 105321392 kB' 'Buffers: 2696 kB' 'Cached: 18851568 kB' 'SwapCached: 0 kB' 'Active: 14956736 kB' 'Inactive: 4471840 kB' 'Active(anon): 14284408 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 577032 kB' 'Mapped: 227084 kB' 'Shmem: 13710096 kB' 'KReclaimable: 367636 kB' 'Slab: 1252024 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 884388 kB' 'KernelStack: 27296 kB' 'PageTables: 9536 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15727724 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235432 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.123 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.123 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:14.124 04:01:28 -- setup/common.sh@33 -- # echo 0 00:04:14.124 04:01:28 -- setup/common.sh@33 -- # return 0 00:04:14.124 04:01:28 -- setup/hugepages.sh@97 -- # anon=0 00:04:14.124 04:01:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:14.124 04:01:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:14.124 04:01:28 -- setup/common.sh@18 -- # local node= 00:04:14.124 04:01:28 -- setup/common.sh@19 -- # local var val 00:04:14.124 04:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:14.124 04:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:14.124 04:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:14.124 04:01:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:14.124 04:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:14.124 04:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100817944 kB' 'MemAvailable: 105321600 kB' 'Buffers: 2696 kB' 'Cached: 18851572 kB' 'SwapCached: 0 kB' 'Active: 14956252 kB' 'Inactive: 4471840 kB' 'Active(anon): 14283924 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 576628 kB' 'Mapped: 227060 kB' 'Shmem: 13710100 kB' 'KReclaimable: 367636 kB' 'Slab: 1251880 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 884244 kB' 'KernelStack: 27136 kB' 'PageTables: 9444 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15727736 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235448 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.124 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.124 04:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.125 04:01:28 -- setup/common.sh@33 -- # echo 0 00:04:14.125 04:01:28 -- setup/common.sh@33 -- # return 0 00:04:14.125 04:01:28 -- setup/hugepages.sh@99 -- # surp=0 00:04:14.125 04:01:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:14.125 04:01:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:14.125 04:01:28 -- setup/common.sh@18 -- # local node= 00:04:14.125 04:01:28 -- setup/common.sh@19 -- # local var val 00:04:14.125 04:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:14.125 04:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:14.125 04:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:14.125 04:01:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:14.125 04:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:14.125 04:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100817736 kB' 'MemAvailable: 105321392 kB' 'Buffers: 2696 kB' 'Cached: 18851572 kB' 'SwapCached: 0 kB' 'Active: 14955540 kB' 'Inactive: 4471840 kB' 'Active(anon): 14283212 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 576408 kB' 'Mapped: 226984 kB' 'Shmem: 13710100 kB' 'KReclaimable: 367636 kB' 'Slab: 1251876 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 884240 kB' 'KernelStack: 27136 kB' 'PageTables: 9136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15727752 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235384 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.125 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.125 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.126 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.126 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:14.126 04:01:28 -- setup/common.sh@33 -- # echo 0 00:04:14.126 04:01:28 -- setup/common.sh@33 -- # return 0 00:04:14.126 04:01:28 -- setup/hugepages.sh@100 -- # resv=0 00:04:14.126 04:01:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:14.127 nr_hugepages=1024 00:04:14.127 04:01:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:14.127 resv_hugepages=0 00:04:14.127 04:01:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:14.127 surplus_hugepages=0 00:04:14.127 04:01:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:14.127 anon_hugepages=0 00:04:14.127 04:01:28 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:14.127 04:01:28 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:14.127 04:01:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:14.127 04:01:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:14.127 04:01:28 -- setup/common.sh@18 -- # local node= 00:04:14.127 04:01:28 -- setup/common.sh@19 -- # local var val 00:04:14.127 04:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:14.127 04:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:14.127 04:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:14.127 04:01:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:14.127 04:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:14.127 04:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338812 kB' 'MemFree: 100816728 kB' 'MemAvailable: 105320384 kB' 'Buffers: 2696 kB' 'Cached: 18851572 kB' 'SwapCached: 0 kB' 'Active: 14955708 kB' 'Inactive: 4471840 kB' 'Active(anon): 14283380 kB' 'Inactive(anon): 0 kB' 'Active(file): 672328 kB' 'Inactive(file): 4471840 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 576580 kB' 'Mapped: 226984 kB' 'Shmem: 13710100 kB' 'KReclaimable: 367636 kB' 'Slab: 1251876 kB' 'SReclaimable: 367636 kB' 'SUnreclaim: 884240 kB' 'KernelStack: 27168 kB' 'PageTables: 9392 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509432 kB' 'Committed_AS: 15722704 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235416 kB' 'VmallocChunk: 0 kB' 'Percpu: 145152 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 5477748 kB' 'DirectMap2M: 38242304 kB' 'DirectMap1G: 92274688 kB' 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.127 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.127 04:01:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.128 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.128 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:14.399 04:01:28 -- setup/common.sh@33 -- # echo 1024 00:04:14.399 04:01:28 -- setup/common.sh@33 -- # return 0 00:04:14.399 04:01:28 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:14.399 04:01:28 -- setup/hugepages.sh@112 -- # get_nodes 00:04:14.399 04:01:28 -- setup/hugepages.sh@27 -- # local node 00:04:14.399 04:01:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:14.399 04:01:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:14.399 04:01:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:14.399 04:01:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:14.399 04:01:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:14.399 04:01:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:14.399 04:01:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:14.399 04:01:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:14.399 04:01:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:14.399 04:01:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:14.399 04:01:28 -- setup/common.sh@18 -- # local node=0 00:04:14.399 04:01:28 -- setup/common.sh@19 -- # local var val 00:04:14.399 04:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:14.399 04:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:14.399 04:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:14.399 04:01:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:14.399 04:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:14.399 04:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 58013436 kB' 'MemUsed: 7645572 kB' 'SwapCached: 0 kB' 'Active: 3344552 kB' 'Inactive: 185548 kB' 'Active(anon): 2807496 kB' 'Inactive(anon): 0 kB' 'Active(file): 537056 kB' 'Inactive(file): 185548 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3220580 kB' 'Mapped: 150156 kB' 'AnonPages: 312672 kB' 'Shmem: 2497976 kB' 'KernelStack: 14104 kB' 'PageTables: 4988 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 174140 kB' 'Slab: 664788 kB' 'SReclaimable: 174140 kB' 'SUnreclaim: 490648 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.399 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.399 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # continue 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.400 04:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.400 04:01:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:14.400 04:01:28 -- setup/common.sh@33 -- # echo 0 00:04:14.400 04:01:28 -- setup/common.sh@33 -- # return 0 00:04:14.400 04:01:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:14.400 04:01:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:14.400 04:01:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:14.400 04:01:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:14.400 04:01:28 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:14.400 node0=1024 expecting 1024 00:04:14.400 04:01:28 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:14.400 00:04:14.400 real 0m7.521s 00:04:14.400 user 0m2.886s 00:04:14.400 sys 0m4.745s 00:04:14.400 04:01:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:14.400 04:01:28 -- common/autotest_common.sh@10 -- # set +x 00:04:14.400 ************************************ 00:04:14.400 END TEST no_shrink_alloc 00:04:14.400 ************************************ 00:04:14.400 04:01:28 -- setup/hugepages.sh@217 -- # clear_hp 00:04:14.400 04:01:28 -- setup/hugepages.sh@37 -- # local node hp 00:04:14.400 04:01:28 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:14.400 04:01:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:14.400 04:01:28 -- setup/hugepages.sh@41 -- # echo 0 00:04:14.400 04:01:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:14.400 04:01:28 -- setup/hugepages.sh@41 -- # echo 0 00:04:14.400 04:01:28 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:14.400 04:01:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:14.400 04:01:28 -- setup/hugepages.sh@41 -- # echo 0 00:04:14.400 04:01:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:14.400 04:01:28 -- setup/hugepages.sh@41 -- # echo 0 00:04:14.400 04:01:28 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:14.400 04:01:28 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:14.400 00:04:14.400 real 0m27.294s 00:04:14.400 user 0m10.702s 00:04:14.400 sys 0m16.965s 00:04:14.400 04:01:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:14.400 04:01:28 -- common/autotest_common.sh@10 -- # set +x 00:04:14.400 ************************************ 00:04:14.400 END TEST hugepages 00:04:14.400 ************************************ 00:04:14.400 04:01:28 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:14.400 04:01:28 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:14.400 04:01:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:14.400 04:01:28 -- common/autotest_common.sh@10 -- # set +x 00:04:14.400 ************************************ 00:04:14.400 START TEST driver 00:04:14.400 ************************************ 00:04:14.400 04:01:28 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:14.400 * Looking for test storage... 00:04:14.400 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:14.400 04:01:28 -- setup/driver.sh@68 -- # setup reset 00:04:14.400 04:01:28 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:14.400 04:01:28 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:19.694 04:01:33 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:19.694 04:01:33 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:19.694 04:01:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:19.694 04:01:33 -- common/autotest_common.sh@10 -- # set +x 00:04:19.694 ************************************ 00:04:19.694 START TEST guess_driver 00:04:19.694 ************************************ 00:04:19.694 04:01:33 -- common/autotest_common.sh@1104 -- # guess_driver 00:04:19.694 04:01:33 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:19.694 04:01:33 -- setup/driver.sh@47 -- # local fail=0 00:04:19.694 04:01:33 -- setup/driver.sh@49 -- # pick_driver 00:04:19.694 04:01:33 -- setup/driver.sh@36 -- # vfio 00:04:19.694 04:01:33 -- setup/driver.sh@21 -- # local iommu_grups 00:04:19.694 04:01:33 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:19.694 04:01:33 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:19.694 04:01:33 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:19.694 04:01:33 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:19.694 04:01:33 -- setup/driver.sh@29 -- # (( 314 > 0 )) 00:04:19.694 04:01:33 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:19.694 04:01:33 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:19.694 04:01:33 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:19.694 04:01:33 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:19.694 04:01:33 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:19.694 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:19.694 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:19.694 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:19.694 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:19.694 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:19.694 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:19.694 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:19.694 04:01:33 -- setup/driver.sh@30 -- # return 0 00:04:19.694 04:01:33 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:19.694 04:01:33 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:19.694 04:01:33 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:19.694 04:01:33 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:19.694 Looking for driver=vfio-pci 00:04:19.694 04:01:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.694 04:01:33 -- setup/driver.sh@45 -- # setup output config 00:04:19.694 04:01:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:19.694 04:01:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:22.998 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.998 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.998 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.998 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.998 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.998 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.998 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.998 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.998 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.998 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.998 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.998 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.998 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.998 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.998 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.998 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.998 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.999 04:01:37 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.999 04:01:37 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.999 04:01:37 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:23.259 04:01:37 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:23.259 04:01:37 -- setup/driver.sh@65 -- # setup reset 00:04:23.259 04:01:37 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:23.259 04:01:37 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:28.551 00:04:28.551 real 0m8.861s 00:04:28.551 user 0m2.937s 00:04:28.551 sys 0m5.105s 00:04:28.551 04:01:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:28.551 04:01:42 -- common/autotest_common.sh@10 -- # set +x 00:04:28.551 ************************************ 00:04:28.551 END TEST guess_driver 00:04:28.551 ************************************ 00:04:28.551 00:04:28.551 real 0m13.904s 00:04:28.551 user 0m4.468s 00:04:28.551 sys 0m7.811s 00:04:28.551 04:01:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:28.551 04:01:42 -- common/autotest_common.sh@10 -- # set +x 00:04:28.551 ************************************ 00:04:28.551 END TEST driver 00:04:28.551 ************************************ 00:04:28.551 04:01:42 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:28.551 04:01:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:28.551 04:01:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:28.551 04:01:42 -- common/autotest_common.sh@10 -- # set +x 00:04:28.551 ************************************ 00:04:28.551 START TEST devices 00:04:28.551 ************************************ 00:04:28.551 04:01:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:28.551 * Looking for test storage... 00:04:28.551 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:28.551 04:01:42 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:28.551 04:01:42 -- setup/devices.sh@192 -- # setup reset 00:04:28.551 04:01:42 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:28.551 04:01:42 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:32.768 04:01:46 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:32.768 04:01:46 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:04:32.768 04:01:46 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:04:32.768 04:01:46 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:04:32.768 04:01:46 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:04:32.768 04:01:46 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:04:32.768 04:01:46 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:04:32.768 04:01:46 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:32.768 04:01:46 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:04:32.768 04:01:46 -- setup/devices.sh@196 -- # blocks=() 00:04:32.768 04:01:46 -- setup/devices.sh@196 -- # declare -a blocks 00:04:32.768 04:01:46 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:32.768 04:01:46 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:32.768 04:01:46 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:32.768 04:01:46 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:32.768 04:01:46 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:32.768 04:01:46 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:32.768 04:01:46 -- setup/devices.sh@202 -- # pci=0000:65:00.0 00:04:32.768 04:01:46 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\6\5\:\0\0\.\0* ]] 00:04:32.768 04:01:46 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:32.768 04:01:46 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:32.768 04:01:46 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:32.768 No valid GPT data, bailing 00:04:32.768 04:01:46 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:32.768 04:01:46 -- scripts/common.sh@393 -- # pt= 00:04:32.768 04:01:46 -- scripts/common.sh@394 -- # return 1 00:04:32.768 04:01:46 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:32.768 04:01:46 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:32.768 04:01:46 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:32.768 04:01:46 -- setup/common.sh@80 -- # echo 1920383410176 00:04:32.768 04:01:46 -- setup/devices.sh@204 -- # (( 1920383410176 >= min_disk_size )) 00:04:32.768 04:01:46 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:32.768 04:01:46 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:65:00.0 00:04:32.768 04:01:46 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:32.768 04:01:46 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:32.768 04:01:46 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:32.768 04:01:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:32.768 04:01:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:32.768 04:01:46 -- common/autotest_common.sh@10 -- # set +x 00:04:32.769 ************************************ 00:04:32.769 START TEST nvme_mount 00:04:32.769 ************************************ 00:04:32.769 04:01:46 -- common/autotest_common.sh@1104 -- # nvme_mount 00:04:32.769 04:01:46 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:32.769 04:01:46 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:32.769 04:01:46 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:32.769 04:01:46 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:32.769 04:01:46 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:32.769 04:01:46 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:32.769 04:01:46 -- setup/common.sh@40 -- # local part_no=1 00:04:32.769 04:01:46 -- setup/common.sh@41 -- # local size=1073741824 00:04:32.769 04:01:46 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:32.769 04:01:46 -- setup/common.sh@44 -- # parts=() 00:04:32.769 04:01:46 -- setup/common.sh@44 -- # local parts 00:04:32.769 04:01:46 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:32.769 04:01:46 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:32.769 04:01:46 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:32.769 04:01:46 -- setup/common.sh@46 -- # (( part++ )) 00:04:32.769 04:01:46 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:32.769 04:01:46 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:32.769 04:01:46 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:32.769 04:01:46 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:33.341 Creating new GPT entries in memory. 00:04:33.341 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:33.341 other utilities. 00:04:33.341 04:01:47 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:33.341 04:01:47 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:33.341 04:01:47 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:33.341 04:01:47 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:33.341 04:01:47 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:34.284 Creating new GPT entries in memory. 00:04:34.284 The operation has completed successfully. 00:04:34.284 04:01:48 -- setup/common.sh@57 -- # (( part++ )) 00:04:34.284 04:01:48 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:34.284 04:01:48 -- setup/common.sh@62 -- # wait 3708840 00:04:34.545 04:01:48 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:34.545 04:01:48 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:34.545 04:01:48 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:34.545 04:01:48 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:34.545 04:01:48 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:34.545 04:01:48 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:34.545 04:01:48 -- setup/devices.sh@105 -- # verify 0000:65:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:34.545 04:01:48 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:04:34.545 04:01:48 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:34.545 04:01:48 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:34.545 04:01:48 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:34.545 04:01:48 -- setup/devices.sh@53 -- # local found=0 00:04:34.545 04:01:48 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:34.545 04:01:48 -- setup/devices.sh@56 -- # : 00:04:34.545 04:01:48 -- setup/devices.sh@59 -- # local pci status 00:04:34.545 04:01:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:34.545 04:01:48 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:04:34.545 04:01:48 -- setup/devices.sh@47 -- # setup output config 00:04:34.545 04:01:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:34.545 04:01:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:37.852 04:01:52 -- setup/devices.sh@63 -- # found=1 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.852 04:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:37.852 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.114 04:01:52 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:38.114 04:01:52 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:38.114 04:01:52 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.114 04:01:52 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:38.114 04:01:52 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:38.114 04:01:52 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:38.114 04:01:52 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.114 04:01:52 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.114 04:01:52 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:38.114 04:01:52 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:38.114 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:38.114 04:01:52 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:38.114 04:01:52 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:38.376 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:38.376 /dev/nvme0n1: 8 bytes were erased at offset 0x1bf1fc55e00 (gpt): 45 46 49 20 50 41 52 54 00:04:38.376 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:38.376 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:38.376 04:01:52 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:38.376 04:01:52 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:38.376 04:01:52 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.376 04:01:52 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:38.376 04:01:52 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:38.376 04:01:52 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.376 04:01:52 -- setup/devices.sh@116 -- # verify 0000:65:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:38.376 04:01:52 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:04:38.376 04:01:52 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:38.376 04:01:52 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.376 04:01:52 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:38.376 04:01:52 -- setup/devices.sh@53 -- # local found=0 00:04:38.376 04:01:52 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:38.376 04:01:52 -- setup/devices.sh@56 -- # : 00:04:38.376 04:01:52 -- setup/devices.sh@59 -- # local pci status 00:04:38.376 04:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.376 04:01:52 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:04:38.376 04:01:52 -- setup/devices.sh@47 -- # setup output config 00:04:38.376 04:01:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:38.376 04:01:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:41.683 04:01:56 -- setup/devices.sh@63 -- # found=1 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.683 04:01:56 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:41.683 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.255 04:01:56 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:42.255 04:01:56 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:42.255 04:01:56 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.255 04:01:56 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:42.255 04:01:56 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:42.255 04:01:56 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:42.255 04:01:56 -- setup/devices.sh@125 -- # verify 0000:65:00.0 data@nvme0n1 '' '' 00:04:42.255 04:01:56 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:04:42.255 04:01:56 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:42.255 04:01:56 -- setup/devices.sh@50 -- # local mount_point= 00:04:42.255 04:01:56 -- setup/devices.sh@51 -- # local test_file= 00:04:42.255 04:01:56 -- setup/devices.sh@53 -- # local found=0 00:04:42.255 04:01:56 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:42.255 04:01:56 -- setup/devices.sh@59 -- # local pci status 00:04:42.255 04:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:42.255 04:01:56 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:04:42.255 04:01:56 -- setup/devices.sh@47 -- # setup output config 00:04:42.255 04:01:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:42.255 04:01:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:45.626 04:01:59 -- setup/devices.sh@63 -- # found=1 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:45.626 04:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.626 04:02:00 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:45.626 04:02:00 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:45.626 04:02:00 -- setup/devices.sh@68 -- # return 0 00:04:45.626 04:02:00 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:45.626 04:02:00 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:45.626 04:02:00 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:45.626 04:02:00 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:45.626 04:02:00 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:45.626 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:45.626 00:04:45.626 real 0m13.240s 00:04:45.626 user 0m4.047s 00:04:45.626 sys 0m7.005s 00:04:45.626 04:02:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:45.626 04:02:00 -- common/autotest_common.sh@10 -- # set +x 00:04:45.626 ************************************ 00:04:45.626 END TEST nvme_mount 00:04:45.626 ************************************ 00:04:45.626 04:02:00 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:45.626 04:02:00 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:45.626 04:02:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:45.626 04:02:00 -- common/autotest_common.sh@10 -- # set +x 00:04:45.626 ************************************ 00:04:45.626 START TEST dm_mount 00:04:45.626 ************************************ 00:04:45.626 04:02:00 -- common/autotest_common.sh@1104 -- # dm_mount 00:04:45.626 04:02:00 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:45.626 04:02:00 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:45.626 04:02:00 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:45.626 04:02:00 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:45.626 04:02:00 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:45.626 04:02:00 -- setup/common.sh@40 -- # local part_no=2 00:04:45.626 04:02:00 -- setup/common.sh@41 -- # local size=1073741824 00:04:45.626 04:02:00 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:45.626 04:02:00 -- setup/common.sh@44 -- # parts=() 00:04:45.626 04:02:00 -- setup/common.sh@44 -- # local parts 00:04:45.626 04:02:00 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:45.626 04:02:00 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:45.626 04:02:00 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:45.626 04:02:00 -- setup/common.sh@46 -- # (( part++ )) 00:04:45.626 04:02:00 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:45.626 04:02:00 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:45.626 04:02:00 -- setup/common.sh@46 -- # (( part++ )) 00:04:45.626 04:02:00 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:45.626 04:02:00 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:45.626 04:02:00 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:45.626 04:02:00 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:46.569 Creating new GPT entries in memory. 00:04:46.569 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:46.569 other utilities. 00:04:46.569 04:02:01 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:46.569 04:02:01 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:46.569 04:02:01 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:46.569 04:02:01 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:46.569 04:02:01 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:47.954 Creating new GPT entries in memory. 00:04:47.954 The operation has completed successfully. 00:04:47.954 04:02:02 -- setup/common.sh@57 -- # (( part++ )) 00:04:47.954 04:02:02 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:47.954 04:02:02 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:47.954 04:02:02 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:47.954 04:02:02 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:48.897 The operation has completed successfully. 00:04:48.897 04:02:03 -- setup/common.sh@57 -- # (( part++ )) 00:04:48.897 04:02:03 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:48.897 04:02:03 -- setup/common.sh@62 -- # wait 3714105 00:04:48.897 04:02:03 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:48.897 04:02:03 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:48.897 04:02:03 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:48.897 04:02:03 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:48.897 04:02:03 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:48.897 04:02:03 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:48.897 04:02:03 -- setup/devices.sh@161 -- # break 00:04:48.897 04:02:03 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:48.897 04:02:03 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:48.897 04:02:03 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:48.897 04:02:03 -- setup/devices.sh@166 -- # dm=dm-0 00:04:48.897 04:02:03 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:48.897 04:02:03 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:48.897 04:02:03 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:48.897 04:02:03 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:04:48.897 04:02:03 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:48.897 04:02:03 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:48.897 04:02:03 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:48.897 04:02:03 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:48.897 04:02:03 -- setup/devices.sh@174 -- # verify 0000:65:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:48.897 04:02:03 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:04:48.897 04:02:03 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:48.897 04:02:03 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:48.897 04:02:03 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:48.897 04:02:03 -- setup/devices.sh@53 -- # local found=0 00:04:48.897 04:02:03 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:48.897 04:02:03 -- setup/devices.sh@56 -- # : 00:04:48.897 04:02:03 -- setup/devices.sh@59 -- # local pci status 00:04:48.897 04:02:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.897 04:02:03 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:04:48.897 04:02:03 -- setup/devices.sh@47 -- # setup output config 00:04:48.897 04:02:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.897 04:02:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:52.207 04:02:06 -- setup/devices.sh@63 -- # found=1 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.207 04:02:06 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:52.207 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.477 04:02:06 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:52.477 04:02:06 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:52.477 04:02:06 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:52.477 04:02:06 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:52.477 04:02:06 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:52.477 04:02:06 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:52.477 04:02:06 -- setup/devices.sh@184 -- # verify 0000:65:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:52.477 04:02:06 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:04:52.477 04:02:06 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:52.477 04:02:06 -- setup/devices.sh@50 -- # local mount_point= 00:04:52.477 04:02:06 -- setup/devices.sh@51 -- # local test_file= 00:04:52.477 04:02:06 -- setup/devices.sh@53 -- # local found=0 00:04:52.477 04:02:06 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:52.477 04:02:06 -- setup/devices.sh@59 -- # local pci status 00:04:52.477 04:02:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.477 04:02:06 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:04:52.477 04:02:06 -- setup/devices.sh@47 -- # setup output config 00:04:52.477 04:02:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:52.477 04:02:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:55.795 04:02:10 -- setup/devices.sh@63 -- # found=1 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.795 04:02:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:55.795 04:02:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.057 04:02:10 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:56.057 04:02:10 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:56.057 04:02:10 -- setup/devices.sh@68 -- # return 0 00:04:56.057 04:02:10 -- setup/devices.sh@187 -- # cleanup_dm 00:04:56.057 04:02:10 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:56.057 04:02:10 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:56.057 04:02:10 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:56.319 04:02:10 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:56.319 04:02:10 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:56.319 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:56.319 04:02:10 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:56.319 04:02:10 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:56.319 00:04:56.319 real 0m10.564s 00:04:56.319 user 0m2.809s 00:04:56.319 sys 0m4.816s 00:04:56.319 04:02:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:56.319 04:02:10 -- common/autotest_common.sh@10 -- # set +x 00:04:56.319 ************************************ 00:04:56.319 END TEST dm_mount 00:04:56.319 ************************************ 00:04:56.319 04:02:10 -- setup/devices.sh@1 -- # cleanup 00:04:56.319 04:02:10 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:56.319 04:02:10 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:56.319 04:02:10 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:56.319 04:02:10 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:56.319 04:02:10 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:56.319 04:02:10 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:56.580 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:56.580 /dev/nvme0n1: 8 bytes were erased at offset 0x1bf1fc55e00 (gpt): 45 46 49 20 50 41 52 54 00:04:56.580 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:56.580 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:56.580 04:02:10 -- setup/devices.sh@12 -- # cleanup_dm 00:04:56.580 04:02:10 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:56.580 04:02:11 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:56.580 04:02:11 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:56.580 04:02:11 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:56.580 04:02:11 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:56.580 04:02:11 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:56.581 00:04:56.581 real 0m28.226s 00:04:56.581 user 0m8.439s 00:04:56.581 sys 0m14.528s 00:04:56.581 04:02:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:56.581 04:02:11 -- common/autotest_common.sh@10 -- # set +x 00:04:56.581 ************************************ 00:04:56.581 END TEST devices 00:04:56.581 ************************************ 00:04:56.581 00:04:56.581 real 1m35.291s 00:04:56.581 user 0m32.271s 00:04:56.581 sys 0m54.236s 00:04:56.581 04:02:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:56.581 04:02:11 -- common/autotest_common.sh@10 -- # set +x 00:04:56.581 ************************************ 00:04:56.581 END TEST setup.sh 00:04:56.581 ************************************ 00:04:56.581 04:02:11 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:59.888 Hugepages 00:04:59.888 node hugesize free / total 00:04:59.888 node0 1048576kB 0 / 0 00:04:59.888 node0 2048kB 2048 / 2048 00:04:59.888 node1 1048576kB 0 / 0 00:04:59.888 node1 2048kB 0 / 0 00:04:59.888 00:04:59.888 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:59.889 I/OAT 0000:00:01.0 8086 0b00 0 ioatdma - - 00:04:59.889 I/OAT 0000:00:01.1 8086 0b00 0 ioatdma - - 00:04:59.889 I/OAT 0000:00:01.2 8086 0b00 0 ioatdma - - 00:04:59.889 I/OAT 0000:00:01.3 8086 0b00 0 ioatdma - - 00:04:59.889 I/OAT 0000:00:01.4 8086 0b00 0 ioatdma - - 00:04:59.889 I/OAT 0000:00:01.5 8086 0b00 0 ioatdma - - 00:04:59.889 I/OAT 0000:00:01.6 8086 0b00 0 ioatdma - - 00:04:59.889 I/OAT 0000:00:01.7 8086 0b00 0 ioatdma - - 00:05:00.149 NVMe 0000:65:00.0 144d a80a 0 nvme nvme0 nvme0n1 00:05:00.149 I/OAT 0000:80:01.0 8086 0b00 1 ioatdma - - 00:05:00.149 I/OAT 0000:80:01.1 8086 0b00 1 ioatdma - - 00:05:00.149 I/OAT 0000:80:01.2 8086 0b00 1 ioatdma - - 00:05:00.149 I/OAT 0000:80:01.3 8086 0b00 1 ioatdma - - 00:05:00.149 I/OAT 0000:80:01.4 8086 0b00 1 ioatdma - - 00:05:00.149 I/OAT 0000:80:01.5 8086 0b00 1 ioatdma - - 00:05:00.149 I/OAT 0000:80:01.6 8086 0b00 1 ioatdma - - 00:05:00.149 I/OAT 0000:80:01.7 8086 0b00 1 ioatdma - - 00:05:00.149 04:02:14 -- spdk/autotest.sh@141 -- # uname -s 00:05:00.149 04:02:14 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:05:00.149 04:02:14 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:05:00.149 04:02:14 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:03.450 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:05:03.450 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:05:03.710 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:05:05.623 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:05:05.623 04:02:20 -- common/autotest_common.sh@1517 -- # sleep 1 00:05:06.564 04:02:21 -- common/autotest_common.sh@1518 -- # bdfs=() 00:05:06.564 04:02:21 -- common/autotest_common.sh@1518 -- # local bdfs 00:05:06.564 04:02:21 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:05:06.564 04:02:21 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:05:06.564 04:02:21 -- common/autotest_common.sh@1498 -- # bdfs=() 00:05:06.564 04:02:21 -- common/autotest_common.sh@1498 -- # local bdfs 00:05:06.564 04:02:21 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:06.564 04:02:21 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:05:06.564 04:02:21 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:06.825 04:02:21 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:05:06.825 04:02:21 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:65:00.0 00:05:06.825 04:02:21 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:10.196 Waiting for block devices as requested 00:05:10.196 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:05:10.196 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:05:10.196 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:05:10.196 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:05:10.457 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:05:10.457 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:05:10.457 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:05:10.719 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:05:10.719 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:05:10.980 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:05:10.980 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:05:10.980 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:05:10.980 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:05:11.241 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:05:11.241 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:05:11.241 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:05:11.503 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:05:11.763 04:02:26 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:05:11.763 04:02:26 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:65:00.0 00:05:11.763 04:02:26 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:05:11.763 04:02:26 -- common/autotest_common.sh@1487 -- # grep 0000:65:00.0/nvme/nvme 00:05:11.763 04:02:26 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:64/0000:64:02.0/0000:65:00.0/nvme/nvme0 00:05:11.763 04:02:26 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:64/0000:64:02.0/0000:65:00.0/nvme/nvme0 ]] 00:05:11.763 04:02:26 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:64/0000:64:02.0/0000:65:00.0/nvme/nvme0 00:05:11.763 04:02:26 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:05:11.763 04:02:26 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:05:11.763 04:02:26 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:05:11.763 04:02:26 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:05:11.763 04:02:26 -- common/autotest_common.sh@1530 -- # grep oacs 00:05:11.763 04:02:26 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:05:11.763 04:02:26 -- common/autotest_common.sh@1530 -- # oacs=' 0x5f' 00:05:11.763 04:02:26 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:05:11.764 04:02:26 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:05:11.764 04:02:26 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:05:11.764 04:02:26 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:05:11.764 04:02:26 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:05:11.764 04:02:26 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:05:11.764 04:02:26 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:05:11.764 04:02:26 -- common/autotest_common.sh@1542 -- # continue 00:05:11.764 04:02:26 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:05:11.764 04:02:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:11.764 04:02:26 -- common/autotest_common.sh@10 -- # set +x 00:05:11.764 04:02:26 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:05:11.764 04:02:26 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:11.764 04:02:26 -- common/autotest_common.sh@10 -- # set +x 00:05:11.764 04:02:26 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:15.070 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:05:15.070 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:05:15.070 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:05:15.070 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:05:15.070 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:05:15.070 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:05:15.070 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:05:15.070 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:05:15.331 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:05:15.331 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:05:15.331 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:05:15.331 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:05:15.331 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:05:15.331 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:05:15.331 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:05:15.331 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:05:15.331 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:05:15.592 04:02:30 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:05:15.592 04:02:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:15.592 04:02:30 -- common/autotest_common.sh@10 -- # set +x 00:05:15.592 04:02:30 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:05:15.592 04:02:30 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:05:15.592 04:02:30 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:05:15.592 04:02:30 -- common/autotest_common.sh@1562 -- # bdfs=() 00:05:15.592 04:02:30 -- common/autotest_common.sh@1562 -- # local bdfs 00:05:15.592 04:02:30 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:05:15.592 04:02:30 -- common/autotest_common.sh@1498 -- # bdfs=() 00:05:15.592 04:02:30 -- common/autotest_common.sh@1498 -- # local bdfs 00:05:15.592 04:02:30 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:15.592 04:02:30 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:15.592 04:02:30 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:05:15.854 04:02:30 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:05:15.854 04:02:30 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:65:00.0 00:05:15.854 04:02:30 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:05:15.855 04:02:30 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:65:00.0/device 00:05:15.855 04:02:30 -- common/autotest_common.sh@1565 -- # device=0xa80a 00:05:15.855 04:02:30 -- common/autotest_common.sh@1566 -- # [[ 0xa80a == \0\x\0\a\5\4 ]] 00:05:15.855 04:02:30 -- common/autotest_common.sh@1571 -- # printf '%s\n' 00:05:15.855 04:02:30 -- common/autotest_common.sh@1577 -- # [[ -z '' ]] 00:05:15.855 04:02:30 -- common/autotest_common.sh@1578 -- # return 0 00:05:15.855 04:02:30 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:05:15.855 04:02:30 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:05:15.855 04:02:30 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:05:15.855 04:02:30 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:05:15.855 04:02:30 -- spdk/autotest.sh@173 -- # timing_enter lib 00:05:15.855 04:02:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:15.855 04:02:30 -- common/autotest_common.sh@10 -- # set +x 00:05:15.855 04:02:30 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:15.855 04:02:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:15.855 04:02:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:15.855 04:02:30 -- common/autotest_common.sh@10 -- # set +x 00:05:15.855 ************************************ 00:05:15.855 START TEST env 00:05:15.855 ************************************ 00:05:15.855 04:02:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:15.855 * Looking for test storage... 00:05:15.855 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:15.855 04:02:30 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:15.855 04:02:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:15.855 04:02:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:15.855 04:02:30 -- common/autotest_common.sh@10 -- # set +x 00:05:15.855 ************************************ 00:05:15.855 START TEST env_memory 00:05:15.855 ************************************ 00:05:15.855 04:02:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:15.855 00:05:15.855 00:05:15.855 CUnit - A unit testing framework for C - Version 2.1-3 00:05:15.855 http://cunit.sourceforge.net/ 00:05:15.855 00:05:15.855 00:05:15.855 Suite: memory 00:05:15.855 Test: alloc and free memory map ...[2024-05-14 04:02:30.400748] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:15.855 passed 00:05:15.855 Test: mem map translation ...[2024-05-14 04:02:30.427221] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:15.855 [2024-05-14 04:02:30.427255] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:15.855 [2024-05-14 04:02:30.427308] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:15.855 [2024-05-14 04:02:30.427317] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:16.118 passed 00:05:16.118 Test: mem map registration ...[2024-05-14 04:02:30.483489] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:16.118 [2024-05-14 04:02:30.483516] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:16.118 passed 00:05:16.118 Test: mem map adjacent registrations ...passed 00:05:16.118 00:05:16.118 Run Summary: Type Total Ran Passed Failed Inactive 00:05:16.118 suites 1 1 n/a 0 0 00:05:16.118 tests 4 4 4 0 0 00:05:16.118 asserts 152 152 152 0 n/a 00:05:16.118 00:05:16.118 Elapsed time = 0.198 seconds 00:05:16.118 00:05:16.118 real 0m0.212s 00:05:16.118 user 0m0.197s 00:05:16.118 sys 0m0.014s 00:05:16.118 04:02:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:16.118 04:02:30 -- common/autotest_common.sh@10 -- # set +x 00:05:16.118 ************************************ 00:05:16.118 END TEST env_memory 00:05:16.118 ************************************ 00:05:16.118 04:02:30 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:16.118 04:02:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:16.118 04:02:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:16.118 04:02:30 -- common/autotest_common.sh@10 -- # set +x 00:05:16.118 ************************************ 00:05:16.118 START TEST env_vtophys 00:05:16.118 ************************************ 00:05:16.118 04:02:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:16.118 EAL: lib.eal log level changed from notice to debug 00:05:16.118 EAL: Detected lcore 0 as core 0 on socket 0 00:05:16.118 EAL: Detected lcore 1 as core 1 on socket 0 00:05:16.118 EAL: Detected lcore 2 as core 2 on socket 0 00:05:16.118 EAL: Detected lcore 3 as core 3 on socket 0 00:05:16.118 EAL: Detected lcore 4 as core 4 on socket 0 00:05:16.118 EAL: Detected lcore 5 as core 5 on socket 0 00:05:16.118 EAL: Detected lcore 6 as core 6 on socket 0 00:05:16.118 EAL: Detected lcore 7 as core 7 on socket 0 00:05:16.118 EAL: Detected lcore 8 as core 8 on socket 0 00:05:16.118 EAL: Detected lcore 9 as core 9 on socket 0 00:05:16.118 EAL: Detected lcore 10 as core 10 on socket 0 00:05:16.118 EAL: Detected lcore 11 as core 11 on socket 0 00:05:16.118 EAL: Detected lcore 12 as core 12 on socket 0 00:05:16.118 EAL: Detected lcore 13 as core 13 on socket 0 00:05:16.118 EAL: Detected lcore 14 as core 14 on socket 0 00:05:16.118 EAL: Detected lcore 15 as core 15 on socket 0 00:05:16.118 EAL: Detected lcore 16 as core 16 on socket 0 00:05:16.118 EAL: Detected lcore 17 as core 17 on socket 0 00:05:16.118 EAL: Detected lcore 18 as core 18 on socket 0 00:05:16.118 EAL: Detected lcore 19 as core 19 on socket 0 00:05:16.118 EAL: Detected lcore 20 as core 20 on socket 0 00:05:16.118 EAL: Detected lcore 21 as core 21 on socket 0 00:05:16.118 EAL: Detected lcore 22 as core 22 on socket 0 00:05:16.118 EAL: Detected lcore 23 as core 23 on socket 0 00:05:16.118 EAL: Detected lcore 24 as core 24 on socket 0 00:05:16.118 EAL: Detected lcore 25 as core 25 on socket 0 00:05:16.118 EAL: Detected lcore 26 as core 26 on socket 0 00:05:16.118 EAL: Detected lcore 27 as core 27 on socket 0 00:05:16.118 EAL: Detected lcore 28 as core 28 on socket 0 00:05:16.118 EAL: Detected lcore 29 as core 29 on socket 0 00:05:16.118 EAL: Detected lcore 30 as core 30 on socket 0 00:05:16.118 EAL: Detected lcore 31 as core 31 on socket 0 00:05:16.118 EAL: Detected lcore 32 as core 32 on socket 0 00:05:16.118 EAL: Detected lcore 33 as core 33 on socket 0 00:05:16.118 EAL: Detected lcore 34 as core 34 on socket 0 00:05:16.118 EAL: Detected lcore 35 as core 35 on socket 0 00:05:16.118 EAL: Detected lcore 36 as core 0 on socket 1 00:05:16.118 EAL: Detected lcore 37 as core 1 on socket 1 00:05:16.118 EAL: Detected lcore 38 as core 2 on socket 1 00:05:16.118 EAL: Detected lcore 39 as core 3 on socket 1 00:05:16.118 EAL: Detected lcore 40 as core 4 on socket 1 00:05:16.118 EAL: Detected lcore 41 as core 5 on socket 1 00:05:16.118 EAL: Detected lcore 42 as core 6 on socket 1 00:05:16.118 EAL: Detected lcore 43 as core 7 on socket 1 00:05:16.118 EAL: Detected lcore 44 as core 8 on socket 1 00:05:16.118 EAL: Detected lcore 45 as core 9 on socket 1 00:05:16.118 EAL: Detected lcore 46 as core 10 on socket 1 00:05:16.118 EAL: Detected lcore 47 as core 11 on socket 1 00:05:16.118 EAL: Detected lcore 48 as core 12 on socket 1 00:05:16.118 EAL: Detected lcore 49 as core 13 on socket 1 00:05:16.118 EAL: Detected lcore 50 as core 14 on socket 1 00:05:16.118 EAL: Detected lcore 51 as core 15 on socket 1 00:05:16.118 EAL: Detected lcore 52 as core 16 on socket 1 00:05:16.118 EAL: Detected lcore 53 as core 17 on socket 1 00:05:16.118 EAL: Detected lcore 54 as core 18 on socket 1 00:05:16.118 EAL: Detected lcore 55 as core 19 on socket 1 00:05:16.118 EAL: Detected lcore 56 as core 20 on socket 1 00:05:16.118 EAL: Detected lcore 57 as core 21 on socket 1 00:05:16.118 EAL: Detected lcore 58 as core 22 on socket 1 00:05:16.118 EAL: Detected lcore 59 as core 23 on socket 1 00:05:16.118 EAL: Detected lcore 60 as core 24 on socket 1 00:05:16.118 EAL: Detected lcore 61 as core 25 on socket 1 00:05:16.118 EAL: Detected lcore 62 as core 26 on socket 1 00:05:16.118 EAL: Detected lcore 63 as core 27 on socket 1 00:05:16.118 EAL: Detected lcore 64 as core 28 on socket 1 00:05:16.118 EAL: Detected lcore 65 as core 29 on socket 1 00:05:16.118 EAL: Detected lcore 66 as core 30 on socket 1 00:05:16.118 EAL: Detected lcore 67 as core 31 on socket 1 00:05:16.118 EAL: Detected lcore 68 as core 32 on socket 1 00:05:16.118 EAL: Detected lcore 69 as core 33 on socket 1 00:05:16.118 EAL: Detected lcore 70 as core 34 on socket 1 00:05:16.118 EAL: Detected lcore 71 as core 35 on socket 1 00:05:16.118 EAL: Detected lcore 72 as core 0 on socket 0 00:05:16.118 EAL: Detected lcore 73 as core 1 on socket 0 00:05:16.118 EAL: Detected lcore 74 as core 2 on socket 0 00:05:16.118 EAL: Detected lcore 75 as core 3 on socket 0 00:05:16.118 EAL: Detected lcore 76 as core 4 on socket 0 00:05:16.118 EAL: Detected lcore 77 as core 5 on socket 0 00:05:16.118 EAL: Detected lcore 78 as core 6 on socket 0 00:05:16.118 EAL: Detected lcore 79 as core 7 on socket 0 00:05:16.118 EAL: Detected lcore 80 as core 8 on socket 0 00:05:16.118 EAL: Detected lcore 81 as core 9 on socket 0 00:05:16.118 EAL: Detected lcore 82 as core 10 on socket 0 00:05:16.118 EAL: Detected lcore 83 as core 11 on socket 0 00:05:16.118 EAL: Detected lcore 84 as core 12 on socket 0 00:05:16.118 EAL: Detected lcore 85 as core 13 on socket 0 00:05:16.118 EAL: Detected lcore 86 as core 14 on socket 0 00:05:16.118 EAL: Detected lcore 87 as core 15 on socket 0 00:05:16.118 EAL: Detected lcore 88 as core 16 on socket 0 00:05:16.118 EAL: Detected lcore 89 as core 17 on socket 0 00:05:16.118 EAL: Detected lcore 90 as core 18 on socket 0 00:05:16.118 EAL: Detected lcore 91 as core 19 on socket 0 00:05:16.118 EAL: Detected lcore 92 as core 20 on socket 0 00:05:16.118 EAL: Detected lcore 93 as core 21 on socket 0 00:05:16.118 EAL: Detected lcore 94 as core 22 on socket 0 00:05:16.118 EAL: Detected lcore 95 as core 23 on socket 0 00:05:16.118 EAL: Detected lcore 96 as core 24 on socket 0 00:05:16.118 EAL: Detected lcore 97 as core 25 on socket 0 00:05:16.118 EAL: Detected lcore 98 as core 26 on socket 0 00:05:16.118 EAL: Detected lcore 99 as core 27 on socket 0 00:05:16.119 EAL: Detected lcore 100 as core 28 on socket 0 00:05:16.119 EAL: Detected lcore 101 as core 29 on socket 0 00:05:16.119 EAL: Detected lcore 102 as core 30 on socket 0 00:05:16.119 EAL: Detected lcore 103 as core 31 on socket 0 00:05:16.119 EAL: Detected lcore 104 as core 32 on socket 0 00:05:16.119 EAL: Detected lcore 105 as core 33 on socket 0 00:05:16.119 EAL: Detected lcore 106 as core 34 on socket 0 00:05:16.119 EAL: Detected lcore 107 as core 35 on socket 0 00:05:16.119 EAL: Detected lcore 108 as core 0 on socket 1 00:05:16.119 EAL: Detected lcore 109 as core 1 on socket 1 00:05:16.119 EAL: Detected lcore 110 as core 2 on socket 1 00:05:16.119 EAL: Detected lcore 111 as core 3 on socket 1 00:05:16.119 EAL: Detected lcore 112 as core 4 on socket 1 00:05:16.119 EAL: Detected lcore 113 as core 5 on socket 1 00:05:16.119 EAL: Detected lcore 114 as core 6 on socket 1 00:05:16.119 EAL: Detected lcore 115 as core 7 on socket 1 00:05:16.119 EAL: Detected lcore 116 as core 8 on socket 1 00:05:16.119 EAL: Detected lcore 117 as core 9 on socket 1 00:05:16.119 EAL: Detected lcore 118 as core 10 on socket 1 00:05:16.119 EAL: Detected lcore 119 as core 11 on socket 1 00:05:16.119 EAL: Detected lcore 120 as core 12 on socket 1 00:05:16.119 EAL: Detected lcore 121 as core 13 on socket 1 00:05:16.119 EAL: Detected lcore 122 as core 14 on socket 1 00:05:16.119 EAL: Detected lcore 123 as core 15 on socket 1 00:05:16.119 EAL: Detected lcore 124 as core 16 on socket 1 00:05:16.119 EAL: Detected lcore 125 as core 17 on socket 1 00:05:16.119 EAL: Detected lcore 126 as core 18 on socket 1 00:05:16.119 EAL: Detected lcore 127 as core 19 on socket 1 00:05:16.119 EAL: Skipped lcore 128 as core 20 on socket 1 00:05:16.119 EAL: Skipped lcore 129 as core 21 on socket 1 00:05:16.119 EAL: Skipped lcore 130 as core 22 on socket 1 00:05:16.119 EAL: Skipped lcore 131 as core 23 on socket 1 00:05:16.119 EAL: Skipped lcore 132 as core 24 on socket 1 00:05:16.119 EAL: Skipped lcore 133 as core 25 on socket 1 00:05:16.119 EAL: Skipped lcore 134 as core 26 on socket 1 00:05:16.119 EAL: Skipped lcore 135 as core 27 on socket 1 00:05:16.119 EAL: Skipped lcore 136 as core 28 on socket 1 00:05:16.119 EAL: Skipped lcore 137 as core 29 on socket 1 00:05:16.119 EAL: Skipped lcore 138 as core 30 on socket 1 00:05:16.119 EAL: Skipped lcore 139 as core 31 on socket 1 00:05:16.119 EAL: Skipped lcore 140 as core 32 on socket 1 00:05:16.119 EAL: Skipped lcore 141 as core 33 on socket 1 00:05:16.119 EAL: Skipped lcore 142 as core 34 on socket 1 00:05:16.119 EAL: Skipped lcore 143 as core 35 on socket 1 00:05:16.119 EAL: Maximum logical cores by configuration: 128 00:05:16.119 EAL: Detected CPU lcores: 128 00:05:16.119 EAL: Detected NUMA nodes: 2 00:05:16.119 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:16.119 EAL: Detected shared linkage of DPDK 00:05:16.119 EAL: No shared files mode enabled, IPC will be disabled 00:05:16.119 EAL: Bus pci wants IOVA as 'DC' 00:05:16.119 EAL: Buses did not request a specific IOVA mode. 00:05:16.119 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:16.119 EAL: Selected IOVA mode 'VA' 00:05:16.119 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.119 EAL: Probing VFIO support... 00:05:16.119 EAL: IOMMU type 1 (Type 1) is supported 00:05:16.119 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:16.119 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:16.119 EAL: VFIO support initialized 00:05:16.119 EAL: Ask a virtual area of 0x2e000 bytes 00:05:16.119 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:16.119 EAL: Setting up physically contiguous memory... 00:05:16.119 EAL: Setting maximum number of open files to 524288 00:05:16.119 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:16.119 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:16.119 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:16.119 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.119 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:16.119 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:16.119 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.119 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:16.119 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:16.119 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.119 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:16.119 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:16.119 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.119 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:16.119 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:16.119 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.119 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:16.119 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:16.119 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.119 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:16.119 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:16.119 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.119 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:16.119 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:16.119 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.119 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:16.119 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:16.119 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:16.119 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.119 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:16.119 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:16.119 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.119 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:16.119 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:16.119 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.119 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:16.119 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:16.119 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.119 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:16.119 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:16.119 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.119 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:16.119 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:16.119 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.119 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:16.119 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:16.119 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.119 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:16.119 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:16.119 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.119 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:16.119 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:16.119 EAL: Hugepages will be freed exactly as allocated. 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: TSC frequency is ~2400000 KHz 00:05:16.119 EAL: Main lcore 0 is ready (tid=7fe9cdbe5a00;cpuset=[0]) 00:05:16.119 EAL: Trying to obtain current memory policy. 00:05:16.119 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.119 EAL: Restoring previous memory policy: 0 00:05:16.119 EAL: request: mp_malloc_sync 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: Heap on socket 0 was expanded by 2MB 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:16.119 EAL: Mem event callback 'spdk:(nil)' registered 00:05:16.119 00:05:16.119 00:05:16.119 CUnit - A unit testing framework for C - Version 2.1-3 00:05:16.119 http://cunit.sourceforge.net/ 00:05:16.119 00:05:16.119 00:05:16.119 Suite: components_suite 00:05:16.119 Test: vtophys_malloc_test ...passed 00:05:16.119 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:16.119 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.119 EAL: Restoring previous memory policy: 4 00:05:16.119 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.119 EAL: request: mp_malloc_sync 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: Heap on socket 0 was expanded by 4MB 00:05:16.119 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.119 EAL: request: mp_malloc_sync 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: Heap on socket 0 was shrunk by 4MB 00:05:16.119 EAL: Trying to obtain current memory policy. 00:05:16.119 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.119 EAL: Restoring previous memory policy: 4 00:05:16.119 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.119 EAL: request: mp_malloc_sync 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: Heap on socket 0 was expanded by 6MB 00:05:16.119 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.119 EAL: request: mp_malloc_sync 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: Heap on socket 0 was shrunk by 6MB 00:05:16.119 EAL: Trying to obtain current memory policy. 00:05:16.119 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.119 EAL: Restoring previous memory policy: 4 00:05:16.119 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.119 EAL: request: mp_malloc_sync 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: Heap on socket 0 was expanded by 10MB 00:05:16.119 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.119 EAL: request: mp_malloc_sync 00:05:16.119 EAL: No shared files mode enabled, IPC is disabled 00:05:16.119 EAL: Heap on socket 0 was shrunk by 10MB 00:05:16.119 EAL: Trying to obtain current memory policy. 00:05:16.119 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.380 EAL: Restoring previous memory policy: 4 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was expanded by 18MB 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was shrunk by 18MB 00:05:16.380 EAL: Trying to obtain current memory policy. 00:05:16.380 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.380 EAL: Restoring previous memory policy: 4 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was expanded by 34MB 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was shrunk by 34MB 00:05:16.380 EAL: Trying to obtain current memory policy. 00:05:16.380 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.380 EAL: Restoring previous memory policy: 4 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was expanded by 66MB 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was shrunk by 66MB 00:05:16.380 EAL: Trying to obtain current memory policy. 00:05:16.380 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.380 EAL: Restoring previous memory policy: 4 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was expanded by 130MB 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was shrunk by 130MB 00:05:16.380 EAL: Trying to obtain current memory policy. 00:05:16.380 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.380 EAL: Restoring previous memory policy: 4 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was expanded by 258MB 00:05:16.380 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.380 EAL: request: mp_malloc_sync 00:05:16.380 EAL: No shared files mode enabled, IPC is disabled 00:05:16.380 EAL: Heap on socket 0 was shrunk by 258MB 00:05:16.380 EAL: Trying to obtain current memory policy. 00:05:16.381 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.381 EAL: Restoring previous memory policy: 4 00:05:16.381 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.381 EAL: request: mp_malloc_sync 00:05:16.381 EAL: No shared files mode enabled, IPC is disabled 00:05:16.381 EAL: Heap on socket 0 was expanded by 514MB 00:05:16.641 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.641 EAL: request: mp_malloc_sync 00:05:16.641 EAL: No shared files mode enabled, IPC is disabled 00:05:16.641 EAL: Heap on socket 0 was shrunk by 514MB 00:05:16.641 EAL: Trying to obtain current memory policy. 00:05:16.641 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.641 EAL: Restoring previous memory policy: 4 00:05:16.641 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.641 EAL: request: mp_malloc_sync 00:05:16.641 EAL: No shared files mode enabled, IPC is disabled 00:05:16.641 EAL: Heap on socket 0 was expanded by 1026MB 00:05:16.902 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.902 EAL: request: mp_malloc_sync 00:05:16.902 EAL: No shared files mode enabled, IPC is disabled 00:05:16.902 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:16.902 passed 00:05:16.902 00:05:16.902 Run Summary: Type Total Ran Passed Failed Inactive 00:05:16.902 suites 1 1 n/a 0 0 00:05:16.902 tests 2 2 2 0 0 00:05:16.902 asserts 497 497 497 0 n/a 00:05:16.902 00:05:16.902 Elapsed time = 0.658 seconds 00:05:16.902 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.902 EAL: request: mp_malloc_sync 00:05:16.902 EAL: No shared files mode enabled, IPC is disabled 00:05:16.902 EAL: Heap on socket 0 was shrunk by 2MB 00:05:16.902 EAL: No shared files mode enabled, IPC is disabled 00:05:16.902 EAL: No shared files mode enabled, IPC is disabled 00:05:16.902 EAL: No shared files mode enabled, IPC is disabled 00:05:16.902 00:05:16.902 real 0m0.778s 00:05:16.902 user 0m0.401s 00:05:16.902 sys 0m0.352s 00:05:16.902 04:02:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:16.902 04:02:31 -- common/autotest_common.sh@10 -- # set +x 00:05:16.902 ************************************ 00:05:16.902 END TEST env_vtophys 00:05:16.902 ************************************ 00:05:16.902 04:02:31 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:16.902 04:02:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:16.902 04:02:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:16.902 04:02:31 -- common/autotest_common.sh@10 -- # set +x 00:05:16.902 ************************************ 00:05:16.902 START TEST env_pci 00:05:16.902 ************************************ 00:05:16.902 04:02:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:16.902 00:05:16.902 00:05:16.902 CUnit - A unit testing framework for C - Version 2.1-3 00:05:16.902 http://cunit.sourceforge.net/ 00:05:16.902 00:05:16.902 00:05:16.902 Suite: pci 00:05:16.902 Test: pci_hook ...[2024-05-14 04:02:31.445652] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3725289 has claimed it 00:05:16.902 EAL: Cannot find device (10000:00:01.0) 00:05:16.902 EAL: Failed to attach device on primary process 00:05:16.902 passed 00:05:16.902 00:05:16.902 Run Summary: Type Total Ran Passed Failed Inactive 00:05:16.902 suites 1 1 n/a 0 0 00:05:16.902 tests 1 1 1 0 0 00:05:16.902 asserts 25 25 25 0 n/a 00:05:16.902 00:05:16.902 Elapsed time = 0.028 seconds 00:05:16.902 00:05:16.902 real 0m0.049s 00:05:16.902 user 0m0.013s 00:05:16.902 sys 0m0.035s 00:05:16.902 04:02:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:16.902 04:02:31 -- common/autotest_common.sh@10 -- # set +x 00:05:16.902 ************************************ 00:05:16.902 END TEST env_pci 00:05:16.902 ************************************ 00:05:17.164 04:02:31 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:17.164 04:02:31 -- env/env.sh@15 -- # uname 00:05:17.164 04:02:31 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:17.164 04:02:31 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:17.164 04:02:31 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:17.164 04:02:31 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:05:17.164 04:02:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:17.164 04:02:31 -- common/autotest_common.sh@10 -- # set +x 00:05:17.164 ************************************ 00:05:17.164 START TEST env_dpdk_post_init 00:05:17.164 ************************************ 00:05:17.164 04:02:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:17.164 EAL: Detected CPU lcores: 128 00:05:17.164 EAL: Detected NUMA nodes: 2 00:05:17.164 EAL: Detected shared linkage of DPDK 00:05:17.164 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:17.164 EAL: Selected IOVA mode 'VA' 00:05:17.164 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.164 EAL: VFIO support initialized 00:05:17.164 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:17.164 EAL: Using IOMMU type 1 (Type 1) 00:05:17.425 EAL: Ignore mapping IO port bar(1) 00:05:17.425 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.0 (socket 0) 00:05:17.425 EAL: Ignore mapping IO port bar(1) 00:05:17.686 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.1 (socket 0) 00:05:17.686 EAL: Ignore mapping IO port bar(1) 00:05:17.947 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.2 (socket 0) 00:05:17.947 EAL: Ignore mapping IO port bar(1) 00:05:17.947 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.3 (socket 0) 00:05:18.207 EAL: Ignore mapping IO port bar(1) 00:05:18.207 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.4 (socket 0) 00:05:18.469 EAL: Ignore mapping IO port bar(1) 00:05:18.469 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.5 (socket 0) 00:05:18.730 EAL: Ignore mapping IO port bar(1) 00:05:18.730 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.6 (socket 0) 00:05:18.992 EAL: Ignore mapping IO port bar(1) 00:05:18.992 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.7 (socket 0) 00:05:19.254 EAL: Probe PCI driver: spdk_nvme (144d:a80a) device: 0000:65:00.0 (socket 0) 00:05:19.254 EAL: Ignore mapping IO port bar(1) 00:05:19.515 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.0 (socket 1) 00:05:19.515 EAL: Ignore mapping IO port bar(1) 00:05:19.515 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.1 (socket 1) 00:05:19.776 EAL: Ignore mapping IO port bar(1) 00:05:19.776 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.2 (socket 1) 00:05:20.037 EAL: Ignore mapping IO port bar(1) 00:05:20.037 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.3 (socket 1) 00:05:20.298 EAL: Ignore mapping IO port bar(1) 00:05:20.298 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.4 (socket 1) 00:05:20.559 EAL: Ignore mapping IO port bar(1) 00:05:20.559 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.5 (socket 1) 00:05:20.559 EAL: Ignore mapping IO port bar(1) 00:05:20.820 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.6 (socket 1) 00:05:20.820 EAL: Ignore mapping IO port bar(1) 00:05:21.081 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.7 (socket 1) 00:05:21.081 EAL: Releasing PCI mapped resource for 0000:65:00.0 00:05:21.081 EAL: Calling pci_unmap_resource for 0000:65:00.0 at 0x202001020000 00:05:21.081 Starting DPDK initialization... 00:05:21.081 Starting SPDK post initialization... 00:05:21.081 SPDK NVMe probe 00:05:21.081 Attaching to 0000:65:00.0 00:05:21.081 Attached to 0000:65:00.0 00:05:21.081 Cleaning up... 00:05:22.995 00:05:22.996 real 0m5.709s 00:05:22.996 user 0m0.184s 00:05:22.996 sys 0m0.070s 00:05:22.996 04:02:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.996 04:02:37 -- common/autotest_common.sh@10 -- # set +x 00:05:22.996 ************************************ 00:05:22.996 END TEST env_dpdk_post_init 00:05:22.996 ************************************ 00:05:22.996 04:02:37 -- env/env.sh@26 -- # uname 00:05:22.996 04:02:37 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:22.996 04:02:37 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:22.996 04:02:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:22.996 04:02:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.996 04:02:37 -- common/autotest_common.sh@10 -- # set +x 00:05:22.996 ************************************ 00:05:22.996 START TEST env_mem_callbacks 00:05:22.996 ************************************ 00:05:22.996 04:02:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:22.996 EAL: Detected CPU lcores: 128 00:05:22.996 EAL: Detected NUMA nodes: 2 00:05:22.996 EAL: Detected shared linkage of DPDK 00:05:22.996 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:22.996 EAL: Selected IOVA mode 'VA' 00:05:22.996 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.996 EAL: VFIO support initialized 00:05:22.996 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:22.996 00:05:22.996 00:05:22.996 CUnit - A unit testing framework for C - Version 2.1-3 00:05:22.996 http://cunit.sourceforge.net/ 00:05:22.996 00:05:22.996 00:05:22.996 Suite: memory 00:05:22.996 Test: test ... 00:05:22.996 register 0x200000200000 2097152 00:05:22.996 malloc 3145728 00:05:22.996 register 0x200000400000 4194304 00:05:22.996 buf 0x200000500000 len 3145728 PASSED 00:05:22.996 malloc 64 00:05:22.996 buf 0x2000004fff40 len 64 PASSED 00:05:22.996 malloc 4194304 00:05:22.996 register 0x200000800000 6291456 00:05:22.996 buf 0x200000a00000 len 4194304 PASSED 00:05:22.996 free 0x200000500000 3145728 00:05:22.996 free 0x2000004fff40 64 00:05:22.996 unregister 0x200000400000 4194304 PASSED 00:05:22.996 free 0x200000a00000 4194304 00:05:22.996 unregister 0x200000800000 6291456 PASSED 00:05:22.996 malloc 8388608 00:05:22.996 register 0x200000400000 10485760 00:05:22.996 buf 0x200000600000 len 8388608 PASSED 00:05:22.996 free 0x200000600000 8388608 00:05:22.996 unregister 0x200000400000 10485760 PASSED 00:05:22.996 passed 00:05:22.996 00:05:22.996 Run Summary: Type Total Ran Passed Failed Inactive 00:05:22.996 suites 1 1 n/a 0 0 00:05:22.996 tests 1 1 1 0 0 00:05:22.996 asserts 15 15 15 0 n/a 00:05:22.996 00:05:22.996 Elapsed time = 0.005 seconds 00:05:22.996 00:05:22.996 real 0m0.059s 00:05:22.996 user 0m0.020s 00:05:22.996 sys 0m0.039s 00:05:22.996 04:02:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.996 04:02:37 -- common/autotest_common.sh@10 -- # set +x 00:05:22.996 ************************************ 00:05:22.996 END TEST env_mem_callbacks 00:05:22.996 ************************************ 00:05:22.996 00:05:22.996 real 0m7.141s 00:05:22.996 user 0m0.937s 00:05:22.996 sys 0m0.762s 00:05:22.996 04:02:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.996 04:02:37 -- common/autotest_common.sh@10 -- # set +x 00:05:22.996 ************************************ 00:05:22.996 END TEST env 00:05:22.996 ************************************ 00:05:22.996 04:02:37 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:22.996 04:02:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:22.996 04:02:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.996 04:02:37 -- common/autotest_common.sh@10 -- # set +x 00:05:22.996 ************************************ 00:05:22.996 START TEST rpc 00:05:22.996 ************************************ 00:05:22.996 04:02:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:22.996 * Looking for test storage... 00:05:22.996 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:22.996 04:02:37 -- rpc/rpc.sh@65 -- # spdk_pid=3726742 00:05:22.996 04:02:37 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:22.996 04:02:37 -- rpc/rpc.sh@67 -- # waitforlisten 3726742 00:05:22.996 04:02:37 -- common/autotest_common.sh@819 -- # '[' -z 3726742 ']' 00:05:22.996 04:02:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.996 04:02:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:22.996 04:02:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.996 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.996 04:02:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:22.996 04:02:37 -- common/autotest_common.sh@10 -- # set +x 00:05:22.996 04:02:37 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:22.996 [2024-05-14 04:02:37.575214] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:22.996 [2024-05-14 04:02:37.575274] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3726742 ] 00:05:23.258 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.258 [2024-05-14 04:02:37.634921] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.258 [2024-05-14 04:02:37.700025] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:23.258 [2024-05-14 04:02:37.700142] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:23.258 [2024-05-14 04:02:37.700151] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3726742' to capture a snapshot of events at runtime. 00:05:23.258 [2024-05-14 04:02:37.700158] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3726742 for offline analysis/debug. 00:05:23.258 [2024-05-14 04:02:37.700176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.833 04:02:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:23.833 04:02:38 -- common/autotest_common.sh@852 -- # return 0 00:05:23.833 04:02:38 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:23.833 04:02:38 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:23.833 04:02:38 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:23.833 04:02:38 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:23.833 04:02:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:23.833 04:02:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:23.833 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:23.833 ************************************ 00:05:23.833 START TEST rpc_integrity 00:05:23.833 ************************************ 00:05:23.833 04:02:38 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:05:23.833 04:02:38 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:23.833 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.833 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:23.833 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.833 04:02:38 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:23.833 04:02:38 -- rpc/rpc.sh@13 -- # jq length 00:05:23.833 04:02:38 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:23.833 04:02:38 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:23.833 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.833 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:23.833 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.833 04:02:38 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:23.833 04:02:38 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:23.833 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.833 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:23.833 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.833 04:02:38 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:23.833 { 00:05:23.833 "name": "Malloc0", 00:05:23.833 "aliases": [ 00:05:23.833 "b3f2cf63-a325-4e36-86a5-da67cdfa00c4" 00:05:23.833 ], 00:05:23.833 "product_name": "Malloc disk", 00:05:23.833 "block_size": 512, 00:05:23.833 "num_blocks": 16384, 00:05:23.833 "uuid": "b3f2cf63-a325-4e36-86a5-da67cdfa00c4", 00:05:23.833 "assigned_rate_limits": { 00:05:23.833 "rw_ios_per_sec": 0, 00:05:23.833 "rw_mbytes_per_sec": 0, 00:05:23.833 "r_mbytes_per_sec": 0, 00:05:23.833 "w_mbytes_per_sec": 0 00:05:23.833 }, 00:05:23.833 "claimed": false, 00:05:23.833 "zoned": false, 00:05:23.833 "supported_io_types": { 00:05:23.833 "read": true, 00:05:23.833 "write": true, 00:05:23.833 "unmap": true, 00:05:23.833 "write_zeroes": true, 00:05:23.833 "flush": true, 00:05:23.833 "reset": true, 00:05:23.833 "compare": false, 00:05:23.833 "compare_and_write": false, 00:05:23.833 "abort": true, 00:05:23.833 "nvme_admin": false, 00:05:23.833 "nvme_io": false 00:05:23.833 }, 00:05:23.833 "memory_domains": [ 00:05:23.833 { 00:05:23.833 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:23.833 "dma_device_type": 2 00:05:23.833 } 00:05:23.833 ], 00:05:23.833 "driver_specific": {} 00:05:23.833 } 00:05:23.833 ]' 00:05:23.833 04:02:38 -- rpc/rpc.sh@17 -- # jq length 00:05:24.094 04:02:38 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:24.094 04:02:38 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:24.094 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.094 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.094 [2024-05-14 04:02:38.463803] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:24.094 [2024-05-14 04:02:38.463837] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:24.094 [2024-05-14 04:02:38.463850] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xcfb460 00:05:24.094 [2024-05-14 04:02:38.463857] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:24.094 [2024-05-14 04:02:38.465198] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:24.094 [2024-05-14 04:02:38.465218] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:24.094 Passthru0 00:05:24.094 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.094 04:02:38 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:24.094 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.094 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.094 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.094 04:02:38 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:24.094 { 00:05:24.094 "name": "Malloc0", 00:05:24.094 "aliases": [ 00:05:24.094 "b3f2cf63-a325-4e36-86a5-da67cdfa00c4" 00:05:24.094 ], 00:05:24.094 "product_name": "Malloc disk", 00:05:24.094 "block_size": 512, 00:05:24.094 "num_blocks": 16384, 00:05:24.095 "uuid": "b3f2cf63-a325-4e36-86a5-da67cdfa00c4", 00:05:24.095 "assigned_rate_limits": { 00:05:24.095 "rw_ios_per_sec": 0, 00:05:24.095 "rw_mbytes_per_sec": 0, 00:05:24.095 "r_mbytes_per_sec": 0, 00:05:24.095 "w_mbytes_per_sec": 0 00:05:24.095 }, 00:05:24.095 "claimed": true, 00:05:24.095 "claim_type": "exclusive_write", 00:05:24.095 "zoned": false, 00:05:24.095 "supported_io_types": { 00:05:24.095 "read": true, 00:05:24.095 "write": true, 00:05:24.095 "unmap": true, 00:05:24.095 "write_zeroes": true, 00:05:24.095 "flush": true, 00:05:24.095 "reset": true, 00:05:24.095 "compare": false, 00:05:24.095 "compare_and_write": false, 00:05:24.095 "abort": true, 00:05:24.095 "nvme_admin": false, 00:05:24.095 "nvme_io": false 00:05:24.095 }, 00:05:24.095 "memory_domains": [ 00:05:24.095 { 00:05:24.095 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:24.095 "dma_device_type": 2 00:05:24.095 } 00:05:24.095 ], 00:05:24.095 "driver_specific": {} 00:05:24.095 }, 00:05:24.095 { 00:05:24.095 "name": "Passthru0", 00:05:24.095 "aliases": [ 00:05:24.095 "d82bb9e9-eb7c-541c-81d9-18814dcc94e5" 00:05:24.095 ], 00:05:24.095 "product_name": "passthru", 00:05:24.095 "block_size": 512, 00:05:24.095 "num_blocks": 16384, 00:05:24.095 "uuid": "d82bb9e9-eb7c-541c-81d9-18814dcc94e5", 00:05:24.095 "assigned_rate_limits": { 00:05:24.095 "rw_ios_per_sec": 0, 00:05:24.095 "rw_mbytes_per_sec": 0, 00:05:24.095 "r_mbytes_per_sec": 0, 00:05:24.095 "w_mbytes_per_sec": 0 00:05:24.095 }, 00:05:24.095 "claimed": false, 00:05:24.095 "zoned": false, 00:05:24.095 "supported_io_types": { 00:05:24.095 "read": true, 00:05:24.095 "write": true, 00:05:24.095 "unmap": true, 00:05:24.095 "write_zeroes": true, 00:05:24.095 "flush": true, 00:05:24.095 "reset": true, 00:05:24.095 "compare": false, 00:05:24.095 "compare_and_write": false, 00:05:24.095 "abort": true, 00:05:24.095 "nvme_admin": false, 00:05:24.095 "nvme_io": false 00:05:24.095 }, 00:05:24.095 "memory_domains": [ 00:05:24.095 { 00:05:24.095 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:24.095 "dma_device_type": 2 00:05:24.095 } 00:05:24.095 ], 00:05:24.095 "driver_specific": { 00:05:24.095 "passthru": { 00:05:24.095 "name": "Passthru0", 00:05:24.095 "base_bdev_name": "Malloc0" 00:05:24.095 } 00:05:24.095 } 00:05:24.095 } 00:05:24.095 ]' 00:05:24.095 04:02:38 -- rpc/rpc.sh@21 -- # jq length 00:05:24.095 04:02:38 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:24.095 04:02:38 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:24.095 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.095 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.095 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.095 04:02:38 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:24.095 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.095 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.095 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.095 04:02:38 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:24.095 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.095 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.095 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.095 04:02:38 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:24.095 04:02:38 -- rpc/rpc.sh@26 -- # jq length 00:05:24.095 04:02:38 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:24.095 00:05:24.095 real 0m0.282s 00:05:24.095 user 0m0.177s 00:05:24.095 sys 0m0.035s 00:05:24.095 04:02:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:24.095 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.095 ************************************ 00:05:24.095 END TEST rpc_integrity 00:05:24.095 ************************************ 00:05:24.095 04:02:38 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:24.095 04:02:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:24.095 04:02:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:24.095 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.095 ************************************ 00:05:24.095 START TEST rpc_plugins 00:05:24.095 ************************************ 00:05:24.095 04:02:38 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:05:24.095 04:02:38 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:24.095 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.095 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.095 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.095 04:02:38 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:24.095 04:02:38 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:24.095 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.095 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.095 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.095 04:02:38 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:24.095 { 00:05:24.095 "name": "Malloc1", 00:05:24.095 "aliases": [ 00:05:24.095 "560f2575-b0a1-4bd0-8854-8f4d401f4dd3" 00:05:24.095 ], 00:05:24.095 "product_name": "Malloc disk", 00:05:24.095 "block_size": 4096, 00:05:24.095 "num_blocks": 256, 00:05:24.095 "uuid": "560f2575-b0a1-4bd0-8854-8f4d401f4dd3", 00:05:24.095 "assigned_rate_limits": { 00:05:24.095 "rw_ios_per_sec": 0, 00:05:24.095 "rw_mbytes_per_sec": 0, 00:05:24.095 "r_mbytes_per_sec": 0, 00:05:24.095 "w_mbytes_per_sec": 0 00:05:24.095 }, 00:05:24.095 "claimed": false, 00:05:24.095 "zoned": false, 00:05:24.095 "supported_io_types": { 00:05:24.095 "read": true, 00:05:24.095 "write": true, 00:05:24.095 "unmap": true, 00:05:24.095 "write_zeroes": true, 00:05:24.095 "flush": true, 00:05:24.095 "reset": true, 00:05:24.095 "compare": false, 00:05:24.095 "compare_and_write": false, 00:05:24.095 "abort": true, 00:05:24.095 "nvme_admin": false, 00:05:24.095 "nvme_io": false 00:05:24.095 }, 00:05:24.095 "memory_domains": [ 00:05:24.095 { 00:05:24.095 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:24.095 "dma_device_type": 2 00:05:24.095 } 00:05:24.095 ], 00:05:24.095 "driver_specific": {} 00:05:24.095 } 00:05:24.095 ]' 00:05:24.095 04:02:38 -- rpc/rpc.sh@32 -- # jq length 00:05:24.356 04:02:38 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:24.356 04:02:38 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:24.356 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.356 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.356 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.356 04:02:38 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:24.356 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.356 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.356 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.356 04:02:38 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:24.356 04:02:38 -- rpc/rpc.sh@36 -- # jq length 00:05:24.356 04:02:38 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:24.356 00:05:24.356 real 0m0.144s 00:05:24.356 user 0m0.095s 00:05:24.356 sys 0m0.011s 00:05:24.356 04:02:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:24.356 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.356 ************************************ 00:05:24.356 END TEST rpc_plugins 00:05:24.356 ************************************ 00:05:24.356 04:02:38 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:24.356 04:02:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:24.356 04:02:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:24.356 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.356 ************************************ 00:05:24.356 START TEST rpc_trace_cmd_test 00:05:24.356 ************************************ 00:05:24.356 04:02:38 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:05:24.356 04:02:38 -- rpc/rpc.sh@40 -- # local info 00:05:24.356 04:02:38 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:24.356 04:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.356 04:02:38 -- common/autotest_common.sh@10 -- # set +x 00:05:24.356 04:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.356 04:02:38 -- rpc/rpc.sh@42 -- # info='{ 00:05:24.356 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3726742", 00:05:24.356 "tpoint_group_mask": "0x8", 00:05:24.356 "iscsi_conn": { 00:05:24.356 "mask": "0x2", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "scsi": { 00:05:24.356 "mask": "0x4", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "bdev": { 00:05:24.356 "mask": "0x8", 00:05:24.356 "tpoint_mask": "0xffffffffffffffff" 00:05:24.356 }, 00:05:24.356 "nvmf_rdma": { 00:05:24.356 "mask": "0x10", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "nvmf_tcp": { 00:05:24.356 "mask": "0x20", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "ftl": { 00:05:24.356 "mask": "0x40", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "blobfs": { 00:05:24.356 "mask": "0x80", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "dsa": { 00:05:24.356 "mask": "0x200", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "thread": { 00:05:24.356 "mask": "0x400", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "nvme_pcie": { 00:05:24.356 "mask": "0x800", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "iaa": { 00:05:24.356 "mask": "0x1000", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "nvme_tcp": { 00:05:24.356 "mask": "0x2000", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 }, 00:05:24.356 "bdev_nvme": { 00:05:24.356 "mask": "0x4000", 00:05:24.356 "tpoint_mask": "0x0" 00:05:24.356 } 00:05:24.356 }' 00:05:24.356 04:02:38 -- rpc/rpc.sh@43 -- # jq length 00:05:24.356 04:02:38 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:24.356 04:02:38 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:24.356 04:02:38 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:24.356 04:02:38 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:24.617 04:02:38 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:24.617 04:02:38 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:24.617 04:02:39 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:24.617 04:02:39 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:24.617 04:02:39 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:24.617 00:05:24.617 real 0m0.219s 00:05:24.617 user 0m0.179s 00:05:24.617 sys 0m0.031s 00:05:24.617 04:02:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:24.617 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.617 ************************************ 00:05:24.617 END TEST rpc_trace_cmd_test 00:05:24.617 ************************************ 00:05:24.617 04:02:39 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:24.617 04:02:39 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:24.617 04:02:39 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:24.617 04:02:39 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:24.617 04:02:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:24.617 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.617 ************************************ 00:05:24.617 START TEST rpc_daemon_integrity 00:05:24.617 ************************************ 00:05:24.617 04:02:39 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:05:24.617 04:02:39 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:24.617 04:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.617 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.617 04:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.617 04:02:39 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:24.617 04:02:39 -- rpc/rpc.sh@13 -- # jq length 00:05:24.617 04:02:39 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:24.617 04:02:39 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:24.617 04:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.617 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.617 04:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.617 04:02:39 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:24.617 04:02:39 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:24.617 04:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.617 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.617 04:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.617 04:02:39 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:24.617 { 00:05:24.617 "name": "Malloc2", 00:05:24.617 "aliases": [ 00:05:24.617 "422a1b94-bdda-47f7-8330-a2d90968461c" 00:05:24.617 ], 00:05:24.617 "product_name": "Malloc disk", 00:05:24.617 "block_size": 512, 00:05:24.617 "num_blocks": 16384, 00:05:24.617 "uuid": "422a1b94-bdda-47f7-8330-a2d90968461c", 00:05:24.617 "assigned_rate_limits": { 00:05:24.617 "rw_ios_per_sec": 0, 00:05:24.617 "rw_mbytes_per_sec": 0, 00:05:24.617 "r_mbytes_per_sec": 0, 00:05:24.617 "w_mbytes_per_sec": 0 00:05:24.617 }, 00:05:24.617 "claimed": false, 00:05:24.617 "zoned": false, 00:05:24.617 "supported_io_types": { 00:05:24.617 "read": true, 00:05:24.617 "write": true, 00:05:24.617 "unmap": true, 00:05:24.617 "write_zeroes": true, 00:05:24.617 "flush": true, 00:05:24.617 "reset": true, 00:05:24.617 "compare": false, 00:05:24.617 "compare_and_write": false, 00:05:24.617 "abort": true, 00:05:24.617 "nvme_admin": false, 00:05:24.617 "nvme_io": false 00:05:24.617 }, 00:05:24.617 "memory_domains": [ 00:05:24.617 { 00:05:24.617 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:24.617 "dma_device_type": 2 00:05:24.617 } 00:05:24.617 ], 00:05:24.617 "driver_specific": {} 00:05:24.617 } 00:05:24.617 ]' 00:05:24.617 04:02:39 -- rpc/rpc.sh@17 -- # jq length 00:05:24.878 04:02:39 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:24.878 04:02:39 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:24.878 04:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.878 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.878 [2024-05-14 04:02:39.225880] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:24.878 [2024-05-14 04:02:39.225910] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:24.878 [2024-05-14 04:02:39.225923] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xcfbd50 00:05:24.878 [2024-05-14 04:02:39.225931] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:24.878 [2024-05-14 04:02:39.227138] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:24.878 [2024-05-14 04:02:39.227157] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:24.878 Passthru0 00:05:24.878 04:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.878 04:02:39 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:24.878 04:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.878 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.878 04:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.878 04:02:39 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:24.878 { 00:05:24.878 "name": "Malloc2", 00:05:24.878 "aliases": [ 00:05:24.878 "422a1b94-bdda-47f7-8330-a2d90968461c" 00:05:24.878 ], 00:05:24.878 "product_name": "Malloc disk", 00:05:24.878 "block_size": 512, 00:05:24.878 "num_blocks": 16384, 00:05:24.878 "uuid": "422a1b94-bdda-47f7-8330-a2d90968461c", 00:05:24.878 "assigned_rate_limits": { 00:05:24.878 "rw_ios_per_sec": 0, 00:05:24.878 "rw_mbytes_per_sec": 0, 00:05:24.878 "r_mbytes_per_sec": 0, 00:05:24.878 "w_mbytes_per_sec": 0 00:05:24.878 }, 00:05:24.878 "claimed": true, 00:05:24.878 "claim_type": "exclusive_write", 00:05:24.878 "zoned": false, 00:05:24.878 "supported_io_types": { 00:05:24.878 "read": true, 00:05:24.878 "write": true, 00:05:24.878 "unmap": true, 00:05:24.878 "write_zeroes": true, 00:05:24.878 "flush": true, 00:05:24.878 "reset": true, 00:05:24.878 "compare": false, 00:05:24.878 "compare_and_write": false, 00:05:24.878 "abort": true, 00:05:24.878 "nvme_admin": false, 00:05:24.878 "nvme_io": false 00:05:24.878 }, 00:05:24.878 "memory_domains": [ 00:05:24.878 { 00:05:24.878 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:24.878 "dma_device_type": 2 00:05:24.878 } 00:05:24.878 ], 00:05:24.878 "driver_specific": {} 00:05:24.878 }, 00:05:24.878 { 00:05:24.878 "name": "Passthru0", 00:05:24.878 "aliases": [ 00:05:24.878 "2ed93095-c517-580d-953f-6a6dcef66343" 00:05:24.878 ], 00:05:24.878 "product_name": "passthru", 00:05:24.878 "block_size": 512, 00:05:24.878 "num_blocks": 16384, 00:05:24.878 "uuid": "2ed93095-c517-580d-953f-6a6dcef66343", 00:05:24.878 "assigned_rate_limits": { 00:05:24.878 "rw_ios_per_sec": 0, 00:05:24.878 "rw_mbytes_per_sec": 0, 00:05:24.878 "r_mbytes_per_sec": 0, 00:05:24.878 "w_mbytes_per_sec": 0 00:05:24.878 }, 00:05:24.878 "claimed": false, 00:05:24.878 "zoned": false, 00:05:24.878 "supported_io_types": { 00:05:24.878 "read": true, 00:05:24.878 "write": true, 00:05:24.878 "unmap": true, 00:05:24.878 "write_zeroes": true, 00:05:24.878 "flush": true, 00:05:24.878 "reset": true, 00:05:24.878 "compare": false, 00:05:24.878 "compare_and_write": false, 00:05:24.878 "abort": true, 00:05:24.878 "nvme_admin": false, 00:05:24.878 "nvme_io": false 00:05:24.878 }, 00:05:24.878 "memory_domains": [ 00:05:24.878 { 00:05:24.878 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:24.878 "dma_device_type": 2 00:05:24.878 } 00:05:24.878 ], 00:05:24.878 "driver_specific": { 00:05:24.878 "passthru": { 00:05:24.878 "name": "Passthru0", 00:05:24.878 "base_bdev_name": "Malloc2" 00:05:24.878 } 00:05:24.878 } 00:05:24.878 } 00:05:24.878 ]' 00:05:24.878 04:02:39 -- rpc/rpc.sh@21 -- # jq length 00:05:24.878 04:02:39 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:24.878 04:02:39 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:24.878 04:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.878 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.878 04:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.878 04:02:39 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:24.878 04:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.878 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.878 04:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.879 04:02:39 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:24.879 04:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:24.879 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.879 04:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:24.879 04:02:39 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:24.879 04:02:39 -- rpc/rpc.sh@26 -- # jq length 00:05:24.879 04:02:39 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:24.879 00:05:24.879 real 0m0.286s 00:05:24.879 user 0m0.190s 00:05:24.879 sys 0m0.028s 00:05:24.879 04:02:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:24.879 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.879 ************************************ 00:05:24.879 END TEST rpc_daemon_integrity 00:05:24.879 ************************************ 00:05:24.879 04:02:39 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:24.879 04:02:39 -- rpc/rpc.sh@84 -- # killprocess 3726742 00:05:24.879 04:02:39 -- common/autotest_common.sh@926 -- # '[' -z 3726742 ']' 00:05:24.879 04:02:39 -- common/autotest_common.sh@930 -- # kill -0 3726742 00:05:24.879 04:02:39 -- common/autotest_common.sh@931 -- # uname 00:05:24.879 04:02:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:24.879 04:02:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3726742 00:05:24.879 04:02:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:24.879 04:02:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:24.879 04:02:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3726742' 00:05:24.879 killing process with pid 3726742 00:05:24.879 04:02:39 -- common/autotest_common.sh@945 -- # kill 3726742 00:05:24.879 04:02:39 -- common/autotest_common.sh@950 -- # wait 3726742 00:05:25.139 00:05:25.139 real 0m2.233s 00:05:25.139 user 0m2.905s 00:05:25.139 sys 0m0.579s 00:05:25.139 04:02:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:25.139 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:25.139 ************************************ 00:05:25.139 END TEST rpc 00:05:25.139 ************************************ 00:05:25.139 04:02:39 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:25.139 04:02:39 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:25.139 04:02:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:25.139 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:25.139 ************************************ 00:05:25.139 START TEST rpc_client 00:05:25.139 ************************************ 00:05:25.139 04:02:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:25.403 * Looking for test storage... 00:05:25.403 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:25.403 04:02:39 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:25.403 OK 00:05:25.403 04:02:39 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:25.403 00:05:25.403 real 0m0.104s 00:05:25.403 user 0m0.045s 00:05:25.403 sys 0m0.064s 00:05:25.403 04:02:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:25.403 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:25.403 ************************************ 00:05:25.403 END TEST rpc_client 00:05:25.403 ************************************ 00:05:25.403 04:02:39 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:25.403 04:02:39 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:25.403 04:02:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:25.403 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:25.404 ************************************ 00:05:25.404 START TEST json_config 00:05:25.404 ************************************ 00:05:25.404 04:02:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:25.404 04:02:39 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:25.404 04:02:39 -- nvmf/common.sh@7 -- # uname -s 00:05:25.404 04:02:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:25.404 04:02:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:25.404 04:02:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:25.404 04:02:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:25.404 04:02:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:25.404 04:02:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:25.404 04:02:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:25.404 04:02:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:25.404 04:02:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:25.404 04:02:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:25.404 04:02:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:05:25.404 04:02:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:05:25.404 04:02:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:25.404 04:02:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:25.404 04:02:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:25.404 04:02:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:25.404 04:02:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:25.404 04:02:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:25.404 04:02:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:25.404 04:02:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:25.404 04:02:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:25.404 04:02:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:25.404 04:02:39 -- paths/export.sh@5 -- # export PATH 00:05:25.404 04:02:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:25.404 04:02:39 -- nvmf/common.sh@46 -- # : 0 00:05:25.404 04:02:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:25.404 04:02:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:25.404 04:02:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:25.404 04:02:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:25.404 04:02:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:25.404 04:02:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:25.404 04:02:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:25.404 04:02:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:25.404 04:02:39 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:25.404 04:02:39 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:25.404 04:02:39 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:25.404 04:02:39 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:25.404 04:02:39 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:25.404 04:02:39 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:25.404 04:02:39 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:25.404 04:02:39 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:25.404 04:02:39 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:25.404 04:02:39 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:25.404 04:02:39 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:25.404 04:02:39 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:25.404 04:02:39 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:25.404 04:02:39 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:25.404 04:02:39 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:25.404 INFO: JSON configuration test init 00:05:25.404 04:02:39 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:25.404 04:02:39 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:25.404 04:02:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:25.404 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:25.404 04:02:39 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:25.404 04:02:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:25.404 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:25.404 04:02:39 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:25.404 04:02:39 -- json_config/json_config.sh@98 -- # local app=target 00:05:25.404 04:02:39 -- json_config/json_config.sh@99 -- # shift 00:05:25.404 04:02:39 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:25.404 04:02:39 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:25.404 04:02:39 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:25.404 04:02:39 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:25.404 04:02:39 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:25.404 04:02:39 -- json_config/json_config.sh@111 -- # app_pid[$app]=3727299 00:05:25.404 04:02:39 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:25.404 Waiting for target to run... 00:05:25.404 04:02:39 -- json_config/json_config.sh@114 -- # waitforlisten 3727299 /var/tmp/spdk_tgt.sock 00:05:25.404 04:02:39 -- common/autotest_common.sh@819 -- # '[' -z 3727299 ']' 00:05:25.404 04:02:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:25.404 04:02:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:25.404 04:02:39 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:25.404 04:02:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:25.404 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:25.404 04:02:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:25.404 04:02:39 -- common/autotest_common.sh@10 -- # set +x 00:05:25.665 [2024-05-14 04:02:40.016836] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:25.665 [2024-05-14 04:02:40.016894] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3727299 ] 00:05:25.665 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.926 [2024-05-14 04:02:40.309353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.926 [2024-05-14 04:02:40.359544] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:25.926 [2024-05-14 04:02:40.359679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.497 04:02:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:26.497 04:02:40 -- common/autotest_common.sh@852 -- # return 0 00:05:26.497 04:02:40 -- json_config/json_config.sh@115 -- # echo '' 00:05:26.497 00:05:26.497 04:02:40 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:26.497 04:02:40 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:26.497 04:02:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:26.497 04:02:40 -- common/autotest_common.sh@10 -- # set +x 00:05:26.497 04:02:40 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:26.497 04:02:40 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:26.497 04:02:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:26.497 04:02:40 -- common/autotest_common.sh@10 -- # set +x 00:05:26.497 04:02:40 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:26.497 04:02:40 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:26.497 04:02:40 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:27.069 04:02:41 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:27.069 04:02:41 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:27.069 04:02:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:27.069 04:02:41 -- common/autotest_common.sh@10 -- # set +x 00:05:27.069 04:02:41 -- json_config/json_config.sh@48 -- # local ret=0 00:05:27.069 04:02:41 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:27.069 04:02:41 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:27.069 04:02:41 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:27.069 04:02:41 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:27.069 04:02:41 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:27.069 04:02:41 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:27.069 04:02:41 -- json_config/json_config.sh@51 -- # local get_types 00:05:27.069 04:02:41 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:27.069 04:02:41 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:27.069 04:02:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:27.069 04:02:41 -- common/autotest_common.sh@10 -- # set +x 00:05:27.069 04:02:41 -- json_config/json_config.sh@58 -- # return 0 00:05:27.069 04:02:41 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:27.069 04:02:41 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:27.069 04:02:41 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:27.069 04:02:41 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:27.069 04:02:41 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:27.069 04:02:41 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:27.069 04:02:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:27.069 04:02:41 -- common/autotest_common.sh@10 -- # set +x 00:05:27.069 04:02:41 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:27.069 04:02:41 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:27.069 04:02:41 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:27.069 04:02:41 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:27.069 04:02:41 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:27.330 MallocForNvmf0 00:05:27.330 04:02:41 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:27.330 04:02:41 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:27.591 MallocForNvmf1 00:05:27.591 04:02:41 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:27.591 04:02:41 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:27.591 [2024-05-14 04:02:42.092400] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:27.591 04:02:42 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:27.591 04:02:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:27.852 04:02:42 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:27.852 04:02:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:28.119 04:02:42 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:28.119 04:02:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:28.119 04:02:42 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:28.119 04:02:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:28.420 [2024-05-14 04:02:42.758600] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:28.420 04:02:42 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:28.420 04:02:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:28.420 04:02:42 -- common/autotest_common.sh@10 -- # set +x 00:05:28.420 04:02:42 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:28.420 04:02:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:28.420 04:02:42 -- common/autotest_common.sh@10 -- # set +x 00:05:28.420 04:02:42 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:28.420 04:02:42 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:28.420 04:02:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:28.420 MallocBdevForConfigChangeCheck 00:05:28.681 04:02:43 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:28.681 04:02:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:28.681 04:02:43 -- common/autotest_common.sh@10 -- # set +x 00:05:28.681 04:02:43 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:28.681 04:02:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:28.942 04:02:43 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:28.942 INFO: shutting down applications... 00:05:28.942 04:02:43 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:28.942 04:02:43 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:28.942 04:02:43 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:28.942 04:02:43 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:29.203 Calling clear_iscsi_subsystem 00:05:29.203 Calling clear_nvmf_subsystem 00:05:29.203 Calling clear_nbd_subsystem 00:05:29.203 Calling clear_ublk_subsystem 00:05:29.203 Calling clear_vhost_blk_subsystem 00:05:29.203 Calling clear_vhost_scsi_subsystem 00:05:29.203 Calling clear_scheduler_subsystem 00:05:29.203 Calling clear_bdev_subsystem 00:05:29.203 Calling clear_accel_subsystem 00:05:29.203 Calling clear_vmd_subsystem 00:05:29.203 Calling clear_sock_subsystem 00:05:29.203 Calling clear_iobuf_subsystem 00:05:29.203 04:02:43 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:29.203 04:02:43 -- json_config/json_config.sh@396 -- # count=100 00:05:29.203 04:02:43 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:29.203 04:02:43 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:29.203 04:02:43 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:29.203 04:02:43 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:29.463 04:02:44 -- json_config/json_config.sh@398 -- # break 00:05:29.463 04:02:44 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:29.463 04:02:44 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:29.463 04:02:44 -- json_config/json_config.sh@120 -- # local app=target 00:05:29.463 04:02:44 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:29.463 04:02:44 -- json_config/json_config.sh@124 -- # [[ -n 3727299 ]] 00:05:29.463 04:02:44 -- json_config/json_config.sh@127 -- # kill -SIGINT 3727299 00:05:29.463 04:02:44 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:29.463 04:02:44 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:29.463 04:02:44 -- json_config/json_config.sh@130 -- # kill -0 3727299 00:05:29.463 04:02:44 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:30.036 04:02:44 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:30.036 04:02:44 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:30.036 04:02:44 -- json_config/json_config.sh@130 -- # kill -0 3727299 00:05:30.036 04:02:44 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:30.036 04:02:44 -- json_config/json_config.sh@132 -- # break 00:05:30.036 04:02:44 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:30.036 04:02:44 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:30.036 SPDK target shutdown done 00:05:30.036 04:02:44 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:30.036 INFO: relaunching applications... 00:05:30.036 04:02:44 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:30.036 04:02:44 -- json_config/json_config.sh@98 -- # local app=target 00:05:30.036 04:02:44 -- json_config/json_config.sh@99 -- # shift 00:05:30.036 04:02:44 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:30.036 04:02:44 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:30.036 04:02:44 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:30.036 04:02:44 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:30.036 04:02:44 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:30.036 04:02:44 -- json_config/json_config.sh@111 -- # app_pid[$app]=3728439 00:05:30.036 04:02:44 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:30.036 Waiting for target to run... 00:05:30.036 04:02:44 -- json_config/json_config.sh@114 -- # waitforlisten 3728439 /var/tmp/spdk_tgt.sock 00:05:30.036 04:02:44 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:30.036 04:02:44 -- common/autotest_common.sh@819 -- # '[' -z 3728439 ']' 00:05:30.036 04:02:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:30.036 04:02:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:30.036 04:02:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:30.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:30.036 04:02:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:30.036 04:02:44 -- common/autotest_common.sh@10 -- # set +x 00:05:30.036 [2024-05-14 04:02:44.615354] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:30.036 [2024-05-14 04:02:44.615415] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3728439 ] 00:05:30.297 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.559 [2024-05-14 04:02:44.896095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.559 [2024-05-14 04:02:44.950091] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:30.559 [2024-05-14 04:02:44.950214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.131 [2024-05-14 04:02:45.435211] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:31.131 [2024-05-14 04:02:45.467602] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:31.704 04:02:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:31.704 04:02:46 -- common/autotest_common.sh@852 -- # return 0 00:05:31.704 04:02:46 -- json_config/json_config.sh@115 -- # echo '' 00:05:31.704 00:05:31.704 04:02:46 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:31.704 04:02:46 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:31.704 INFO: Checking if target configuration is the same... 00:05:31.704 04:02:46 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:31.704 04:02:46 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:31.704 04:02:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:31.704 + '[' 2 -ne 2 ']' 00:05:31.704 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:31.704 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:31.704 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:31.704 +++ basename /dev/fd/62 00:05:31.704 ++ mktemp /tmp/62.XXX 00:05:31.704 + tmp_file_1=/tmp/62.H4X 00:05:31.704 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:31.704 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:31.704 + tmp_file_2=/tmp/spdk_tgt_config.json.uon 00:05:31.704 + ret=0 00:05:31.704 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:31.704 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:31.965 + diff -u /tmp/62.H4X /tmp/spdk_tgt_config.json.uon 00:05:31.965 + echo 'INFO: JSON config files are the same' 00:05:31.965 INFO: JSON config files are the same 00:05:31.965 + rm /tmp/62.H4X /tmp/spdk_tgt_config.json.uon 00:05:31.965 + exit 0 00:05:31.965 04:02:46 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:31.965 04:02:46 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:31.965 INFO: changing configuration and checking if this can be detected... 00:05:31.965 04:02:46 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:31.965 04:02:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:31.965 04:02:46 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:31.965 04:02:46 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:31.965 04:02:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:31.965 + '[' 2 -ne 2 ']' 00:05:31.965 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:31.965 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:31.965 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:31.965 +++ basename /dev/fd/62 00:05:31.965 ++ mktemp /tmp/62.XXX 00:05:31.965 + tmp_file_1=/tmp/62.Lwx 00:05:31.965 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:31.965 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:31.965 + tmp_file_2=/tmp/spdk_tgt_config.json.mFF 00:05:31.965 + ret=0 00:05:31.965 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:32.225 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:32.487 + diff -u /tmp/62.Lwx /tmp/spdk_tgt_config.json.mFF 00:05:32.487 + ret=1 00:05:32.487 + echo '=== Start of file: /tmp/62.Lwx ===' 00:05:32.487 + cat /tmp/62.Lwx 00:05:32.487 + echo '=== End of file: /tmp/62.Lwx ===' 00:05:32.487 + echo '' 00:05:32.487 + echo '=== Start of file: /tmp/spdk_tgt_config.json.mFF ===' 00:05:32.487 + cat /tmp/spdk_tgt_config.json.mFF 00:05:32.487 + echo '=== End of file: /tmp/spdk_tgt_config.json.mFF ===' 00:05:32.487 + echo '' 00:05:32.487 + rm /tmp/62.Lwx /tmp/spdk_tgt_config.json.mFF 00:05:32.487 + exit 1 00:05:32.487 04:02:46 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:32.487 INFO: configuration change detected. 00:05:32.487 04:02:46 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:32.487 04:02:46 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:32.487 04:02:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:32.487 04:02:46 -- common/autotest_common.sh@10 -- # set +x 00:05:32.487 04:02:46 -- json_config/json_config.sh@360 -- # local ret=0 00:05:32.487 04:02:46 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:32.487 04:02:46 -- json_config/json_config.sh@370 -- # [[ -n 3728439 ]] 00:05:32.487 04:02:46 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:32.487 04:02:46 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:32.487 04:02:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:32.487 04:02:46 -- common/autotest_common.sh@10 -- # set +x 00:05:32.487 04:02:46 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:32.487 04:02:46 -- json_config/json_config.sh@246 -- # uname -s 00:05:32.487 04:02:46 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:32.487 04:02:46 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:32.487 04:02:46 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:32.487 04:02:46 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:32.487 04:02:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:32.487 04:02:46 -- common/autotest_common.sh@10 -- # set +x 00:05:32.487 04:02:46 -- json_config/json_config.sh@376 -- # killprocess 3728439 00:05:32.487 04:02:46 -- common/autotest_common.sh@926 -- # '[' -z 3728439 ']' 00:05:32.487 04:02:46 -- common/autotest_common.sh@930 -- # kill -0 3728439 00:05:32.487 04:02:46 -- common/autotest_common.sh@931 -- # uname 00:05:32.487 04:02:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:32.487 04:02:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3728439 00:05:32.487 04:02:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:32.487 04:02:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:32.487 04:02:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3728439' 00:05:32.487 killing process with pid 3728439 00:05:32.487 04:02:46 -- common/autotest_common.sh@945 -- # kill 3728439 00:05:32.487 04:02:46 -- common/autotest_common.sh@950 -- # wait 3728439 00:05:32.748 04:02:47 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:32.748 04:02:47 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:32.748 04:02:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:32.748 04:02:47 -- common/autotest_common.sh@10 -- # set +x 00:05:32.748 04:02:47 -- json_config/json_config.sh@381 -- # return 0 00:05:32.748 04:02:47 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:32.748 INFO: Success 00:05:32.748 00:05:32.748 real 0m7.426s 00:05:32.748 user 0m9.060s 00:05:32.748 sys 0m1.711s 00:05:32.748 04:02:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:32.748 04:02:47 -- common/autotest_common.sh@10 -- # set +x 00:05:32.748 ************************************ 00:05:32.748 END TEST json_config 00:05:32.748 ************************************ 00:05:32.748 04:02:47 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:32.748 04:02:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:32.748 04:02:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:32.748 04:02:47 -- common/autotest_common.sh@10 -- # set +x 00:05:32.748 ************************************ 00:05:32.748 START TEST json_config_extra_key 00:05:32.748 ************************************ 00:05:32.748 04:02:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:33.010 04:02:47 -- nvmf/common.sh@7 -- # uname -s 00:05:33.010 04:02:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:33.010 04:02:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:33.010 04:02:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:33.010 04:02:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:33.010 04:02:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:33.010 04:02:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:33.010 04:02:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:33.010 04:02:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:33.010 04:02:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:33.010 04:02:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:33.010 04:02:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:05:33.010 04:02:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:05:33.010 04:02:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:33.010 04:02:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:33.010 04:02:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:33.010 04:02:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:33.010 04:02:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:33.010 04:02:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:33.010 04:02:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:33.010 04:02:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:33.010 04:02:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:33.010 04:02:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:33.010 04:02:47 -- paths/export.sh@5 -- # export PATH 00:05:33.010 04:02:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:33.010 04:02:47 -- nvmf/common.sh@46 -- # : 0 00:05:33.010 04:02:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:33.010 04:02:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:33.010 04:02:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:33.010 04:02:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:33.010 04:02:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:33.010 04:02:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:33.010 04:02:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:33.010 04:02:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:33.010 INFO: launching applications... 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3729195 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:33.010 Waiting for target to run... 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3729195 /var/tmp/spdk_tgt.sock 00:05:33.010 04:02:47 -- common/autotest_common.sh@819 -- # '[' -z 3729195 ']' 00:05:33.010 04:02:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:33.010 04:02:47 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:33.010 04:02:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:33.010 04:02:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:33.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:33.010 04:02:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:33.010 04:02:47 -- common/autotest_common.sh@10 -- # set +x 00:05:33.010 [2024-05-14 04:02:47.479068] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:33.010 [2024-05-14 04:02:47.479144] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3729195 ] 00:05:33.010 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.271 [2024-05-14 04:02:47.768829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.271 [2024-05-14 04:02:47.818898] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:33.271 [2024-05-14 04:02:47.819016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.843 04:02:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:33.843 04:02:48 -- common/autotest_common.sh@852 -- # return 0 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:33.843 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:33.843 INFO: shutting down applications... 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3729195 ]] 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3729195 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3729195 00:05:33.843 04:02:48 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:34.416 04:02:48 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:34.416 04:02:48 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:34.416 04:02:48 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3729195 00:05:34.416 04:02:48 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:34.416 04:02:48 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:34.416 04:02:48 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:34.416 04:02:48 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:34.416 SPDK target shutdown done 00:05:34.416 04:02:48 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:34.416 Success 00:05:34.416 00:05:34.416 real 0m1.427s 00:05:34.416 user 0m1.045s 00:05:34.416 sys 0m0.401s 00:05:34.416 04:02:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:34.416 04:02:48 -- common/autotest_common.sh@10 -- # set +x 00:05:34.416 ************************************ 00:05:34.416 END TEST json_config_extra_key 00:05:34.416 ************************************ 00:05:34.416 04:02:48 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:34.416 04:02:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:34.416 04:02:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:34.416 04:02:48 -- common/autotest_common.sh@10 -- # set +x 00:05:34.416 ************************************ 00:05:34.416 START TEST alias_rpc 00:05:34.416 ************************************ 00:05:34.416 04:02:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:34.416 * Looking for test storage... 00:05:34.416 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:34.416 04:02:48 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:34.416 04:02:48 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3729465 00:05:34.416 04:02:48 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3729465 00:05:34.416 04:02:48 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:34.416 04:02:48 -- common/autotest_common.sh@819 -- # '[' -z 3729465 ']' 00:05:34.416 04:02:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.416 04:02:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:34.416 04:02:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.416 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.416 04:02:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:34.416 04:02:48 -- common/autotest_common.sh@10 -- # set +x 00:05:34.416 [2024-05-14 04:02:48.958479] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:34.416 [2024-05-14 04:02:48.958561] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3729465 ] 00:05:34.416 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.677 [2024-05-14 04:02:49.022936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.677 [2024-05-14 04:02:49.095800] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.677 [2024-05-14 04:02:49.095933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.250 04:02:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:35.250 04:02:49 -- common/autotest_common.sh@852 -- # return 0 00:05:35.250 04:02:49 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:35.510 04:02:49 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3729465 00:05:35.510 04:02:49 -- common/autotest_common.sh@926 -- # '[' -z 3729465 ']' 00:05:35.510 04:02:49 -- common/autotest_common.sh@930 -- # kill -0 3729465 00:05:35.510 04:02:49 -- common/autotest_common.sh@931 -- # uname 00:05:35.510 04:02:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:35.510 04:02:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3729465 00:05:35.510 04:02:49 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:35.510 04:02:49 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:35.510 04:02:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3729465' 00:05:35.510 killing process with pid 3729465 00:05:35.510 04:02:49 -- common/autotest_common.sh@945 -- # kill 3729465 00:05:35.510 04:02:49 -- common/autotest_common.sh@950 -- # wait 3729465 00:05:35.771 00:05:35.771 real 0m1.341s 00:05:35.771 user 0m1.461s 00:05:35.771 sys 0m0.346s 00:05:35.771 04:02:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:35.771 04:02:50 -- common/autotest_common.sh@10 -- # set +x 00:05:35.771 ************************************ 00:05:35.771 END TEST alias_rpc 00:05:35.771 ************************************ 00:05:35.771 04:02:50 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:05:35.771 04:02:50 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:35.771 04:02:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:35.771 04:02:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:35.771 04:02:50 -- common/autotest_common.sh@10 -- # set +x 00:05:35.771 ************************************ 00:05:35.771 START TEST spdkcli_tcp 00:05:35.771 ************************************ 00:05:35.771 04:02:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:35.771 * Looking for test storage... 00:05:35.771 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:35.772 04:02:50 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:35.772 04:02:50 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:35.772 04:02:50 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:35.772 04:02:50 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:35.772 04:02:50 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:35.772 04:02:50 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:35.772 04:02:50 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:35.772 04:02:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:35.772 04:02:50 -- common/autotest_common.sh@10 -- # set +x 00:05:35.772 04:02:50 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3729703 00:05:35.772 04:02:50 -- spdkcli/tcp.sh@27 -- # waitforlisten 3729703 00:05:35.772 04:02:50 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:35.772 04:02:50 -- common/autotest_common.sh@819 -- # '[' -z 3729703 ']' 00:05:35.772 04:02:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:35.772 04:02:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:35.772 04:02:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:35.772 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:35.772 04:02:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:35.772 04:02:50 -- common/autotest_common.sh@10 -- # set +x 00:05:35.772 [2024-05-14 04:02:50.343765] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:35.772 [2024-05-14 04:02:50.343840] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3729703 ] 00:05:36.033 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.033 [2024-05-14 04:02:50.410064] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:36.033 [2024-05-14 04:02:50.483745] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:36.033 [2024-05-14 04:02:50.484157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:36.033 [2024-05-14 04:02:50.484160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.604 04:02:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:36.604 04:02:51 -- common/autotest_common.sh@852 -- # return 0 00:05:36.604 04:02:51 -- spdkcli/tcp.sh@31 -- # socat_pid=3730017 00:05:36.604 04:02:51 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:36.604 04:02:51 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:36.866 [ 00:05:36.866 "bdev_malloc_delete", 00:05:36.866 "bdev_malloc_create", 00:05:36.866 "bdev_null_resize", 00:05:36.866 "bdev_null_delete", 00:05:36.866 "bdev_null_create", 00:05:36.866 "bdev_nvme_cuse_unregister", 00:05:36.866 "bdev_nvme_cuse_register", 00:05:36.866 "bdev_opal_new_user", 00:05:36.866 "bdev_opal_set_lock_state", 00:05:36.866 "bdev_opal_delete", 00:05:36.866 "bdev_opal_get_info", 00:05:36.866 "bdev_opal_create", 00:05:36.866 "bdev_nvme_opal_revert", 00:05:36.866 "bdev_nvme_opal_init", 00:05:36.866 "bdev_nvme_send_cmd", 00:05:36.866 "bdev_nvme_get_path_iostat", 00:05:36.866 "bdev_nvme_get_mdns_discovery_info", 00:05:36.866 "bdev_nvme_stop_mdns_discovery", 00:05:36.866 "bdev_nvme_start_mdns_discovery", 00:05:36.866 "bdev_nvme_set_multipath_policy", 00:05:36.866 "bdev_nvme_set_preferred_path", 00:05:36.866 "bdev_nvme_get_io_paths", 00:05:36.866 "bdev_nvme_remove_error_injection", 00:05:36.866 "bdev_nvme_add_error_injection", 00:05:36.866 "bdev_nvme_get_discovery_info", 00:05:36.866 "bdev_nvme_stop_discovery", 00:05:36.866 "bdev_nvme_start_discovery", 00:05:36.866 "bdev_nvme_get_controller_health_info", 00:05:36.866 "bdev_nvme_disable_controller", 00:05:36.866 "bdev_nvme_enable_controller", 00:05:36.866 "bdev_nvme_reset_controller", 00:05:36.866 "bdev_nvme_get_transport_statistics", 00:05:36.866 "bdev_nvme_apply_firmware", 00:05:36.866 "bdev_nvme_detach_controller", 00:05:36.866 "bdev_nvme_get_controllers", 00:05:36.866 "bdev_nvme_attach_controller", 00:05:36.866 "bdev_nvme_set_hotplug", 00:05:36.866 "bdev_nvme_set_options", 00:05:36.866 "bdev_passthru_delete", 00:05:36.866 "bdev_passthru_create", 00:05:36.866 "bdev_lvol_grow_lvstore", 00:05:36.866 "bdev_lvol_get_lvols", 00:05:36.866 "bdev_lvol_get_lvstores", 00:05:36.866 "bdev_lvol_delete", 00:05:36.866 "bdev_lvol_set_read_only", 00:05:36.866 "bdev_lvol_resize", 00:05:36.866 "bdev_lvol_decouple_parent", 00:05:36.866 "bdev_lvol_inflate", 00:05:36.866 "bdev_lvol_rename", 00:05:36.866 "bdev_lvol_clone_bdev", 00:05:36.866 "bdev_lvol_clone", 00:05:36.866 "bdev_lvol_snapshot", 00:05:36.866 "bdev_lvol_create", 00:05:36.866 "bdev_lvol_delete_lvstore", 00:05:36.866 "bdev_lvol_rename_lvstore", 00:05:36.866 "bdev_lvol_create_lvstore", 00:05:36.866 "bdev_raid_set_options", 00:05:36.866 "bdev_raid_remove_base_bdev", 00:05:36.866 "bdev_raid_add_base_bdev", 00:05:36.866 "bdev_raid_delete", 00:05:36.866 "bdev_raid_create", 00:05:36.866 "bdev_raid_get_bdevs", 00:05:36.866 "bdev_error_inject_error", 00:05:36.866 "bdev_error_delete", 00:05:36.866 "bdev_error_create", 00:05:36.866 "bdev_split_delete", 00:05:36.866 "bdev_split_create", 00:05:36.866 "bdev_delay_delete", 00:05:36.866 "bdev_delay_create", 00:05:36.866 "bdev_delay_update_latency", 00:05:36.866 "bdev_zone_block_delete", 00:05:36.866 "bdev_zone_block_create", 00:05:36.866 "blobfs_create", 00:05:36.866 "blobfs_detect", 00:05:36.866 "blobfs_set_cache_size", 00:05:36.866 "bdev_aio_delete", 00:05:36.866 "bdev_aio_rescan", 00:05:36.866 "bdev_aio_create", 00:05:36.866 "bdev_ftl_set_property", 00:05:36.867 "bdev_ftl_get_properties", 00:05:36.867 "bdev_ftl_get_stats", 00:05:36.867 "bdev_ftl_unmap", 00:05:36.867 "bdev_ftl_unload", 00:05:36.867 "bdev_ftl_delete", 00:05:36.867 "bdev_ftl_load", 00:05:36.867 "bdev_ftl_create", 00:05:36.867 "bdev_virtio_attach_controller", 00:05:36.867 "bdev_virtio_scsi_get_devices", 00:05:36.867 "bdev_virtio_detach_controller", 00:05:36.867 "bdev_virtio_blk_set_hotplug", 00:05:36.867 "bdev_iscsi_delete", 00:05:36.867 "bdev_iscsi_create", 00:05:36.867 "bdev_iscsi_set_options", 00:05:36.867 "accel_error_inject_error", 00:05:36.867 "ioat_scan_accel_module", 00:05:36.867 "dsa_scan_accel_module", 00:05:36.867 "iaa_scan_accel_module", 00:05:36.867 "iscsi_set_options", 00:05:36.867 "iscsi_get_auth_groups", 00:05:36.867 "iscsi_auth_group_remove_secret", 00:05:36.867 "iscsi_auth_group_add_secret", 00:05:36.867 "iscsi_delete_auth_group", 00:05:36.867 "iscsi_create_auth_group", 00:05:36.867 "iscsi_set_discovery_auth", 00:05:36.867 "iscsi_get_options", 00:05:36.867 "iscsi_target_node_request_logout", 00:05:36.867 "iscsi_target_node_set_redirect", 00:05:36.867 "iscsi_target_node_set_auth", 00:05:36.867 "iscsi_target_node_add_lun", 00:05:36.867 "iscsi_get_connections", 00:05:36.867 "iscsi_portal_group_set_auth", 00:05:36.867 "iscsi_start_portal_group", 00:05:36.867 "iscsi_delete_portal_group", 00:05:36.867 "iscsi_create_portal_group", 00:05:36.867 "iscsi_get_portal_groups", 00:05:36.867 "iscsi_delete_target_node", 00:05:36.867 "iscsi_target_node_remove_pg_ig_maps", 00:05:36.867 "iscsi_target_node_add_pg_ig_maps", 00:05:36.867 "iscsi_create_target_node", 00:05:36.867 "iscsi_get_target_nodes", 00:05:36.867 "iscsi_delete_initiator_group", 00:05:36.867 "iscsi_initiator_group_remove_initiators", 00:05:36.867 "iscsi_initiator_group_add_initiators", 00:05:36.867 "iscsi_create_initiator_group", 00:05:36.867 "iscsi_get_initiator_groups", 00:05:36.867 "nvmf_set_crdt", 00:05:36.867 "nvmf_set_config", 00:05:36.867 "nvmf_set_max_subsystems", 00:05:36.867 "nvmf_subsystem_get_listeners", 00:05:36.867 "nvmf_subsystem_get_qpairs", 00:05:36.867 "nvmf_subsystem_get_controllers", 00:05:36.867 "nvmf_get_stats", 00:05:36.867 "nvmf_get_transports", 00:05:36.867 "nvmf_create_transport", 00:05:36.867 "nvmf_get_targets", 00:05:36.867 "nvmf_delete_target", 00:05:36.867 "nvmf_create_target", 00:05:36.867 "nvmf_subsystem_allow_any_host", 00:05:36.867 "nvmf_subsystem_remove_host", 00:05:36.867 "nvmf_subsystem_add_host", 00:05:36.867 "nvmf_subsystem_remove_ns", 00:05:36.867 "nvmf_subsystem_add_ns", 00:05:36.867 "nvmf_subsystem_listener_set_ana_state", 00:05:36.867 "nvmf_discovery_get_referrals", 00:05:36.867 "nvmf_discovery_remove_referral", 00:05:36.867 "nvmf_discovery_add_referral", 00:05:36.867 "nvmf_subsystem_remove_listener", 00:05:36.867 "nvmf_subsystem_add_listener", 00:05:36.867 "nvmf_delete_subsystem", 00:05:36.867 "nvmf_create_subsystem", 00:05:36.867 "nvmf_get_subsystems", 00:05:36.867 "env_dpdk_get_mem_stats", 00:05:36.867 "nbd_get_disks", 00:05:36.867 "nbd_stop_disk", 00:05:36.867 "nbd_start_disk", 00:05:36.867 "ublk_recover_disk", 00:05:36.867 "ublk_get_disks", 00:05:36.867 "ublk_stop_disk", 00:05:36.867 "ublk_start_disk", 00:05:36.867 "ublk_destroy_target", 00:05:36.867 "ublk_create_target", 00:05:36.867 "virtio_blk_create_transport", 00:05:36.867 "virtio_blk_get_transports", 00:05:36.867 "vhost_controller_set_coalescing", 00:05:36.867 "vhost_get_controllers", 00:05:36.867 "vhost_delete_controller", 00:05:36.867 "vhost_create_blk_controller", 00:05:36.867 "vhost_scsi_controller_remove_target", 00:05:36.867 "vhost_scsi_controller_add_target", 00:05:36.867 "vhost_start_scsi_controller", 00:05:36.867 "vhost_create_scsi_controller", 00:05:36.867 "thread_set_cpumask", 00:05:36.867 "framework_get_scheduler", 00:05:36.867 "framework_set_scheduler", 00:05:36.867 "framework_get_reactors", 00:05:36.867 "thread_get_io_channels", 00:05:36.867 "thread_get_pollers", 00:05:36.867 "thread_get_stats", 00:05:36.867 "framework_monitor_context_switch", 00:05:36.867 "spdk_kill_instance", 00:05:36.867 "log_enable_timestamps", 00:05:36.867 "log_get_flags", 00:05:36.867 "log_clear_flag", 00:05:36.867 "log_set_flag", 00:05:36.867 "log_get_level", 00:05:36.867 "log_set_level", 00:05:36.867 "log_get_print_level", 00:05:36.867 "log_set_print_level", 00:05:36.867 "framework_enable_cpumask_locks", 00:05:36.867 "framework_disable_cpumask_locks", 00:05:36.867 "framework_wait_init", 00:05:36.867 "framework_start_init", 00:05:36.867 "scsi_get_devices", 00:05:36.867 "bdev_get_histogram", 00:05:36.867 "bdev_enable_histogram", 00:05:36.867 "bdev_set_qos_limit", 00:05:36.867 "bdev_set_qd_sampling_period", 00:05:36.867 "bdev_get_bdevs", 00:05:36.867 "bdev_reset_iostat", 00:05:36.867 "bdev_get_iostat", 00:05:36.867 "bdev_examine", 00:05:36.867 "bdev_wait_for_examine", 00:05:36.867 "bdev_set_options", 00:05:36.867 "notify_get_notifications", 00:05:36.867 "notify_get_types", 00:05:36.867 "accel_get_stats", 00:05:36.867 "accel_set_options", 00:05:36.867 "accel_set_driver", 00:05:36.867 "accel_crypto_key_destroy", 00:05:36.867 "accel_crypto_keys_get", 00:05:36.867 "accel_crypto_key_create", 00:05:36.867 "accel_assign_opc", 00:05:36.867 "accel_get_module_info", 00:05:36.867 "accel_get_opc_assignments", 00:05:36.867 "vmd_rescan", 00:05:36.867 "vmd_remove_device", 00:05:36.867 "vmd_enable", 00:05:36.867 "sock_set_default_impl", 00:05:36.867 "sock_impl_set_options", 00:05:36.867 "sock_impl_get_options", 00:05:36.867 "iobuf_get_stats", 00:05:36.867 "iobuf_set_options", 00:05:36.867 "framework_get_pci_devices", 00:05:36.867 "framework_get_config", 00:05:36.867 "framework_get_subsystems", 00:05:36.867 "trace_get_info", 00:05:36.867 "trace_get_tpoint_group_mask", 00:05:36.867 "trace_disable_tpoint_group", 00:05:36.868 "trace_enable_tpoint_group", 00:05:36.868 "trace_clear_tpoint_mask", 00:05:36.868 "trace_set_tpoint_mask", 00:05:36.868 "spdk_get_version", 00:05:36.868 "rpc_get_methods" 00:05:36.868 ] 00:05:36.868 04:02:51 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:36.868 04:02:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:36.868 04:02:51 -- common/autotest_common.sh@10 -- # set +x 00:05:36.868 04:02:51 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:36.868 04:02:51 -- spdkcli/tcp.sh@38 -- # killprocess 3729703 00:05:36.868 04:02:51 -- common/autotest_common.sh@926 -- # '[' -z 3729703 ']' 00:05:36.868 04:02:51 -- common/autotest_common.sh@930 -- # kill -0 3729703 00:05:36.868 04:02:51 -- common/autotest_common.sh@931 -- # uname 00:05:36.868 04:02:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:36.868 04:02:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3729703 00:05:36.868 04:02:51 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:36.868 04:02:51 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:36.868 04:02:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3729703' 00:05:36.868 killing process with pid 3729703 00:05:36.868 04:02:51 -- common/autotest_common.sh@945 -- # kill 3729703 00:05:36.868 04:02:51 -- common/autotest_common.sh@950 -- # wait 3729703 00:05:37.129 00:05:37.129 real 0m1.383s 00:05:37.129 user 0m2.542s 00:05:37.129 sys 0m0.419s 00:05:37.129 04:02:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:37.129 04:02:51 -- common/autotest_common.sh@10 -- # set +x 00:05:37.129 ************************************ 00:05:37.129 END TEST spdkcli_tcp 00:05:37.129 ************************************ 00:05:37.129 04:02:51 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:37.129 04:02:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:37.129 04:02:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:37.129 04:02:51 -- common/autotest_common.sh@10 -- # set +x 00:05:37.129 ************************************ 00:05:37.129 START TEST dpdk_mem_utility 00:05:37.129 ************************************ 00:05:37.129 04:02:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:37.129 * Looking for test storage... 00:05:37.129 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:37.129 04:02:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:37.129 04:02:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3730082 00:05:37.129 04:02:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3730082 00:05:37.129 04:02:51 -- common/autotest_common.sh@819 -- # '[' -z 3730082 ']' 00:05:37.129 04:02:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:37.129 04:02:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:37.129 04:02:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:37.129 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:37.129 04:02:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:37.129 04:02:51 -- common/autotest_common.sh@10 -- # set +x 00:05:37.129 04:02:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:37.389 [2024-05-14 04:02:51.764078] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:37.389 [2024-05-14 04:02:51.764144] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3730082 ] 00:05:37.390 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.390 [2024-05-14 04:02:51.823897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.390 [2024-05-14 04:02:51.887984] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:37.390 [2024-05-14 04:02:51.888111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.961 04:02:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:37.961 04:02:52 -- common/autotest_common.sh@852 -- # return 0 00:05:37.961 04:02:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:37.961 04:02:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:37.961 04:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:37.961 04:02:52 -- common/autotest_common.sh@10 -- # set +x 00:05:37.961 { 00:05:37.961 "filename": "/tmp/spdk_mem_dump.txt" 00:05:37.961 } 00:05:37.961 04:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:37.961 04:02:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:38.222 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:38.222 1 heaps totaling size 814.000000 MiB 00:05:38.222 size: 814.000000 MiB heap id: 0 00:05:38.222 end heaps---------- 00:05:38.222 8 mempools totaling size 598.116089 MiB 00:05:38.222 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:38.222 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:38.222 size: 84.521057 MiB name: bdev_io_3730082 00:05:38.222 size: 51.011292 MiB name: evtpool_3730082 00:05:38.222 size: 50.003479 MiB name: msgpool_3730082 00:05:38.222 size: 21.763794 MiB name: PDU_Pool 00:05:38.222 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:38.222 size: 0.026123 MiB name: Session_Pool 00:05:38.222 end mempools------- 00:05:38.222 6 memzones totaling size 4.142822 MiB 00:05:38.222 size: 1.000366 MiB name: RG_ring_0_3730082 00:05:38.222 size: 1.000366 MiB name: RG_ring_1_3730082 00:05:38.222 size: 1.000366 MiB name: RG_ring_4_3730082 00:05:38.222 size: 1.000366 MiB name: RG_ring_5_3730082 00:05:38.222 size: 0.125366 MiB name: RG_ring_2_3730082 00:05:38.222 size: 0.015991 MiB name: RG_ring_3_3730082 00:05:38.222 end memzones------- 00:05:38.222 04:02:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:38.222 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:38.222 list of free elements. size: 12.519348 MiB 00:05:38.222 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:38.222 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:38.222 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:38.222 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:38.222 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:38.222 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:38.222 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:38.222 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:38.222 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:38.222 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:38.222 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:38.222 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:38.222 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:38.222 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:38.222 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:38.222 list of standard malloc elements. size: 199.218079 MiB 00:05:38.222 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:38.222 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:38.222 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:38.222 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:38.222 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:38.222 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:38.222 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:38.222 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:38.222 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:38.222 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:38.222 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:38.222 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:38.222 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:38.222 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:38.222 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:38.222 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:38.222 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:38.222 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:38.222 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:38.222 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:38.222 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:38.222 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:38.222 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:38.223 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:38.223 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:38.223 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:38.223 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:38.223 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:38.223 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:38.223 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:38.223 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:38.223 list of memzone associated elements. size: 602.262573 MiB 00:05:38.223 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:38.223 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:38.223 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:38.223 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:38.223 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:38.223 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3730082_0 00:05:38.223 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:38.223 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3730082_0 00:05:38.223 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:38.223 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3730082_0 00:05:38.223 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:38.223 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:38.223 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:38.223 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:38.223 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:38.223 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3730082 00:05:38.223 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:38.223 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3730082 00:05:38.223 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:38.223 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3730082 00:05:38.223 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:38.223 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:38.223 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:38.223 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:38.223 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:38.223 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:38.223 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:38.223 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:38.223 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:38.223 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3730082 00:05:38.223 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:38.223 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3730082 00:05:38.223 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:38.223 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3730082 00:05:38.223 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:38.223 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3730082 00:05:38.223 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:38.223 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3730082 00:05:38.223 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:38.223 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:38.223 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:38.223 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:38.223 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:38.223 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:38.223 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:38.223 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3730082 00:05:38.223 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:38.223 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:38.223 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:38.223 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:38.223 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:38.223 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3730082 00:05:38.223 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:38.223 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:38.223 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:38.223 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3730082 00:05:38.223 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:38.223 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3730082 00:05:38.223 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:38.223 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:38.223 04:02:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:38.223 04:02:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3730082 00:05:38.223 04:02:52 -- common/autotest_common.sh@926 -- # '[' -z 3730082 ']' 00:05:38.223 04:02:52 -- common/autotest_common.sh@930 -- # kill -0 3730082 00:05:38.223 04:02:52 -- common/autotest_common.sh@931 -- # uname 00:05:38.223 04:02:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:38.223 04:02:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3730082 00:05:38.223 04:02:52 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:38.223 04:02:52 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:38.223 04:02:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3730082' 00:05:38.223 killing process with pid 3730082 00:05:38.223 04:02:52 -- common/autotest_common.sh@945 -- # kill 3730082 00:05:38.223 04:02:52 -- common/autotest_common.sh@950 -- # wait 3730082 00:05:38.484 00:05:38.484 real 0m1.264s 00:05:38.484 user 0m1.337s 00:05:38.484 sys 0m0.348s 00:05:38.484 04:02:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:38.484 04:02:52 -- common/autotest_common.sh@10 -- # set +x 00:05:38.484 ************************************ 00:05:38.484 END TEST dpdk_mem_utility 00:05:38.484 ************************************ 00:05:38.484 04:02:52 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:38.484 04:02:52 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:38.484 04:02:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:38.484 04:02:52 -- common/autotest_common.sh@10 -- # set +x 00:05:38.484 ************************************ 00:05:38.484 START TEST event 00:05:38.484 ************************************ 00:05:38.484 04:02:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:38.484 * Looking for test storage... 00:05:38.484 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:38.484 04:02:53 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:38.484 04:02:53 -- bdev/nbd_common.sh@6 -- # set -e 00:05:38.484 04:02:53 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:38.484 04:02:53 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:38.484 04:02:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:38.484 04:02:53 -- common/autotest_common.sh@10 -- # set +x 00:05:38.484 ************************************ 00:05:38.484 START TEST event_perf 00:05:38.484 ************************************ 00:05:38.484 04:02:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:38.484 Running I/O for 1 seconds...[2024-05-14 04:02:53.048983] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:38.484 [2024-05-14 04:02:53.049087] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3730475 ] 00:05:38.745 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.745 [2024-05-14 04:02:53.111940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:38.745 [2024-05-14 04:02:53.175924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:38.745 [2024-05-14 04:02:53.176044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:38.745 [2024-05-14 04:02:53.176201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.745 [2024-05-14 04:02:53.176201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:39.688 Running I/O for 1 seconds... 00:05:39.688 lcore 0: 172502 00:05:39.688 lcore 1: 172502 00:05:39.688 lcore 2: 172502 00:05:39.688 lcore 3: 172505 00:05:39.688 done. 00:05:39.688 00:05:39.688 real 0m1.201s 00:05:39.688 user 0m4.132s 00:05:39.688 sys 0m0.065s 00:05:39.688 04:02:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:39.688 04:02:54 -- common/autotest_common.sh@10 -- # set +x 00:05:39.688 ************************************ 00:05:39.688 END TEST event_perf 00:05:39.688 ************************************ 00:05:39.688 04:02:54 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:39.688 04:02:54 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:05:39.688 04:02:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:39.688 04:02:54 -- common/autotest_common.sh@10 -- # set +x 00:05:39.688 ************************************ 00:05:39.688 START TEST event_reactor 00:05:39.688 ************************************ 00:05:39.688 04:02:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:39.948 [2024-05-14 04:02:54.293630] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:39.948 [2024-05-14 04:02:54.293736] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3730828 ] 00:05:39.948 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.948 [2024-05-14 04:02:54.356629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.948 [2024-05-14 04:02:54.416065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.891 test_start 00:05:40.891 oneshot 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 tick 250 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 tick 250 00:05:40.891 tick 500 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 tick 250 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 test_end 00:05:40.891 00:05:40.891 real 0m1.194s 00:05:40.891 user 0m1.125s 00:05:40.891 sys 0m0.065s 00:05:40.891 04:02:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:40.891 04:02:55 -- common/autotest_common.sh@10 -- # set +x 00:05:40.891 ************************************ 00:05:40.891 END TEST event_reactor 00:05:40.891 ************************************ 00:05:41.151 04:02:55 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:41.151 04:02:55 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:05:41.151 04:02:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:41.151 04:02:55 -- common/autotest_common.sh@10 -- # set +x 00:05:41.151 ************************************ 00:05:41.151 START TEST event_reactor_perf 00:05:41.151 ************************************ 00:05:41.151 04:02:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:41.151 [2024-05-14 04:02:55.533227] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:41.151 [2024-05-14 04:02:55.533347] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3730977 ] 00:05:41.151 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.151 [2024-05-14 04:02:55.596269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.151 [2024-05-14 04:02:55.660803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.537 test_start 00:05:42.537 test_end 00:05:42.537 Performance: 366498 events per second 00:05:42.537 00:05:42.537 real 0m1.199s 00:05:42.537 user 0m1.131s 00:05:42.537 sys 0m0.065s 00:05:42.537 04:02:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:42.537 04:02:56 -- common/autotest_common.sh@10 -- # set +x 00:05:42.537 ************************************ 00:05:42.537 END TEST event_reactor_perf 00:05:42.537 ************************************ 00:05:42.537 04:02:56 -- event/event.sh@49 -- # uname -s 00:05:42.537 04:02:56 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:42.537 04:02:56 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:42.537 04:02:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:42.537 04:02:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:42.537 04:02:56 -- common/autotest_common.sh@10 -- # set +x 00:05:42.537 ************************************ 00:05:42.537 START TEST event_scheduler 00:05:42.537 ************************************ 00:05:42.537 04:02:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:42.537 * Looking for test storage... 00:05:42.537 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:05:42.537 04:02:56 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:42.537 04:02:56 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3731241 00:05:42.537 04:02:56 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:42.537 04:02:56 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:42.537 04:02:56 -- scheduler/scheduler.sh@37 -- # waitforlisten 3731241 00:05:42.537 04:02:56 -- common/autotest_common.sh@819 -- # '[' -z 3731241 ']' 00:05:42.537 04:02:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:42.537 04:02:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:42.537 04:02:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:42.537 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:42.537 04:02:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:42.537 04:02:56 -- common/autotest_common.sh@10 -- # set +x 00:05:42.537 [2024-05-14 04:02:56.902268] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:42.537 [2024-05-14 04:02:56.902336] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3731241 ] 00:05:42.537 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.537 [2024-05-14 04:02:56.959576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:42.537 [2024-05-14 04:02:57.022761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.537 [2024-05-14 04:02:57.022923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:42.537 [2024-05-14 04:02:57.023080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:42.537 [2024-05-14 04:02:57.023081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:43.110 04:02:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:43.110 04:02:57 -- common/autotest_common.sh@852 -- # return 0 00:05:43.110 04:02:57 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:43.110 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.110 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.110 POWER: Env isn't set yet! 00:05:43.110 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:43.110 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:05:43.110 POWER: Cannot set governor of lcore 0 to userspace 00:05:43.110 POWER: Attempting to initialise PSTAT power management... 00:05:43.110 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:43.371 POWER: Initialized successfully for lcore 0 power management 00:05:43.371 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:43.371 POWER: Initialized successfully for lcore 1 power management 00:05:43.371 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:43.371 POWER: Initialized successfully for lcore 2 power management 00:05:43.371 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:43.371 POWER: Initialized successfully for lcore 3 power management 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 [2024-05-14 04:02:57.785303] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:43.371 04:02:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:43.371 04:02:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 ************************************ 00:05:43.371 START TEST scheduler_create_thread 00:05:43.371 ************************************ 00:05:43.371 04:02:57 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 2 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 3 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 4 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 5 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 6 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 7 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 8 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:43.371 9 00:05:43.371 04:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:43.371 04:02:57 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:43.371 04:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:43.371 04:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:44.757 10 00:05:44.757 04:02:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:44.757 04:02:59 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:44.757 04:02:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:44.757 04:02:59 -- common/autotest_common.sh@10 -- # set +x 00:05:46.200 04:03:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:46.200 04:03:00 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:46.200 04:03:00 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:46.200 04:03:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:46.200 04:03:00 -- common/autotest_common.sh@10 -- # set +x 00:05:46.795 04:03:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:46.795 04:03:01 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:46.795 04:03:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:46.795 04:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:47.366 04:03:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:47.366 04:03:01 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:47.366 04:03:01 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:47.366 04:03:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:47.366 04:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:48.307 04:03:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:48.307 00:05:48.307 real 0m4.797s 00:05:48.307 user 0m0.023s 00:05:48.307 sys 0m0.008s 00:05:48.307 04:03:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:48.307 04:03:02 -- common/autotest_common.sh@10 -- # set +x 00:05:48.307 ************************************ 00:05:48.307 END TEST scheduler_create_thread 00:05:48.307 ************************************ 00:05:48.307 04:03:02 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:48.307 04:03:02 -- scheduler/scheduler.sh@46 -- # killprocess 3731241 00:05:48.307 04:03:02 -- common/autotest_common.sh@926 -- # '[' -z 3731241 ']' 00:05:48.307 04:03:02 -- common/autotest_common.sh@930 -- # kill -0 3731241 00:05:48.307 04:03:02 -- common/autotest_common.sh@931 -- # uname 00:05:48.307 04:03:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:48.307 04:03:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3731241 00:05:48.307 04:03:02 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:05:48.307 04:03:02 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:05:48.307 04:03:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3731241' 00:05:48.307 killing process with pid 3731241 00:05:48.307 04:03:02 -- common/autotest_common.sh@945 -- # kill 3731241 00:05:48.307 04:03:02 -- common/autotest_common.sh@950 -- # wait 3731241 00:05:48.307 [2024-05-14 04:03:02.871261] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:48.568 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:05:48.568 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:48.568 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:05:48.568 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:48.568 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:05:48.568 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:48.568 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:05:48.568 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:48.568 00:05:48.568 real 0m6.271s 00:05:48.568 user 0m14.090s 00:05:48.568 sys 0m0.332s 00:05:48.568 04:03:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:48.568 04:03:03 -- common/autotest_common.sh@10 -- # set +x 00:05:48.568 ************************************ 00:05:48.568 END TEST event_scheduler 00:05:48.568 ************************************ 00:05:48.568 04:03:03 -- event/event.sh@51 -- # modprobe -n nbd 00:05:48.568 04:03:03 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:48.568 04:03:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:48.568 04:03:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:48.568 04:03:03 -- common/autotest_common.sh@10 -- # set +x 00:05:48.568 ************************************ 00:05:48.568 START TEST app_repeat 00:05:48.568 ************************************ 00:05:48.568 04:03:03 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:05:48.568 04:03:03 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:48.568 04:03:03 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:48.568 04:03:03 -- event/event.sh@13 -- # local nbd_list 00:05:48.568 04:03:03 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:48.568 04:03:03 -- event/event.sh@14 -- # local bdev_list 00:05:48.568 04:03:03 -- event/event.sh@15 -- # local repeat_times=4 00:05:48.568 04:03:03 -- event/event.sh@17 -- # modprobe nbd 00:05:48.568 04:03:03 -- event/event.sh@19 -- # repeat_pid=3732759 00:05:48.568 04:03:03 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:48.568 04:03:03 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:48.568 04:03:03 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3732759' 00:05:48.568 Process app_repeat pid: 3732759 00:05:48.568 04:03:03 -- event/event.sh@23 -- # for i in {0..2} 00:05:48.568 04:03:03 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:48.568 spdk_app_start Round 0 00:05:48.568 04:03:03 -- event/event.sh@25 -- # waitforlisten 3732759 /var/tmp/spdk-nbd.sock 00:05:48.568 04:03:03 -- common/autotest_common.sh@819 -- # '[' -z 3732759 ']' 00:05:48.568 04:03:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:48.568 04:03:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:48.568 04:03:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:48.568 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:48.568 04:03:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:48.568 04:03:03 -- common/autotest_common.sh@10 -- # set +x 00:05:48.568 [2024-05-14 04:03:03.121325] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:48.568 [2024-05-14 04:03:03.121418] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3732759 ] 00:05:48.568 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.828 [2024-05-14 04:03:03.185778] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:48.828 [2024-05-14 04:03:03.256373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:48.828 [2024-05-14 04:03:03.256386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.409 04:03:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:49.409 04:03:03 -- common/autotest_common.sh@852 -- # return 0 00:05:49.409 04:03:03 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:49.670 Malloc0 00:05:49.670 04:03:04 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:49.670 Malloc1 00:05:49.670 04:03:04 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@12 -- # local i 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:49.670 04:03:04 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:49.930 /dev/nbd0 00:05:49.930 04:03:04 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:49.930 04:03:04 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:49.930 04:03:04 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:05:49.930 04:03:04 -- common/autotest_common.sh@857 -- # local i 00:05:49.930 04:03:04 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:49.930 04:03:04 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:49.930 04:03:04 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:05:49.930 04:03:04 -- common/autotest_common.sh@861 -- # break 00:05:49.930 04:03:04 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:49.930 04:03:04 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:49.930 04:03:04 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:49.930 1+0 records in 00:05:49.930 1+0 records out 00:05:49.930 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000279144 s, 14.7 MB/s 00:05:49.930 04:03:04 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:49.930 04:03:04 -- common/autotest_common.sh@874 -- # size=4096 00:05:49.930 04:03:04 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:49.930 04:03:04 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:49.930 04:03:04 -- common/autotest_common.sh@877 -- # return 0 00:05:49.930 04:03:04 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:49.930 04:03:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:49.930 04:03:04 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:50.191 /dev/nbd1 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:50.191 04:03:04 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:05:50.191 04:03:04 -- common/autotest_common.sh@857 -- # local i 00:05:50.191 04:03:04 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:50.191 04:03:04 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:50.191 04:03:04 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:05:50.191 04:03:04 -- common/autotest_common.sh@861 -- # break 00:05:50.191 04:03:04 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:50.191 04:03:04 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:50.191 04:03:04 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:50.191 1+0 records in 00:05:50.191 1+0 records out 00:05:50.191 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000312068 s, 13.1 MB/s 00:05:50.191 04:03:04 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:50.191 04:03:04 -- common/autotest_common.sh@874 -- # size=4096 00:05:50.191 04:03:04 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:50.191 04:03:04 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:50.191 04:03:04 -- common/autotest_common.sh@877 -- # return 0 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:50.191 { 00:05:50.191 "nbd_device": "/dev/nbd0", 00:05:50.191 "bdev_name": "Malloc0" 00:05:50.191 }, 00:05:50.191 { 00:05:50.191 "nbd_device": "/dev/nbd1", 00:05:50.191 "bdev_name": "Malloc1" 00:05:50.191 } 00:05:50.191 ]' 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:50.191 { 00:05:50.191 "nbd_device": "/dev/nbd0", 00:05:50.191 "bdev_name": "Malloc0" 00:05:50.191 }, 00:05:50.191 { 00:05:50.191 "nbd_device": "/dev/nbd1", 00:05:50.191 "bdev_name": "Malloc1" 00:05:50.191 } 00:05:50.191 ]' 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:50.191 04:03:04 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:50.191 /dev/nbd1' 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:50.452 /dev/nbd1' 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@65 -- # count=2 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@95 -- # count=2 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:50.452 256+0 records in 00:05:50.452 256+0 records out 00:05:50.452 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012448 s, 84.2 MB/s 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:50.452 256+0 records in 00:05:50.452 256+0 records out 00:05:50.452 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169239 s, 62.0 MB/s 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:50.452 256+0 records in 00:05:50.452 256+0 records out 00:05:50.452 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353427 s, 29.7 MB/s 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@51 -- # local i 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:50.452 04:03:04 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@41 -- # break 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@45 -- # return 0 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@41 -- # break 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@45 -- # return 0 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:50.712 04:03:05 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@65 -- # true 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@65 -- # count=0 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@104 -- # count=0 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:50.972 04:03:05 -- bdev/nbd_common.sh@109 -- # return 0 00:05:50.972 04:03:05 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:51.233 04:03:05 -- event/event.sh@35 -- # sleep 3 00:05:51.233 [2024-05-14 04:03:05.756372] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:51.233 [2024-05-14 04:03:05.817270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:51.233 [2024-05-14 04:03:05.817272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.492 [2024-05-14 04:03:05.848722] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:51.492 [2024-05-14 04:03:05.848754] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:54.792 04:03:08 -- event/event.sh@23 -- # for i in {0..2} 00:05:54.792 04:03:08 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:54.792 spdk_app_start Round 1 00:05:54.792 04:03:08 -- event/event.sh@25 -- # waitforlisten 3732759 /var/tmp/spdk-nbd.sock 00:05:54.792 04:03:08 -- common/autotest_common.sh@819 -- # '[' -z 3732759 ']' 00:05:54.792 04:03:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:54.792 04:03:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:54.792 04:03:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:54.792 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:54.792 04:03:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:54.792 04:03:08 -- common/autotest_common.sh@10 -- # set +x 00:05:54.792 04:03:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:54.792 04:03:08 -- common/autotest_common.sh@852 -- # return 0 00:05:54.792 04:03:08 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:54.792 Malloc0 00:05:54.792 04:03:08 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:54.792 Malloc1 00:05:54.792 04:03:09 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@12 -- # local i 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:54.792 /dev/nbd0 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:54.792 04:03:09 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:05:54.792 04:03:09 -- common/autotest_common.sh@857 -- # local i 00:05:54.792 04:03:09 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:54.792 04:03:09 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:54.792 04:03:09 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:05:54.792 04:03:09 -- common/autotest_common.sh@861 -- # break 00:05:54.792 04:03:09 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:54.792 04:03:09 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:54.792 04:03:09 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:54.792 1+0 records in 00:05:54.792 1+0 records out 00:05:54.792 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000227804 s, 18.0 MB/s 00:05:54.792 04:03:09 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:54.792 04:03:09 -- common/autotest_common.sh@874 -- # size=4096 00:05:54.792 04:03:09 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:54.792 04:03:09 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:54.792 04:03:09 -- common/autotest_common.sh@877 -- # return 0 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:54.792 04:03:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:55.052 /dev/nbd1 00:05:55.052 04:03:09 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:55.052 04:03:09 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:55.052 04:03:09 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:05:55.052 04:03:09 -- common/autotest_common.sh@857 -- # local i 00:05:55.052 04:03:09 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:55.052 04:03:09 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:55.052 04:03:09 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:05:55.052 04:03:09 -- common/autotest_common.sh@861 -- # break 00:05:55.052 04:03:09 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:55.052 04:03:09 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:55.052 04:03:09 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:55.052 1+0 records in 00:05:55.052 1+0 records out 00:05:55.052 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000270953 s, 15.1 MB/s 00:05:55.052 04:03:09 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:55.052 04:03:09 -- common/autotest_common.sh@874 -- # size=4096 00:05:55.052 04:03:09 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:55.052 04:03:09 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:55.052 04:03:09 -- common/autotest_common.sh@877 -- # return 0 00:05:55.052 04:03:09 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:55.052 04:03:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:55.052 04:03:09 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:55.052 04:03:09 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.052 04:03:09 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:55.052 04:03:09 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:55.052 { 00:05:55.052 "nbd_device": "/dev/nbd0", 00:05:55.052 "bdev_name": "Malloc0" 00:05:55.052 }, 00:05:55.052 { 00:05:55.052 "nbd_device": "/dev/nbd1", 00:05:55.052 "bdev_name": "Malloc1" 00:05:55.052 } 00:05:55.052 ]' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:55.313 { 00:05:55.313 "nbd_device": "/dev/nbd0", 00:05:55.313 "bdev_name": "Malloc0" 00:05:55.313 }, 00:05:55.313 { 00:05:55.313 "nbd_device": "/dev/nbd1", 00:05:55.313 "bdev_name": "Malloc1" 00:05:55.313 } 00:05:55.313 ]' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:55.313 /dev/nbd1' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:55.313 /dev/nbd1' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@65 -- # count=2 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@95 -- # count=2 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:55.313 256+0 records in 00:05:55.313 256+0 records out 00:05:55.313 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116149 s, 90.3 MB/s 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:55.313 256+0 records in 00:05:55.313 256+0 records out 00:05:55.313 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177529 s, 59.1 MB/s 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:55.313 256+0 records in 00:05:55.313 256+0 records out 00:05:55.313 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172956 s, 60.6 MB/s 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@51 -- # local i 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:55.313 04:03:09 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@41 -- # break 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@45 -- # return 0 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:55.574 04:03:09 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@41 -- # break 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@45 -- # return 0 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.574 04:03:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@65 -- # true 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@65 -- # count=0 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@104 -- # count=0 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:55.834 04:03:10 -- bdev/nbd_common.sh@109 -- # return 0 00:05:55.834 04:03:10 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:56.095 04:03:10 -- event/event.sh@35 -- # sleep 3 00:05:56.095 [2024-05-14 04:03:10.610877] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:56.095 [2024-05-14 04:03:10.671954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:56.095 [2024-05-14 04:03:10.671957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.356 [2024-05-14 04:03:10.703398] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:56.356 [2024-05-14 04:03:10.703431] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:58.900 04:03:13 -- event/event.sh@23 -- # for i in {0..2} 00:05:58.900 04:03:13 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:58.900 spdk_app_start Round 2 00:05:58.900 04:03:13 -- event/event.sh@25 -- # waitforlisten 3732759 /var/tmp/spdk-nbd.sock 00:05:58.900 04:03:13 -- common/autotest_common.sh@819 -- # '[' -z 3732759 ']' 00:05:58.900 04:03:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:58.900 04:03:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:58.900 04:03:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:58.900 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:58.900 04:03:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:58.900 04:03:13 -- common/autotest_common.sh@10 -- # set +x 00:05:59.169 04:03:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:59.169 04:03:13 -- common/autotest_common.sh@852 -- # return 0 00:05:59.169 04:03:13 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:59.433 Malloc0 00:05:59.433 04:03:13 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:59.433 Malloc1 00:05:59.433 04:03:13 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@12 -- # local i 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:59.433 04:03:13 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:59.693 /dev/nbd0 00:05:59.693 04:03:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:59.693 04:03:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:59.693 04:03:14 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:05:59.693 04:03:14 -- common/autotest_common.sh@857 -- # local i 00:05:59.693 04:03:14 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:59.693 04:03:14 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:59.693 04:03:14 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:05:59.693 04:03:14 -- common/autotest_common.sh@861 -- # break 00:05:59.693 04:03:14 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:59.693 04:03:14 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:59.693 04:03:14 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:59.693 1+0 records in 00:05:59.693 1+0 records out 00:05:59.693 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000262524 s, 15.6 MB/s 00:05:59.693 04:03:14 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.693 04:03:14 -- common/autotest_common.sh@874 -- # size=4096 00:05:59.693 04:03:14 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.693 04:03:14 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:59.693 04:03:14 -- common/autotest_common.sh@877 -- # return 0 00:05:59.693 04:03:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:59.693 04:03:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:59.693 04:03:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:59.954 /dev/nbd1 00:05:59.954 04:03:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:59.954 04:03:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:59.954 04:03:14 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:05:59.954 04:03:14 -- common/autotest_common.sh@857 -- # local i 00:05:59.954 04:03:14 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:59.954 04:03:14 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:59.954 04:03:14 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:05:59.954 04:03:14 -- common/autotest_common.sh@861 -- # break 00:05:59.954 04:03:14 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:59.955 04:03:14 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:59.955 04:03:14 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:59.955 1+0 records in 00:05:59.955 1+0 records out 00:05:59.955 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000286338 s, 14.3 MB/s 00:05:59.955 04:03:14 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.955 04:03:14 -- common/autotest_common.sh@874 -- # size=4096 00:05:59.955 04:03:14 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.955 04:03:14 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:59.955 04:03:14 -- common/autotest_common.sh@877 -- # return 0 00:05:59.955 04:03:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:59.955 04:03:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:59.955 04:03:14 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:59.955 04:03:14 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:59.955 04:03:14 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:59.955 04:03:14 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:59.955 { 00:05:59.955 "nbd_device": "/dev/nbd0", 00:05:59.955 "bdev_name": "Malloc0" 00:05:59.955 }, 00:05:59.955 { 00:05:59.955 "nbd_device": "/dev/nbd1", 00:05:59.955 "bdev_name": "Malloc1" 00:05:59.955 } 00:05:59.955 ]' 00:05:59.955 04:03:14 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:59.955 { 00:05:59.955 "nbd_device": "/dev/nbd0", 00:05:59.955 "bdev_name": "Malloc0" 00:05:59.955 }, 00:05:59.955 { 00:05:59.955 "nbd_device": "/dev/nbd1", 00:05:59.955 "bdev_name": "Malloc1" 00:05:59.955 } 00:05:59.955 ]' 00:05:59.955 04:03:14 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:00.216 /dev/nbd1' 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:00.216 /dev/nbd1' 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@65 -- # count=2 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@95 -- # count=2 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:00.216 256+0 records in 00:06:00.216 256+0 records out 00:06:00.216 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115249 s, 91.0 MB/s 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:00.216 256+0 records in 00:06:00.216 256+0 records out 00:06:00.216 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173438 s, 60.5 MB/s 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:00.216 256+0 records in 00:06:00.216 256+0 records out 00:06:00.216 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167732 s, 62.5 MB/s 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@51 -- # local i 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:00.216 04:03:14 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@41 -- # break 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@45 -- # return 0 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@41 -- # break 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@45 -- # return 0 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.478 04:03:14 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@65 -- # true 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@65 -- # count=0 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@104 -- # count=0 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:00.739 04:03:15 -- bdev/nbd_common.sh@109 -- # return 0 00:06:00.739 04:03:15 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:01.001 04:03:15 -- event/event.sh@35 -- # sleep 3 00:06:01.001 [2024-05-14 04:03:15.488307] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:01.001 [2024-05-14 04:03:15.549885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:01.001 [2024-05-14 04:03:15.549888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.001 [2024-05-14 04:03:15.581317] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:01.001 [2024-05-14 04:03:15.581349] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:04.302 04:03:18 -- event/event.sh@38 -- # waitforlisten 3732759 /var/tmp/spdk-nbd.sock 00:06:04.302 04:03:18 -- common/autotest_common.sh@819 -- # '[' -z 3732759 ']' 00:06:04.303 04:03:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:04.303 04:03:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:04.303 04:03:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:04.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:04.303 04:03:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:04.303 04:03:18 -- common/autotest_common.sh@10 -- # set +x 00:06:04.303 04:03:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:04.303 04:03:18 -- common/autotest_common.sh@852 -- # return 0 00:06:04.303 04:03:18 -- event/event.sh@39 -- # killprocess 3732759 00:06:04.303 04:03:18 -- common/autotest_common.sh@926 -- # '[' -z 3732759 ']' 00:06:04.303 04:03:18 -- common/autotest_common.sh@930 -- # kill -0 3732759 00:06:04.303 04:03:18 -- common/autotest_common.sh@931 -- # uname 00:06:04.303 04:03:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:04.303 04:03:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3732759 00:06:04.303 04:03:18 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:04.303 04:03:18 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:04.303 04:03:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3732759' 00:06:04.303 killing process with pid 3732759 00:06:04.303 04:03:18 -- common/autotest_common.sh@945 -- # kill 3732759 00:06:04.303 04:03:18 -- common/autotest_common.sh@950 -- # wait 3732759 00:06:04.303 spdk_app_start is called in Round 0. 00:06:04.303 Shutdown signal received, stop current app iteration 00:06:04.303 Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 reinitialization... 00:06:04.303 spdk_app_start is called in Round 1. 00:06:04.303 Shutdown signal received, stop current app iteration 00:06:04.303 Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 reinitialization... 00:06:04.303 spdk_app_start is called in Round 2. 00:06:04.303 Shutdown signal received, stop current app iteration 00:06:04.303 Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 reinitialization... 00:06:04.303 spdk_app_start is called in Round 3. 00:06:04.303 Shutdown signal received, stop current app iteration 00:06:04.303 04:03:18 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:04.303 04:03:18 -- event/event.sh@42 -- # return 0 00:06:04.303 00:06:04.303 real 0m15.589s 00:06:04.303 user 0m33.582s 00:06:04.303 sys 0m2.126s 00:06:04.303 04:03:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:04.303 04:03:18 -- common/autotest_common.sh@10 -- # set +x 00:06:04.303 ************************************ 00:06:04.303 END TEST app_repeat 00:06:04.303 ************************************ 00:06:04.303 04:03:18 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:04.303 04:03:18 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:04.303 04:03:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:04.303 04:03:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:04.303 04:03:18 -- common/autotest_common.sh@10 -- # set +x 00:06:04.303 ************************************ 00:06:04.303 START TEST cpu_locks 00:06:04.303 ************************************ 00:06:04.303 04:03:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:04.303 * Looking for test storage... 00:06:04.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:04.303 04:03:18 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:04.303 04:03:18 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:04.303 04:03:18 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:04.303 04:03:18 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:04.303 04:03:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:04.303 04:03:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:04.303 04:03:18 -- common/autotest_common.sh@10 -- # set +x 00:06:04.303 ************************************ 00:06:04.303 START TEST default_locks 00:06:04.303 ************************************ 00:06:04.303 04:03:18 -- common/autotest_common.sh@1104 -- # default_locks 00:06:04.303 04:03:18 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3736573 00:06:04.303 04:03:18 -- event/cpu_locks.sh@47 -- # waitforlisten 3736573 00:06:04.303 04:03:18 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:04.303 04:03:18 -- common/autotest_common.sh@819 -- # '[' -z 3736573 ']' 00:06:04.303 04:03:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:04.303 04:03:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:04.303 04:03:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:04.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:04.303 04:03:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:04.303 04:03:18 -- common/autotest_common.sh@10 -- # set +x 00:06:04.303 [2024-05-14 04:03:18.880398] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:04.303 [2024-05-14 04:03:18.880474] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3736573 ] 00:06:04.564 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.564 [2024-05-14 04:03:18.945944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.564 [2024-05-14 04:03:19.019160] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:04.564 [2024-05-14 04:03:19.019312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.134 04:03:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:05.134 04:03:19 -- common/autotest_common.sh@852 -- # return 0 00:06:05.134 04:03:19 -- event/cpu_locks.sh@49 -- # locks_exist 3736573 00:06:05.134 04:03:19 -- event/cpu_locks.sh@22 -- # lslocks -p 3736573 00:06:05.134 04:03:19 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:05.394 lslocks: write error 00:06:05.394 04:03:19 -- event/cpu_locks.sh@50 -- # killprocess 3736573 00:06:05.655 04:03:19 -- common/autotest_common.sh@926 -- # '[' -z 3736573 ']' 00:06:05.655 04:03:19 -- common/autotest_common.sh@930 -- # kill -0 3736573 00:06:05.655 04:03:19 -- common/autotest_common.sh@931 -- # uname 00:06:05.655 04:03:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:05.655 04:03:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3736573 00:06:05.655 04:03:20 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:05.655 04:03:20 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:05.655 04:03:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3736573' 00:06:05.655 killing process with pid 3736573 00:06:05.655 04:03:20 -- common/autotest_common.sh@945 -- # kill 3736573 00:06:05.655 04:03:20 -- common/autotest_common.sh@950 -- # wait 3736573 00:06:05.916 04:03:20 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3736573 00:06:05.916 04:03:20 -- common/autotest_common.sh@640 -- # local es=0 00:06:05.916 04:03:20 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 3736573 00:06:05.916 04:03:20 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:06:05.916 04:03:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:05.916 04:03:20 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:06:05.916 04:03:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:05.916 04:03:20 -- common/autotest_common.sh@643 -- # waitforlisten 3736573 00:06:05.916 04:03:20 -- common/autotest_common.sh@819 -- # '[' -z 3736573 ']' 00:06:05.916 04:03:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.916 04:03:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:05.916 04:03:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.916 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.916 04:03:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:05.916 04:03:20 -- common/autotest_common.sh@10 -- # set +x 00:06:05.916 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (3736573) - No such process 00:06:05.916 ERROR: process (pid: 3736573) is no longer running 00:06:05.916 04:03:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:05.916 04:03:20 -- common/autotest_common.sh@852 -- # return 1 00:06:05.916 04:03:20 -- common/autotest_common.sh@643 -- # es=1 00:06:05.916 04:03:20 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:05.916 04:03:20 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:05.916 04:03:20 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:05.916 04:03:20 -- event/cpu_locks.sh@54 -- # no_locks 00:06:05.916 04:03:20 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:05.916 04:03:20 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:05.916 04:03:20 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:05.916 00:06:05.916 real 0m1.432s 00:06:05.916 user 0m1.532s 00:06:05.916 sys 0m0.460s 00:06:05.916 04:03:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:05.916 04:03:20 -- common/autotest_common.sh@10 -- # set +x 00:06:05.916 ************************************ 00:06:05.916 END TEST default_locks 00:06:05.916 ************************************ 00:06:05.916 04:03:20 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:05.916 04:03:20 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:05.916 04:03:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:05.916 04:03:20 -- common/autotest_common.sh@10 -- # set +x 00:06:05.916 ************************************ 00:06:05.916 START TEST default_locks_via_rpc 00:06:05.916 ************************************ 00:06:05.916 04:03:20 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:06:05.916 04:03:20 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3736869 00:06:05.916 04:03:20 -- event/cpu_locks.sh@63 -- # waitforlisten 3736869 00:06:05.916 04:03:20 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:05.916 04:03:20 -- common/autotest_common.sh@819 -- # '[' -z 3736869 ']' 00:06:05.916 04:03:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.916 04:03:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:05.916 04:03:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.916 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.916 04:03:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:05.916 04:03:20 -- common/autotest_common.sh@10 -- # set +x 00:06:05.916 [2024-05-14 04:03:20.352560] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:05.916 [2024-05-14 04:03:20.352616] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3736869 ] 00:06:05.916 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.916 [2024-05-14 04:03:20.412004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.916 [2024-05-14 04:03:20.474455] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:05.916 [2024-05-14 04:03:20.474586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.886 04:03:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:06.886 04:03:21 -- common/autotest_common.sh@852 -- # return 0 00:06:06.886 04:03:21 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:06.886 04:03:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:06.886 04:03:21 -- common/autotest_common.sh@10 -- # set +x 00:06:06.886 04:03:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:06.886 04:03:21 -- event/cpu_locks.sh@67 -- # no_locks 00:06:06.886 04:03:21 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:06.886 04:03:21 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:06.886 04:03:21 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:06.886 04:03:21 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:06.886 04:03:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:06.886 04:03:21 -- common/autotest_common.sh@10 -- # set +x 00:06:06.886 04:03:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:06.886 04:03:21 -- event/cpu_locks.sh@71 -- # locks_exist 3736869 00:06:06.886 04:03:21 -- event/cpu_locks.sh@22 -- # lslocks -p 3736869 00:06:06.886 04:03:21 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:07.156 04:03:21 -- event/cpu_locks.sh@73 -- # killprocess 3736869 00:06:07.156 04:03:21 -- common/autotest_common.sh@926 -- # '[' -z 3736869 ']' 00:06:07.156 04:03:21 -- common/autotest_common.sh@930 -- # kill -0 3736869 00:06:07.156 04:03:21 -- common/autotest_common.sh@931 -- # uname 00:06:07.156 04:03:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:07.156 04:03:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3736869 00:06:07.156 04:03:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:07.156 04:03:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:07.156 04:03:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3736869' 00:06:07.156 killing process with pid 3736869 00:06:07.156 04:03:21 -- common/autotest_common.sh@945 -- # kill 3736869 00:06:07.156 04:03:21 -- common/autotest_common.sh@950 -- # wait 3736869 00:06:07.417 00:06:07.417 real 0m1.602s 00:06:07.417 user 0m1.702s 00:06:07.417 sys 0m0.537s 00:06:07.417 04:03:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:07.417 04:03:21 -- common/autotest_common.sh@10 -- # set +x 00:06:07.417 ************************************ 00:06:07.417 END TEST default_locks_via_rpc 00:06:07.417 ************************************ 00:06:07.417 04:03:21 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:07.417 04:03:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:07.417 04:03:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:07.417 04:03:21 -- common/autotest_common.sh@10 -- # set +x 00:06:07.417 ************************************ 00:06:07.417 START TEST non_locking_app_on_locked_coremask 00:06:07.417 ************************************ 00:06:07.417 04:03:21 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:06:07.417 04:03:21 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3737240 00:06:07.417 04:03:21 -- event/cpu_locks.sh@81 -- # waitforlisten 3737240 /var/tmp/spdk.sock 00:06:07.417 04:03:21 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:07.417 04:03:21 -- common/autotest_common.sh@819 -- # '[' -z 3737240 ']' 00:06:07.417 04:03:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:07.417 04:03:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:07.417 04:03:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:07.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:07.417 04:03:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:07.417 04:03:21 -- common/autotest_common.sh@10 -- # set +x 00:06:07.417 [2024-05-14 04:03:22.001886] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:07.417 [2024-05-14 04:03:22.001947] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3737240 ] 00:06:07.678 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.678 [2024-05-14 04:03:22.061882] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.678 [2024-05-14 04:03:22.126793] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:07.678 [2024-05-14 04:03:22.126919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.251 04:03:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:08.251 04:03:22 -- common/autotest_common.sh@852 -- # return 0 00:06:08.251 04:03:22 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3737576 00:06:08.251 04:03:22 -- event/cpu_locks.sh@85 -- # waitforlisten 3737576 /var/tmp/spdk2.sock 00:06:08.251 04:03:22 -- common/autotest_common.sh@819 -- # '[' -z 3737576 ']' 00:06:08.251 04:03:22 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:08.251 04:03:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:08.251 04:03:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:08.251 04:03:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:08.251 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:08.251 04:03:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:08.251 04:03:22 -- common/autotest_common.sh@10 -- # set +x 00:06:08.251 [2024-05-14 04:03:22.809327] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:08.251 [2024-05-14 04:03:22.809377] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3737576 ] 00:06:08.251 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.512 [2024-05-14 04:03:22.898263] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:08.512 [2024-05-14 04:03:22.898289] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.512 [2024-05-14 04:03:23.020990] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:08.512 [2024-05-14 04:03:23.021113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.119 04:03:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:09.119 04:03:23 -- common/autotest_common.sh@852 -- # return 0 00:06:09.119 04:03:23 -- event/cpu_locks.sh@87 -- # locks_exist 3737240 00:06:09.119 04:03:23 -- event/cpu_locks.sh@22 -- # lslocks -p 3737240 00:06:09.119 04:03:23 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:09.689 lslocks: write error 00:06:09.689 04:03:24 -- event/cpu_locks.sh@89 -- # killprocess 3737240 00:06:09.689 04:03:24 -- common/autotest_common.sh@926 -- # '[' -z 3737240 ']' 00:06:09.689 04:03:24 -- common/autotest_common.sh@930 -- # kill -0 3737240 00:06:09.689 04:03:24 -- common/autotest_common.sh@931 -- # uname 00:06:09.689 04:03:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:09.689 04:03:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3737240 00:06:09.689 04:03:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:09.689 04:03:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:09.689 04:03:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3737240' 00:06:09.689 killing process with pid 3737240 00:06:09.689 04:03:24 -- common/autotest_common.sh@945 -- # kill 3737240 00:06:09.689 04:03:24 -- common/autotest_common.sh@950 -- # wait 3737240 00:06:10.261 04:03:24 -- event/cpu_locks.sh@90 -- # killprocess 3737576 00:06:10.261 04:03:24 -- common/autotest_common.sh@926 -- # '[' -z 3737576 ']' 00:06:10.261 04:03:24 -- common/autotest_common.sh@930 -- # kill -0 3737576 00:06:10.261 04:03:24 -- common/autotest_common.sh@931 -- # uname 00:06:10.261 04:03:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:10.261 04:03:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3737576 00:06:10.261 04:03:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:10.261 04:03:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:10.261 04:03:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3737576' 00:06:10.261 killing process with pid 3737576 00:06:10.261 04:03:24 -- common/autotest_common.sh@945 -- # kill 3737576 00:06:10.261 04:03:24 -- common/autotest_common.sh@950 -- # wait 3737576 00:06:10.261 00:06:10.261 real 0m2.889s 00:06:10.261 user 0m3.135s 00:06:10.261 sys 0m0.868s 00:06:10.261 04:03:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:10.261 04:03:24 -- common/autotest_common.sh@10 -- # set +x 00:06:10.261 ************************************ 00:06:10.261 END TEST non_locking_app_on_locked_coremask 00:06:10.261 ************************************ 00:06:10.521 04:03:24 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:10.521 04:03:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:10.521 04:03:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:10.521 04:03:24 -- common/autotest_common.sh@10 -- # set +x 00:06:10.521 ************************************ 00:06:10.521 START TEST locking_app_on_unlocked_coremask 00:06:10.521 ************************************ 00:06:10.521 04:03:24 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:06:10.521 04:03:24 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3737955 00:06:10.521 04:03:24 -- event/cpu_locks.sh@99 -- # waitforlisten 3737955 /var/tmp/spdk.sock 00:06:10.521 04:03:24 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:10.521 04:03:24 -- common/autotest_common.sh@819 -- # '[' -z 3737955 ']' 00:06:10.521 04:03:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:10.521 04:03:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:10.521 04:03:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:10.521 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:10.521 04:03:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:10.521 04:03:24 -- common/autotest_common.sh@10 -- # set +x 00:06:10.521 [2024-05-14 04:03:24.932956] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:10.521 [2024-05-14 04:03:24.933019] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3737955 ] 00:06:10.521 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.521 [2024-05-14 04:03:24.992240] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:10.521 [2024-05-14 04:03:24.992270] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.521 [2024-05-14 04:03:25.057543] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:10.521 [2024-05-14 04:03:25.057677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.463 04:03:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:11.463 04:03:25 -- common/autotest_common.sh@852 -- # return 0 00:06:11.463 04:03:25 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3738139 00:06:11.463 04:03:25 -- event/cpu_locks.sh@103 -- # waitforlisten 3738139 /var/tmp/spdk2.sock 00:06:11.463 04:03:25 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:11.463 04:03:25 -- common/autotest_common.sh@819 -- # '[' -z 3738139 ']' 00:06:11.463 04:03:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:11.463 04:03:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:11.463 04:03:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:11.463 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:11.463 04:03:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:11.463 04:03:25 -- common/autotest_common.sh@10 -- # set +x 00:06:11.463 [2024-05-14 04:03:25.736311] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:11.463 [2024-05-14 04:03:25.736363] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3738139 ] 00:06:11.463 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.463 [2024-05-14 04:03:25.821461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.463 [2024-05-14 04:03:25.948749] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:11.463 [2024-05-14 04:03:25.948874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.033 04:03:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:12.033 04:03:26 -- common/autotest_common.sh@852 -- # return 0 00:06:12.033 04:03:26 -- event/cpu_locks.sh@105 -- # locks_exist 3738139 00:06:12.033 04:03:26 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:12.033 04:03:26 -- event/cpu_locks.sh@22 -- # lslocks -p 3738139 00:06:12.604 lslocks: write error 00:06:12.604 04:03:27 -- event/cpu_locks.sh@107 -- # killprocess 3737955 00:06:12.604 04:03:27 -- common/autotest_common.sh@926 -- # '[' -z 3737955 ']' 00:06:12.604 04:03:27 -- common/autotest_common.sh@930 -- # kill -0 3737955 00:06:12.604 04:03:27 -- common/autotest_common.sh@931 -- # uname 00:06:12.604 04:03:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:12.604 04:03:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3737955 00:06:12.604 04:03:27 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:12.604 04:03:27 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:12.604 04:03:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3737955' 00:06:12.604 killing process with pid 3737955 00:06:12.604 04:03:27 -- common/autotest_common.sh@945 -- # kill 3737955 00:06:12.604 04:03:27 -- common/autotest_common.sh@950 -- # wait 3737955 00:06:13.174 04:03:27 -- event/cpu_locks.sh@108 -- # killprocess 3738139 00:06:13.174 04:03:27 -- common/autotest_common.sh@926 -- # '[' -z 3738139 ']' 00:06:13.174 04:03:27 -- common/autotest_common.sh@930 -- # kill -0 3738139 00:06:13.174 04:03:27 -- common/autotest_common.sh@931 -- # uname 00:06:13.174 04:03:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:13.174 04:03:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3738139 00:06:13.174 04:03:27 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:13.174 04:03:27 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:13.174 04:03:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3738139' 00:06:13.174 killing process with pid 3738139 00:06:13.174 04:03:27 -- common/autotest_common.sh@945 -- # kill 3738139 00:06:13.174 04:03:27 -- common/autotest_common.sh@950 -- # wait 3738139 00:06:13.174 00:06:13.174 real 0m2.863s 00:06:13.174 user 0m3.103s 00:06:13.174 sys 0m0.877s 00:06:13.174 04:03:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:13.174 04:03:27 -- common/autotest_common.sh@10 -- # set +x 00:06:13.174 ************************************ 00:06:13.174 END TEST locking_app_on_unlocked_coremask 00:06:13.174 ************************************ 00:06:13.434 04:03:27 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:13.434 04:03:27 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:13.434 04:03:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:13.434 04:03:27 -- common/autotest_common.sh@10 -- # set +x 00:06:13.434 ************************************ 00:06:13.434 START TEST locking_app_on_locked_coremask 00:06:13.434 ************************************ 00:06:13.434 04:03:27 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:06:13.434 04:03:27 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3738666 00:06:13.434 04:03:27 -- event/cpu_locks.sh@116 -- # waitforlisten 3738666 /var/tmp/spdk.sock 00:06:13.434 04:03:27 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:13.434 04:03:27 -- common/autotest_common.sh@819 -- # '[' -z 3738666 ']' 00:06:13.434 04:03:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:13.434 04:03:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:13.434 04:03:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:13.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:13.434 04:03:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:13.434 04:03:27 -- common/autotest_common.sh@10 -- # set +x 00:06:13.434 [2024-05-14 04:03:27.840763] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:13.434 [2024-05-14 04:03:27.840823] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3738666 ] 00:06:13.434 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.434 [2024-05-14 04:03:27.899673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.434 [2024-05-14 04:03:27.964568] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:13.434 [2024-05-14 04:03:27.964691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.375 04:03:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:14.375 04:03:28 -- common/autotest_common.sh@852 -- # return 0 00:06:14.375 04:03:28 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:14.375 04:03:28 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3738680 00:06:14.375 04:03:28 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3738680 /var/tmp/spdk2.sock 00:06:14.375 04:03:28 -- common/autotest_common.sh@640 -- # local es=0 00:06:14.375 04:03:28 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 3738680 /var/tmp/spdk2.sock 00:06:14.375 04:03:28 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:06:14.375 04:03:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:14.375 04:03:28 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:06:14.375 04:03:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:14.375 04:03:28 -- common/autotest_common.sh@643 -- # waitforlisten 3738680 /var/tmp/spdk2.sock 00:06:14.375 04:03:28 -- common/autotest_common.sh@819 -- # '[' -z 3738680 ']' 00:06:14.375 04:03:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:14.375 04:03:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:14.375 04:03:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:14.375 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:14.375 04:03:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:14.375 04:03:28 -- common/autotest_common.sh@10 -- # set +x 00:06:14.375 [2024-05-14 04:03:28.627714] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:14.375 [2024-05-14 04:03:28.627768] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3738680 ] 00:06:14.375 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.375 [2024-05-14 04:03:28.713864] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3738666 has claimed it. 00:06:14.375 [2024-05-14 04:03:28.713902] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:14.947 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (3738680) - No such process 00:06:14.947 ERROR: process (pid: 3738680) is no longer running 00:06:14.947 04:03:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:14.947 04:03:29 -- common/autotest_common.sh@852 -- # return 1 00:06:14.947 04:03:29 -- common/autotest_common.sh@643 -- # es=1 00:06:14.947 04:03:29 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:14.947 04:03:29 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:14.947 04:03:29 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:14.947 04:03:29 -- event/cpu_locks.sh@122 -- # locks_exist 3738666 00:06:14.947 04:03:29 -- event/cpu_locks.sh@22 -- # lslocks -p 3738666 00:06:14.947 04:03:29 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:15.207 lslocks: write error 00:06:15.207 04:03:29 -- event/cpu_locks.sh@124 -- # killprocess 3738666 00:06:15.207 04:03:29 -- common/autotest_common.sh@926 -- # '[' -z 3738666 ']' 00:06:15.207 04:03:29 -- common/autotest_common.sh@930 -- # kill -0 3738666 00:06:15.207 04:03:29 -- common/autotest_common.sh@931 -- # uname 00:06:15.207 04:03:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:15.207 04:03:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3738666 00:06:15.207 04:03:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:15.207 04:03:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:15.207 04:03:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3738666' 00:06:15.207 killing process with pid 3738666 00:06:15.207 04:03:29 -- common/autotest_common.sh@945 -- # kill 3738666 00:06:15.207 04:03:29 -- common/autotest_common.sh@950 -- # wait 3738666 00:06:15.468 00:06:15.468 real 0m2.191s 00:06:15.468 user 0m2.437s 00:06:15.468 sys 0m0.582s 00:06:15.468 04:03:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:15.468 04:03:29 -- common/autotest_common.sh@10 -- # set +x 00:06:15.468 ************************************ 00:06:15.468 END TEST locking_app_on_locked_coremask 00:06:15.468 ************************************ 00:06:15.468 04:03:30 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:15.468 04:03:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:15.468 04:03:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:15.468 04:03:30 -- common/autotest_common.sh@10 -- # set +x 00:06:15.468 ************************************ 00:06:15.468 START TEST locking_overlapped_coremask 00:06:15.468 ************************************ 00:06:15.468 04:03:30 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:06:15.468 04:03:30 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3739042 00:06:15.468 04:03:30 -- event/cpu_locks.sh@133 -- # waitforlisten 3739042 /var/tmp/spdk.sock 00:06:15.468 04:03:30 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:15.468 04:03:30 -- common/autotest_common.sh@819 -- # '[' -z 3739042 ']' 00:06:15.468 04:03:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:15.468 04:03:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:15.468 04:03:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:15.468 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:15.468 04:03:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:15.468 04:03:30 -- common/autotest_common.sh@10 -- # set +x 00:06:15.729 [2024-05-14 04:03:30.081597] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:15.729 [2024-05-14 04:03:30.081662] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3739042 ] 00:06:15.729 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.729 [2024-05-14 04:03:30.141154] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:15.729 [2024-05-14 04:03:30.205940] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:15.729 [2024-05-14 04:03:30.206184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.729 [2024-05-14 04:03:30.206310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:15.729 [2024-05-14 04:03:30.206320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.300 04:03:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:16.300 04:03:30 -- common/autotest_common.sh@852 -- # return 0 00:06:16.300 04:03:30 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3739338 00:06:16.300 04:03:30 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3739338 /var/tmp/spdk2.sock 00:06:16.300 04:03:30 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:16.300 04:03:30 -- common/autotest_common.sh@640 -- # local es=0 00:06:16.300 04:03:30 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 3739338 /var/tmp/spdk2.sock 00:06:16.300 04:03:30 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:06:16.300 04:03:30 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:16.300 04:03:30 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:06:16.300 04:03:30 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:16.300 04:03:30 -- common/autotest_common.sh@643 -- # waitforlisten 3739338 /var/tmp/spdk2.sock 00:06:16.300 04:03:30 -- common/autotest_common.sh@819 -- # '[' -z 3739338 ']' 00:06:16.300 04:03:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:16.300 04:03:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:16.300 04:03:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:16.300 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:16.300 04:03:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:16.300 04:03:30 -- common/autotest_common.sh@10 -- # set +x 00:06:16.300 [2024-05-14 04:03:30.886608] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:16.300 [2024-05-14 04:03:30.886661] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3739338 ] 00:06:16.560 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.560 [2024-05-14 04:03:30.958852] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3739042 has claimed it. 00:06:16.560 [2024-05-14 04:03:30.958883] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:17.130 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (3739338) - No such process 00:06:17.130 ERROR: process (pid: 3739338) is no longer running 00:06:17.130 04:03:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:17.130 04:03:31 -- common/autotest_common.sh@852 -- # return 1 00:06:17.130 04:03:31 -- common/autotest_common.sh@643 -- # es=1 00:06:17.131 04:03:31 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:17.131 04:03:31 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:17.131 04:03:31 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:17.131 04:03:31 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:17.131 04:03:31 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:17.131 04:03:31 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:17.131 04:03:31 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:17.131 04:03:31 -- event/cpu_locks.sh@141 -- # killprocess 3739042 00:06:17.131 04:03:31 -- common/autotest_common.sh@926 -- # '[' -z 3739042 ']' 00:06:17.131 04:03:31 -- common/autotest_common.sh@930 -- # kill -0 3739042 00:06:17.131 04:03:31 -- common/autotest_common.sh@931 -- # uname 00:06:17.131 04:03:31 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:17.131 04:03:31 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3739042 00:06:17.131 04:03:31 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:17.131 04:03:31 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:17.131 04:03:31 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3739042' 00:06:17.131 killing process with pid 3739042 00:06:17.131 04:03:31 -- common/autotest_common.sh@945 -- # kill 3739042 00:06:17.131 04:03:31 -- common/autotest_common.sh@950 -- # wait 3739042 00:06:17.391 00:06:17.391 real 0m1.731s 00:06:17.391 user 0m4.888s 00:06:17.391 sys 0m0.374s 00:06:17.391 04:03:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:17.391 04:03:31 -- common/autotest_common.sh@10 -- # set +x 00:06:17.391 ************************************ 00:06:17.391 END TEST locking_overlapped_coremask 00:06:17.391 ************************************ 00:06:17.391 04:03:31 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:17.391 04:03:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:17.391 04:03:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:17.391 04:03:31 -- common/autotest_common.sh@10 -- # set +x 00:06:17.391 ************************************ 00:06:17.391 START TEST locking_overlapped_coremask_via_rpc 00:06:17.391 ************************************ 00:06:17.391 04:03:31 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:06:17.391 04:03:31 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3739423 00:06:17.391 04:03:31 -- event/cpu_locks.sh@149 -- # waitforlisten 3739423 /var/tmp/spdk.sock 00:06:17.391 04:03:31 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:17.391 04:03:31 -- common/autotest_common.sh@819 -- # '[' -z 3739423 ']' 00:06:17.391 04:03:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:17.391 04:03:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:17.391 04:03:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:17.391 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:17.391 04:03:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:17.391 04:03:31 -- common/autotest_common.sh@10 -- # set +x 00:06:17.391 [2024-05-14 04:03:31.869488] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:17.391 [2024-05-14 04:03:31.869541] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3739423 ] 00:06:17.391 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.391 [2024-05-14 04:03:31.928243] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:17.391 [2024-05-14 04:03:31.928277] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:17.652 [2024-05-14 04:03:31.990068] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:17.652 [2024-05-14 04:03:31.990324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:17.652 [2024-05-14 04:03:31.990460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:17.652 [2024-05-14 04:03:31.990555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.224 04:03:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:18.224 04:03:32 -- common/autotest_common.sh@852 -- # return 0 00:06:18.224 04:03:32 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3739752 00:06:18.224 04:03:32 -- event/cpu_locks.sh@153 -- # waitforlisten 3739752 /var/tmp/spdk2.sock 00:06:18.224 04:03:32 -- common/autotest_common.sh@819 -- # '[' -z 3739752 ']' 00:06:18.224 04:03:32 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:18.224 04:03:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:18.224 04:03:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:18.224 04:03:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:18.224 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:18.224 04:03:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:18.224 04:03:32 -- common/autotest_common.sh@10 -- # set +x 00:06:18.224 [2024-05-14 04:03:32.675804] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:18.224 [2024-05-14 04:03:32.675854] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3739752 ] 00:06:18.224 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.224 [2024-05-14 04:03:32.747826] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:18.224 [2024-05-14 04:03:32.747850] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:18.485 [2024-05-14 04:03:32.851578] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:18.485 [2024-05-14 04:03:32.851814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:18.485 [2024-05-14 04:03:32.851974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:18.485 [2024-05-14 04:03:32.851977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:19.058 04:03:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:19.058 04:03:33 -- common/autotest_common.sh@852 -- # return 0 00:06:19.058 04:03:33 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:19.058 04:03:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:19.058 04:03:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.058 04:03:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:19.058 04:03:33 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:19.058 04:03:33 -- common/autotest_common.sh@640 -- # local es=0 00:06:19.058 04:03:33 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:19.058 04:03:33 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:06:19.058 04:03:33 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:19.058 04:03:33 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:06:19.058 04:03:33 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:19.058 04:03:33 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:19.058 04:03:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:19.058 04:03:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.058 [2024-05-14 04:03:33.451344] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3739423 has claimed it. 00:06:19.058 request: 00:06:19.058 { 00:06:19.058 "method": "framework_enable_cpumask_locks", 00:06:19.058 "req_id": 1 00:06:19.058 } 00:06:19.058 Got JSON-RPC error response 00:06:19.058 response: 00:06:19.058 { 00:06:19.058 "code": -32603, 00:06:19.058 "message": "Failed to claim CPU core: 2" 00:06:19.058 } 00:06:19.058 04:03:33 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:06:19.058 04:03:33 -- common/autotest_common.sh@643 -- # es=1 00:06:19.058 04:03:33 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:19.058 04:03:33 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:19.058 04:03:33 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:19.058 04:03:33 -- event/cpu_locks.sh@158 -- # waitforlisten 3739423 /var/tmp/spdk.sock 00:06:19.058 04:03:33 -- common/autotest_common.sh@819 -- # '[' -z 3739423 ']' 00:06:19.058 04:03:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:19.058 04:03:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:19.058 04:03:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:19.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:19.058 04:03:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:19.058 04:03:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.058 04:03:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:19.058 04:03:33 -- common/autotest_common.sh@852 -- # return 0 00:06:19.058 04:03:33 -- event/cpu_locks.sh@159 -- # waitforlisten 3739752 /var/tmp/spdk2.sock 00:06:19.058 04:03:33 -- common/autotest_common.sh@819 -- # '[' -z 3739752 ']' 00:06:19.058 04:03:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:19.058 04:03:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:19.058 04:03:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:19.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:19.058 04:03:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:19.058 04:03:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.319 04:03:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:19.319 04:03:33 -- common/autotest_common.sh@852 -- # return 0 00:06:19.319 04:03:33 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:19.319 04:03:33 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:19.319 04:03:33 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:19.319 04:03:33 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:19.319 00:06:19.319 real 0m1.986s 00:06:19.319 user 0m0.753s 00:06:19.319 sys 0m0.160s 00:06:19.319 04:03:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:19.319 04:03:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.319 ************************************ 00:06:19.319 END TEST locking_overlapped_coremask_via_rpc 00:06:19.319 ************************************ 00:06:19.319 04:03:33 -- event/cpu_locks.sh@174 -- # cleanup 00:06:19.319 04:03:33 -- event/cpu_locks.sh@15 -- # [[ -z 3739423 ]] 00:06:19.319 04:03:33 -- event/cpu_locks.sh@15 -- # killprocess 3739423 00:06:19.319 04:03:33 -- common/autotest_common.sh@926 -- # '[' -z 3739423 ']' 00:06:19.319 04:03:33 -- common/autotest_common.sh@930 -- # kill -0 3739423 00:06:19.319 04:03:33 -- common/autotest_common.sh@931 -- # uname 00:06:19.319 04:03:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:19.319 04:03:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3739423 00:06:19.319 04:03:33 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:19.319 04:03:33 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:19.319 04:03:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3739423' 00:06:19.319 killing process with pid 3739423 00:06:19.319 04:03:33 -- common/autotest_common.sh@945 -- # kill 3739423 00:06:19.319 04:03:33 -- common/autotest_common.sh@950 -- # wait 3739423 00:06:19.580 04:03:34 -- event/cpu_locks.sh@16 -- # [[ -z 3739752 ]] 00:06:19.580 04:03:34 -- event/cpu_locks.sh@16 -- # killprocess 3739752 00:06:19.580 04:03:34 -- common/autotest_common.sh@926 -- # '[' -z 3739752 ']' 00:06:19.580 04:03:34 -- common/autotest_common.sh@930 -- # kill -0 3739752 00:06:19.580 04:03:34 -- common/autotest_common.sh@931 -- # uname 00:06:19.580 04:03:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:19.580 04:03:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3739752 00:06:19.580 04:03:34 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:06:19.580 04:03:34 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:06:19.580 04:03:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3739752' 00:06:19.580 killing process with pid 3739752 00:06:19.580 04:03:34 -- common/autotest_common.sh@945 -- # kill 3739752 00:06:19.580 04:03:34 -- common/autotest_common.sh@950 -- # wait 3739752 00:06:19.841 04:03:34 -- event/cpu_locks.sh@18 -- # rm -f 00:06:19.841 04:03:34 -- event/cpu_locks.sh@1 -- # cleanup 00:06:19.841 04:03:34 -- event/cpu_locks.sh@15 -- # [[ -z 3739423 ]] 00:06:19.841 04:03:34 -- event/cpu_locks.sh@15 -- # killprocess 3739423 00:06:19.841 04:03:34 -- common/autotest_common.sh@926 -- # '[' -z 3739423 ']' 00:06:19.841 04:03:34 -- common/autotest_common.sh@930 -- # kill -0 3739423 00:06:19.842 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3739423) - No such process 00:06:19.842 04:03:34 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3739423 is not found' 00:06:19.842 Process with pid 3739423 is not found 00:06:19.842 04:03:34 -- event/cpu_locks.sh@16 -- # [[ -z 3739752 ]] 00:06:19.842 04:03:34 -- event/cpu_locks.sh@16 -- # killprocess 3739752 00:06:19.842 04:03:34 -- common/autotest_common.sh@926 -- # '[' -z 3739752 ']' 00:06:19.842 04:03:34 -- common/autotest_common.sh@930 -- # kill -0 3739752 00:06:19.842 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3739752) - No such process 00:06:19.842 04:03:34 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3739752 is not found' 00:06:19.842 Process with pid 3739752 is not found 00:06:19.842 04:03:34 -- event/cpu_locks.sh@18 -- # rm -f 00:06:19.842 00:06:19.842 real 0m15.631s 00:06:19.842 user 0m26.979s 00:06:19.842 sys 0m4.626s 00:06:19.842 04:03:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:19.842 04:03:34 -- common/autotest_common.sh@10 -- # set +x 00:06:19.842 ************************************ 00:06:19.842 END TEST cpu_locks 00:06:19.842 ************************************ 00:06:19.842 00:06:19.842 real 0m41.462s 00:06:19.842 user 1m21.162s 00:06:19.842 sys 0m7.573s 00:06:19.842 04:03:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:19.842 04:03:34 -- common/autotest_common.sh@10 -- # set +x 00:06:19.842 ************************************ 00:06:19.842 END TEST event 00:06:19.842 ************************************ 00:06:19.842 04:03:34 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:19.842 04:03:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:19.842 04:03:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:19.842 04:03:34 -- common/autotest_common.sh@10 -- # set +x 00:06:20.103 ************************************ 00:06:20.103 START TEST thread 00:06:20.103 ************************************ 00:06:20.103 04:03:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:20.103 * Looking for test storage... 00:06:20.103 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:20.103 04:03:34 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:20.103 04:03:34 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:20.103 04:03:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:20.103 04:03:34 -- common/autotest_common.sh@10 -- # set +x 00:06:20.103 ************************************ 00:06:20.103 START TEST thread_poller_perf 00:06:20.103 ************************************ 00:06:20.103 04:03:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:20.103 [2024-05-14 04:03:34.561538] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:20.103 [2024-05-14 04:03:34.561659] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3740188 ] 00:06:20.103 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.103 [2024-05-14 04:03:34.628585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.363 [2024-05-14 04:03:34.700787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.363 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:21.349 ====================================== 00:06:21.349 busy:2407617942 (cyc) 00:06:21.349 total_run_count: 275000 00:06:21.349 tsc_hz: 2400000000 (cyc) 00:06:21.349 ====================================== 00:06:21.349 poller_cost: 8754 (cyc), 3647 (nsec) 00:06:21.349 00:06:21.349 real 0m1.223s 00:06:21.349 user 0m1.149s 00:06:21.349 sys 0m0.069s 00:06:21.349 04:03:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:21.349 04:03:35 -- common/autotest_common.sh@10 -- # set +x 00:06:21.349 ************************************ 00:06:21.349 END TEST thread_poller_perf 00:06:21.349 ************************************ 00:06:21.349 04:03:35 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:21.349 04:03:35 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:21.349 04:03:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:21.349 04:03:35 -- common/autotest_common.sh@10 -- # set +x 00:06:21.349 ************************************ 00:06:21.349 START TEST thread_poller_perf 00:06:21.349 ************************************ 00:06:21.349 04:03:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:21.349 [2024-05-14 04:03:35.828624] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:21.349 [2024-05-14 04:03:35.828722] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3740494 ] 00:06:21.349 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.349 [2024-05-14 04:03:35.892559] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.610 [2024-05-14 04:03:35.956157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.610 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:22.552 ====================================== 00:06:22.552 busy:2402255282 (cyc) 00:06:22.552 total_run_count: 3575000 00:06:22.552 tsc_hz: 2400000000 (cyc) 00:06:22.552 ====================================== 00:06:22.552 poller_cost: 671 (cyc), 279 (nsec) 00:06:22.552 00:06:22.552 real 0m1.206s 00:06:22.552 user 0m1.131s 00:06:22.552 sys 0m0.071s 00:06:22.552 04:03:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:22.552 04:03:37 -- common/autotest_common.sh@10 -- # set +x 00:06:22.552 ************************************ 00:06:22.552 END TEST thread_poller_perf 00:06:22.552 ************************************ 00:06:22.552 04:03:37 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:22.552 00:06:22.552 real 0m2.615s 00:06:22.552 user 0m2.349s 00:06:22.552 sys 0m0.279s 00:06:22.552 04:03:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:22.552 04:03:37 -- common/autotest_common.sh@10 -- # set +x 00:06:22.552 ************************************ 00:06:22.552 END TEST thread 00:06:22.552 ************************************ 00:06:22.552 04:03:37 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:22.552 04:03:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:22.552 04:03:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:22.552 04:03:37 -- common/autotest_common.sh@10 -- # set +x 00:06:22.552 ************************************ 00:06:22.552 START TEST accel 00:06:22.552 ************************************ 00:06:22.552 04:03:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:22.814 * Looking for test storage... 00:06:22.814 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:22.814 04:03:37 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:22.814 04:03:37 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:22.814 04:03:37 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:22.814 04:03:37 -- accel/accel.sh@59 -- # spdk_tgt_pid=3740734 00:06:22.814 04:03:37 -- accel/accel.sh@60 -- # waitforlisten 3740734 00:06:22.814 04:03:37 -- common/autotest_common.sh@819 -- # '[' -z 3740734 ']' 00:06:22.814 04:03:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:22.814 04:03:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:22.814 04:03:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:22.814 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:22.814 04:03:37 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:22.814 04:03:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:22.814 04:03:37 -- accel/accel.sh@58 -- # build_accel_config 00:06:22.814 04:03:37 -- common/autotest_common.sh@10 -- # set +x 00:06:22.814 04:03:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.814 04:03:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.814 04:03:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.814 04:03:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.814 04:03:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.814 04:03:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.814 04:03:37 -- accel/accel.sh@42 -- # jq -r . 00:06:22.814 [2024-05-14 04:03:37.240739] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:22.814 [2024-05-14 04:03:37.240809] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3740734 ] 00:06:22.814 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.814 [2024-05-14 04:03:37.305471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.814 [2024-05-14 04:03:37.378073] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:22.814 [2024-05-14 04:03:37.378218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.756 04:03:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:23.756 04:03:38 -- common/autotest_common.sh@852 -- # return 0 00:06:23.756 04:03:38 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:23.756 04:03:38 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:23.756 04:03:38 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:23.756 04:03:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:23.756 04:03:38 -- common/autotest_common.sh@10 -- # set +x 00:06:23.756 04:03:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:23.756 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.756 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.756 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.756 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.756 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.756 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.756 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.756 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.756 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.756 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.756 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # IFS== 00:06:23.757 04:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:06:23.757 04:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:23.757 04:03:38 -- accel/accel.sh@67 -- # killprocess 3740734 00:06:23.757 04:03:38 -- common/autotest_common.sh@926 -- # '[' -z 3740734 ']' 00:06:23.757 04:03:38 -- common/autotest_common.sh@930 -- # kill -0 3740734 00:06:23.757 04:03:38 -- common/autotest_common.sh@931 -- # uname 00:06:23.757 04:03:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:23.757 04:03:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3740734 00:06:23.757 04:03:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:23.757 04:03:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:23.757 04:03:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3740734' 00:06:23.757 killing process with pid 3740734 00:06:23.757 04:03:38 -- common/autotest_common.sh@945 -- # kill 3740734 00:06:23.757 04:03:38 -- common/autotest_common.sh@950 -- # wait 3740734 00:06:23.757 04:03:38 -- accel/accel.sh@68 -- # trap - ERR 00:06:23.757 04:03:38 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:23.757 04:03:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:23.757 04:03:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:23.757 04:03:38 -- common/autotest_common.sh@10 -- # set +x 00:06:23.757 04:03:38 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:06:23.757 04:03:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:23.757 04:03:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:23.757 04:03:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.757 04:03:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.757 04:03:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.757 04:03:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.757 04:03:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.757 04:03:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.757 04:03:38 -- accel/accel.sh@42 -- # jq -r . 00:06:24.018 04:03:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.018 04:03:38 -- common/autotest_common.sh@10 -- # set +x 00:06:24.018 04:03:38 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:24.018 04:03:38 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:24.018 04:03:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:24.018 04:03:38 -- common/autotest_common.sh@10 -- # set +x 00:06:24.018 ************************************ 00:06:24.018 START TEST accel_missing_filename 00:06:24.018 ************************************ 00:06:24.018 04:03:38 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:06:24.018 04:03:38 -- common/autotest_common.sh@640 -- # local es=0 00:06:24.018 04:03:38 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:24.018 04:03:38 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:24.018 04:03:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:24.018 04:03:38 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:24.018 04:03:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:24.018 04:03:38 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:06:24.018 04:03:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:24.018 04:03:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.018 04:03:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.018 04:03:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.018 04:03:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.018 04:03:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.018 04:03:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.018 04:03:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.018 04:03:38 -- accel/accel.sh@42 -- # jq -r . 00:06:24.018 [2024-05-14 04:03:38.434524] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:24.018 [2024-05-14 04:03:38.434627] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3740990 ] 00:06:24.018 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.018 [2024-05-14 04:03:38.497345] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.018 [2024-05-14 04:03:38.559863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.018 [2024-05-14 04:03:38.591497] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:24.279 [2024-05-14 04:03:38.628689] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:24.279 A filename is required. 00:06:24.279 04:03:38 -- common/autotest_common.sh@643 -- # es=234 00:06:24.279 04:03:38 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:24.279 04:03:38 -- common/autotest_common.sh@652 -- # es=106 00:06:24.279 04:03:38 -- common/autotest_common.sh@653 -- # case "$es" in 00:06:24.279 04:03:38 -- common/autotest_common.sh@660 -- # es=1 00:06:24.279 04:03:38 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:24.279 00:06:24.279 real 0m0.273s 00:06:24.279 user 0m0.210s 00:06:24.279 sys 0m0.106s 00:06:24.279 04:03:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.279 04:03:38 -- common/autotest_common.sh@10 -- # set +x 00:06:24.279 ************************************ 00:06:24.279 END TEST accel_missing_filename 00:06:24.279 ************************************ 00:06:24.279 04:03:38 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:24.279 04:03:38 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:06:24.279 04:03:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:24.279 04:03:38 -- common/autotest_common.sh@10 -- # set +x 00:06:24.279 ************************************ 00:06:24.279 START TEST accel_compress_verify 00:06:24.279 ************************************ 00:06:24.279 04:03:38 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:24.279 04:03:38 -- common/autotest_common.sh@640 -- # local es=0 00:06:24.279 04:03:38 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:24.279 04:03:38 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:24.279 04:03:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:24.279 04:03:38 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:24.279 04:03:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:24.279 04:03:38 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:24.279 04:03:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:24.279 04:03:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.279 04:03:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.279 04:03:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.279 04:03:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.279 04:03:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.279 04:03:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.279 04:03:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.279 04:03:38 -- accel/accel.sh@42 -- # jq -r . 00:06:24.279 [2024-05-14 04:03:38.744650] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:24.279 [2024-05-14 04:03:38.744736] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3741034 ] 00:06:24.279 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.279 [2024-05-14 04:03:38.806527] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.540 [2024-05-14 04:03:38.869375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.540 [2024-05-14 04:03:38.901362] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:24.540 [2024-05-14 04:03:38.938761] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:24.540 00:06:24.540 Compression does not support the verify option, aborting. 00:06:24.540 04:03:38 -- common/autotest_common.sh@643 -- # es=161 00:06:24.540 04:03:38 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:24.540 04:03:38 -- common/autotest_common.sh@652 -- # es=33 00:06:24.540 04:03:38 -- common/autotest_common.sh@653 -- # case "$es" in 00:06:24.540 04:03:38 -- common/autotest_common.sh@660 -- # es=1 00:06:24.540 04:03:38 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:24.540 00:06:24.540 real 0m0.273s 00:06:24.540 user 0m0.218s 00:06:24.540 sys 0m0.095s 00:06:24.540 04:03:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.540 04:03:38 -- common/autotest_common.sh@10 -- # set +x 00:06:24.540 ************************************ 00:06:24.540 END TEST accel_compress_verify 00:06:24.540 ************************************ 00:06:24.540 04:03:39 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:24.540 04:03:39 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:24.540 04:03:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:24.540 04:03:39 -- common/autotest_common.sh@10 -- # set +x 00:06:24.540 ************************************ 00:06:24.540 START TEST accel_wrong_workload 00:06:24.540 ************************************ 00:06:24.540 04:03:39 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:06:24.540 04:03:39 -- common/autotest_common.sh@640 -- # local es=0 00:06:24.540 04:03:39 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:24.540 04:03:39 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:24.540 04:03:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:24.540 04:03:39 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:24.540 04:03:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:24.540 04:03:39 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:06:24.540 04:03:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:24.540 04:03:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.540 04:03:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.540 04:03:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.540 04:03:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.540 04:03:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.540 04:03:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.540 04:03:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.540 04:03:39 -- accel/accel.sh@42 -- # jq -r . 00:06:24.540 Unsupported workload type: foobar 00:06:24.540 [2024-05-14 04:03:39.054676] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:24.540 accel_perf options: 00:06:24.540 [-h help message] 00:06:24.540 [-q queue depth per core] 00:06:24.540 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:24.540 [-T number of threads per core 00:06:24.540 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:24.540 [-t time in seconds] 00:06:24.540 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:24.540 [ dif_verify, , dif_generate, dif_generate_copy 00:06:24.540 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:24.541 [-l for compress/decompress workloads, name of uncompressed input file 00:06:24.541 [-S for crc32c workload, use this seed value (default 0) 00:06:24.541 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:24.541 [-f for fill workload, use this BYTE value (default 255) 00:06:24.541 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:24.541 [-y verify result if this switch is on] 00:06:24.541 [-a tasks to allocate per core (default: same value as -q)] 00:06:24.541 Can be used to spread operations across a wider range of memory. 00:06:24.541 04:03:39 -- common/autotest_common.sh@643 -- # es=1 00:06:24.541 04:03:39 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:24.541 04:03:39 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:24.541 04:03:39 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:24.541 00:06:24.541 real 0m0.032s 00:06:24.541 user 0m0.017s 00:06:24.541 sys 0m0.014s 00:06:24.541 04:03:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.541 04:03:39 -- common/autotest_common.sh@10 -- # set +x 00:06:24.541 ************************************ 00:06:24.541 END TEST accel_wrong_workload 00:06:24.541 ************************************ 00:06:24.541 Error: writing output failed: Broken pipe 00:06:24.541 04:03:39 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:24.541 04:03:39 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:06:24.541 04:03:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:24.541 04:03:39 -- common/autotest_common.sh@10 -- # set +x 00:06:24.541 ************************************ 00:06:24.541 START TEST accel_negative_buffers 00:06:24.541 ************************************ 00:06:24.541 04:03:39 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:24.541 04:03:39 -- common/autotest_common.sh@640 -- # local es=0 00:06:24.541 04:03:39 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:24.541 04:03:39 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:24.541 04:03:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:24.541 04:03:39 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:24.541 04:03:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:24.541 04:03:39 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:06:24.541 04:03:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:24.541 04:03:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.541 04:03:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.541 04:03:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.541 04:03:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.541 04:03:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.541 04:03:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.541 04:03:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.541 04:03:39 -- accel/accel.sh@42 -- # jq -r . 00:06:24.541 -x option must be non-negative. 00:06:24.541 [2024-05-14 04:03:39.123284] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:24.541 accel_perf options: 00:06:24.541 [-h help message] 00:06:24.541 [-q queue depth per core] 00:06:24.541 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:24.541 [-T number of threads per core 00:06:24.541 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:24.541 [-t time in seconds] 00:06:24.541 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:24.541 [ dif_verify, , dif_generate, dif_generate_copy 00:06:24.541 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:24.541 [-l for compress/decompress workloads, name of uncompressed input file 00:06:24.541 [-S for crc32c workload, use this seed value (default 0) 00:06:24.541 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:24.541 [-f for fill workload, use this BYTE value (default 255) 00:06:24.541 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:24.541 [-y verify result if this switch is on] 00:06:24.541 [-a tasks to allocate per core (default: same value as -q)] 00:06:24.541 Can be used to spread operations across a wider range of memory. 00:06:24.541 04:03:39 -- common/autotest_common.sh@643 -- # es=1 00:06:24.541 04:03:39 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:24.541 04:03:39 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:24.541 04:03:39 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:24.541 00:06:24.541 real 0m0.030s 00:06:24.541 user 0m0.018s 00:06:24.541 sys 0m0.012s 00:06:24.541 04:03:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:24.541 04:03:39 -- common/autotest_common.sh@10 -- # set +x 00:06:24.541 ************************************ 00:06:24.541 END TEST accel_negative_buffers 00:06:24.541 ************************************ 00:06:24.809 Error: writing output failed: Broken pipe 00:06:24.809 04:03:39 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:24.809 04:03:39 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:24.809 04:03:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:24.809 04:03:39 -- common/autotest_common.sh@10 -- # set +x 00:06:24.809 ************************************ 00:06:24.809 START TEST accel_crc32c 00:06:24.809 ************************************ 00:06:24.809 04:03:39 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:24.809 04:03:39 -- accel/accel.sh@16 -- # local accel_opc 00:06:24.809 04:03:39 -- accel/accel.sh@17 -- # local accel_module 00:06:24.809 04:03:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:24.809 04:03:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:24.809 04:03:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.809 04:03:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.809 04:03:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.809 04:03:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.809 04:03:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.809 04:03:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.809 04:03:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.809 04:03:39 -- accel/accel.sh@42 -- # jq -r . 00:06:24.809 [2024-05-14 04:03:39.192484] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:24.809 [2024-05-14 04:03:39.192559] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3741316 ] 00:06:24.809 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.809 [2024-05-14 04:03:39.257259] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.809 [2024-05-14 04:03:39.329854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.191 04:03:40 -- accel/accel.sh@18 -- # out=' 00:06:26.191 SPDK Configuration: 00:06:26.191 Core mask: 0x1 00:06:26.191 00:06:26.191 Accel Perf Configuration: 00:06:26.191 Workload Type: crc32c 00:06:26.191 CRC-32C seed: 32 00:06:26.191 Transfer size: 4096 bytes 00:06:26.191 Vector count 1 00:06:26.191 Module: software 00:06:26.191 Queue depth: 32 00:06:26.191 Allocate depth: 32 00:06:26.191 # threads/core: 1 00:06:26.191 Run time: 1 seconds 00:06:26.191 Verify: Yes 00:06:26.191 00:06:26.191 Running for 1 seconds... 00:06:26.191 00:06:26.191 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:26.191 ------------------------------------------------------------------------------------ 00:06:26.191 0,0 442496/s 1728 MiB/s 0 0 00:06:26.191 ==================================================================================== 00:06:26.191 Total 442496/s 1728 MiB/s 0 0' 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:26.191 04:03:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:26.191 04:03:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.191 04:03:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.191 04:03:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.191 04:03:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.191 04:03:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.191 04:03:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.191 04:03:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.191 04:03:40 -- accel/accel.sh@42 -- # jq -r . 00:06:26.191 [2024-05-14 04:03:40.482830] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:26.191 [2024-05-14 04:03:40.482931] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3741451 ] 00:06:26.191 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.191 [2024-05-14 04:03:40.544042] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.191 [2024-05-14 04:03:40.606162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val= 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val= 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val=0x1 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val= 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val= 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val=crc32c 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val=32 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val= 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val=software 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@23 -- # accel_module=software 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val=32 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val=32 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val=1 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val=Yes 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val= 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.191 04:03:40 -- accel/accel.sh@21 -- # val= 00:06:26.191 04:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.191 04:03:40 -- accel/accel.sh@20 -- # read -r var val 00:06:27.575 04:03:41 -- accel/accel.sh@21 -- # val= 00:06:27.575 04:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.575 04:03:41 -- accel/accel.sh@21 -- # val= 00:06:27.575 04:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.575 04:03:41 -- accel/accel.sh@21 -- # val= 00:06:27.575 04:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.575 04:03:41 -- accel/accel.sh@21 -- # val= 00:06:27.575 04:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.575 04:03:41 -- accel/accel.sh@21 -- # val= 00:06:27.575 04:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.575 04:03:41 -- accel/accel.sh@21 -- # val= 00:06:27.575 04:03:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.575 04:03:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.575 04:03:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:27.575 04:03:41 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:27.575 04:03:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:27.575 00:06:27.575 real 0m2.567s 00:06:27.575 user 0m2.372s 00:06:27.575 sys 0m0.189s 00:06:27.575 04:03:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:27.575 04:03:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.575 ************************************ 00:06:27.575 END TEST accel_crc32c 00:06:27.575 ************************************ 00:06:27.575 04:03:41 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:27.575 04:03:41 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:27.575 04:03:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:27.575 04:03:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.575 ************************************ 00:06:27.575 START TEST accel_crc32c_C2 00:06:27.575 ************************************ 00:06:27.575 04:03:41 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:27.575 04:03:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:27.575 04:03:41 -- accel/accel.sh@17 -- # local accel_module 00:06:27.575 04:03:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:27.575 04:03:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:27.575 04:03:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.575 04:03:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.575 04:03:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.575 04:03:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.575 04:03:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.575 04:03:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.575 04:03:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.575 04:03:41 -- accel/accel.sh@42 -- # jq -r . 00:06:27.575 [2024-05-14 04:03:41.797273] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:27.575 [2024-05-14 04:03:41.797391] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3741756 ] 00:06:27.575 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.575 [2024-05-14 04:03:41.859031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.575 [2024-05-14 04:03:41.922068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.516 04:03:43 -- accel/accel.sh@18 -- # out=' 00:06:28.516 SPDK Configuration: 00:06:28.516 Core mask: 0x1 00:06:28.516 00:06:28.516 Accel Perf Configuration: 00:06:28.516 Workload Type: crc32c 00:06:28.516 CRC-32C seed: 0 00:06:28.516 Transfer size: 4096 bytes 00:06:28.516 Vector count 2 00:06:28.516 Module: software 00:06:28.516 Queue depth: 32 00:06:28.516 Allocate depth: 32 00:06:28.516 # threads/core: 1 00:06:28.516 Run time: 1 seconds 00:06:28.516 Verify: Yes 00:06:28.516 00:06:28.516 Running for 1 seconds... 00:06:28.516 00:06:28.516 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:28.516 ------------------------------------------------------------------------------------ 00:06:28.516 0,0 373824/s 2920 MiB/s 0 0 00:06:28.516 ==================================================================================== 00:06:28.516 Total 373824/s 1460 MiB/s 0 0' 00:06:28.516 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.516 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.516 04:03:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:28.516 04:03:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:28.516 04:03:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:28.516 04:03:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.516 04:03:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.516 04:03:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.516 04:03:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.516 04:03:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.516 04:03:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.516 04:03:43 -- accel/accel.sh@42 -- # jq -r . 00:06:28.516 [2024-05-14 04:03:43.072259] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:28.516 [2024-05-14 04:03:43.072338] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3742096 ] 00:06:28.516 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.777 [2024-05-14 04:03:43.132601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:28.777 [2024-05-14 04:03:43.195474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.777 04:03:43 -- accel/accel.sh@21 -- # val= 00:06:28.777 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.777 04:03:43 -- accel/accel.sh@21 -- # val= 00:06:28.777 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.777 04:03:43 -- accel/accel.sh@21 -- # val=0x1 00:06:28.777 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.777 04:03:43 -- accel/accel.sh@21 -- # val= 00:06:28.777 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.777 04:03:43 -- accel/accel.sh@21 -- # val= 00:06:28.777 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.777 04:03:43 -- accel/accel.sh@21 -- # val=crc32c 00:06:28.777 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.777 04:03:43 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.777 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val=0 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val= 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val=software 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@23 -- # accel_module=software 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val=32 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val=32 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val=1 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val=Yes 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val= 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:28.778 04:03:43 -- accel/accel.sh@21 -- # val= 00:06:28.778 04:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # IFS=: 00:06:28.778 04:03:43 -- accel/accel.sh@20 -- # read -r var val 00:06:30.161 04:03:44 -- accel/accel.sh@21 -- # val= 00:06:30.161 04:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.161 04:03:44 -- accel/accel.sh@21 -- # val= 00:06:30.161 04:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.161 04:03:44 -- accel/accel.sh@21 -- # val= 00:06:30.161 04:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.161 04:03:44 -- accel/accel.sh@21 -- # val= 00:06:30.161 04:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.161 04:03:44 -- accel/accel.sh@21 -- # val= 00:06:30.161 04:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.161 04:03:44 -- accel/accel.sh@21 -- # val= 00:06:30.161 04:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.161 04:03:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.161 04:03:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:30.161 04:03:44 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:30.161 04:03:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:30.161 00:06:30.161 real 0m2.552s 00:06:30.161 user 0m2.351s 00:06:30.161 sys 0m0.196s 00:06:30.161 04:03:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:30.161 04:03:44 -- common/autotest_common.sh@10 -- # set +x 00:06:30.161 ************************************ 00:06:30.161 END TEST accel_crc32c_C2 00:06:30.161 ************************************ 00:06:30.161 04:03:44 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:30.161 04:03:44 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:30.161 04:03:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:30.161 04:03:44 -- common/autotest_common.sh@10 -- # set +x 00:06:30.161 ************************************ 00:06:30.161 START TEST accel_copy 00:06:30.161 ************************************ 00:06:30.161 04:03:44 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:06:30.161 04:03:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:30.161 04:03:44 -- accel/accel.sh@17 -- # local accel_module 00:06:30.161 04:03:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:30.161 04:03:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:30.161 04:03:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.161 04:03:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.161 04:03:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.161 04:03:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.161 04:03:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.161 04:03:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.161 04:03:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.161 04:03:44 -- accel/accel.sh@42 -- # jq -r . 00:06:30.162 [2024-05-14 04:03:44.387176] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:30.162 [2024-05-14 04:03:44.387278] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3742450 ] 00:06:30.162 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.162 [2024-05-14 04:03:44.448150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.162 [2024-05-14 04:03:44.510333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.102 04:03:45 -- accel/accel.sh@18 -- # out=' 00:06:31.102 SPDK Configuration: 00:06:31.102 Core mask: 0x1 00:06:31.102 00:06:31.102 Accel Perf Configuration: 00:06:31.102 Workload Type: copy 00:06:31.102 Transfer size: 4096 bytes 00:06:31.102 Vector count 1 00:06:31.102 Module: software 00:06:31.102 Queue depth: 32 00:06:31.102 Allocate depth: 32 00:06:31.102 # threads/core: 1 00:06:31.102 Run time: 1 seconds 00:06:31.102 Verify: Yes 00:06:31.102 00:06:31.102 Running for 1 seconds... 00:06:31.102 00:06:31.102 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:31.102 ------------------------------------------------------------------------------------ 00:06:31.102 0,0 304928/s 1191 MiB/s 0 0 00:06:31.102 ==================================================================================== 00:06:31.102 Total 304928/s 1191 MiB/s 0 0' 00:06:31.102 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.102 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.102 04:03:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:31.102 04:03:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:31.102 04:03:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.102 04:03:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:31.102 04:03:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.102 04:03:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.102 04:03:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:31.102 04:03:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:31.102 04:03:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:31.102 04:03:45 -- accel/accel.sh@42 -- # jq -r . 00:06:31.102 [2024-05-14 04:03:45.662388] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:31.102 [2024-05-14 04:03:45.662490] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3742585 ] 00:06:31.102 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.363 [2024-05-14 04:03:45.722813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.363 [2024-05-14 04:03:45.784371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val= 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val= 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val=0x1 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val= 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val= 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val=copy 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val= 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val=software 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@23 -- # accel_module=software 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val=32 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val=32 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val=1 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val=Yes 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val= 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:31.363 04:03:45 -- accel/accel.sh@21 -- # val= 00:06:31.363 04:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # IFS=: 00:06:31.363 04:03:45 -- accel/accel.sh@20 -- # read -r var val 00:06:32.747 04:03:46 -- accel/accel.sh@21 -- # val= 00:06:32.747 04:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # IFS=: 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # read -r var val 00:06:32.747 04:03:46 -- accel/accel.sh@21 -- # val= 00:06:32.747 04:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # IFS=: 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # read -r var val 00:06:32.747 04:03:46 -- accel/accel.sh@21 -- # val= 00:06:32.747 04:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # IFS=: 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # read -r var val 00:06:32.747 04:03:46 -- accel/accel.sh@21 -- # val= 00:06:32.747 04:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # IFS=: 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # read -r var val 00:06:32.747 04:03:46 -- accel/accel.sh@21 -- # val= 00:06:32.747 04:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # IFS=: 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # read -r var val 00:06:32.747 04:03:46 -- accel/accel.sh@21 -- # val= 00:06:32.747 04:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # IFS=: 00:06:32.747 04:03:46 -- accel/accel.sh@20 -- # read -r var val 00:06:32.747 04:03:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:32.747 04:03:46 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:32.747 04:03:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:32.747 00:06:32.747 real 0m2.550s 00:06:32.747 user 0m2.355s 00:06:32.747 sys 0m0.190s 00:06:32.747 04:03:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:32.747 04:03:46 -- common/autotest_common.sh@10 -- # set +x 00:06:32.747 ************************************ 00:06:32.747 END TEST accel_copy 00:06:32.747 ************************************ 00:06:32.747 04:03:46 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:32.747 04:03:46 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:32.747 04:03:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:32.747 04:03:46 -- common/autotest_common.sh@10 -- # set +x 00:06:32.747 ************************************ 00:06:32.747 START TEST accel_fill 00:06:32.747 ************************************ 00:06:32.747 04:03:46 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:32.747 04:03:46 -- accel/accel.sh@16 -- # local accel_opc 00:06:32.747 04:03:46 -- accel/accel.sh@17 -- # local accel_module 00:06:32.747 04:03:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:32.747 04:03:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:32.747 04:03:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.747 04:03:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.747 04:03:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.747 04:03:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.747 04:03:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.747 04:03:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.747 04:03:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.747 04:03:46 -- accel/accel.sh@42 -- # jq -r . 00:06:32.747 [2024-05-14 04:03:46.974673] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:32.747 [2024-05-14 04:03:46.974769] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3742824 ] 00:06:32.747 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.747 [2024-05-14 04:03:47.036984] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.747 [2024-05-14 04:03:47.099354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.688 04:03:48 -- accel/accel.sh@18 -- # out=' 00:06:33.688 SPDK Configuration: 00:06:33.688 Core mask: 0x1 00:06:33.688 00:06:33.688 Accel Perf Configuration: 00:06:33.688 Workload Type: fill 00:06:33.688 Fill pattern: 0x80 00:06:33.688 Transfer size: 4096 bytes 00:06:33.688 Vector count 1 00:06:33.688 Module: software 00:06:33.688 Queue depth: 64 00:06:33.688 Allocate depth: 64 00:06:33.688 # threads/core: 1 00:06:33.688 Run time: 1 seconds 00:06:33.688 Verify: Yes 00:06:33.688 00:06:33.688 Running for 1 seconds... 00:06:33.688 00:06:33.688 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:33.688 ------------------------------------------------------------------------------------ 00:06:33.688 0,0 464384/s 1814 MiB/s 0 0 00:06:33.688 ==================================================================================== 00:06:33.688 Total 464384/s 1814 MiB/s 0 0' 00:06:33.688 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.688 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.688 04:03:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:33.688 04:03:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:33.688 04:03:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.688 04:03:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.688 04:03:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.688 04:03:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.688 04:03:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.688 04:03:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.688 04:03:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.688 04:03:48 -- accel/accel.sh@42 -- # jq -r . 00:06:33.688 [2024-05-14 04:03:48.251127] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:33.688 [2024-05-14 04:03:48.251205] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3743158 ] 00:06:33.949 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.949 [2024-05-14 04:03:48.311761] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.949 [2024-05-14 04:03:48.372976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val= 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val= 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val=0x1 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val= 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val= 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val=fill 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@24 -- # accel_opc=fill 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val=0x80 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val= 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val=software 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@23 -- # accel_module=software 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val=64 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val=64 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val=1 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val=Yes 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val= 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:33.949 04:03:48 -- accel/accel.sh@21 -- # val= 00:06:33.949 04:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # IFS=: 00:06:33.949 04:03:48 -- accel/accel.sh@20 -- # read -r var val 00:06:35.333 04:03:49 -- accel/accel.sh@21 -- # val= 00:06:35.333 04:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # IFS=: 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # read -r var val 00:06:35.333 04:03:49 -- accel/accel.sh@21 -- # val= 00:06:35.333 04:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # IFS=: 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # read -r var val 00:06:35.333 04:03:49 -- accel/accel.sh@21 -- # val= 00:06:35.333 04:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # IFS=: 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # read -r var val 00:06:35.333 04:03:49 -- accel/accel.sh@21 -- # val= 00:06:35.333 04:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # IFS=: 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # read -r var val 00:06:35.333 04:03:49 -- accel/accel.sh@21 -- # val= 00:06:35.333 04:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # IFS=: 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # read -r var val 00:06:35.333 04:03:49 -- accel/accel.sh@21 -- # val= 00:06:35.333 04:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # IFS=: 00:06:35.333 04:03:49 -- accel/accel.sh@20 -- # read -r var val 00:06:35.333 04:03:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:35.333 04:03:49 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:06:35.333 04:03:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:35.333 00:06:35.333 real 0m2.551s 00:06:35.333 user 0m2.350s 00:06:35.333 sys 0m0.196s 00:06:35.333 04:03:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:35.333 04:03:49 -- common/autotest_common.sh@10 -- # set +x 00:06:35.333 ************************************ 00:06:35.333 END TEST accel_fill 00:06:35.333 ************************************ 00:06:35.333 04:03:49 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:35.333 04:03:49 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:35.333 04:03:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:35.333 04:03:49 -- common/autotest_common.sh@10 -- # set +x 00:06:35.333 ************************************ 00:06:35.333 START TEST accel_copy_crc32c 00:06:35.333 ************************************ 00:06:35.333 04:03:49 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:06:35.333 04:03:49 -- accel/accel.sh@16 -- # local accel_opc 00:06:35.333 04:03:49 -- accel/accel.sh@17 -- # local accel_module 00:06:35.333 04:03:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:35.333 04:03:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:35.333 04:03:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:35.333 04:03:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.333 04:03:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.333 04:03:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.333 04:03:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.333 04:03:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.333 04:03:49 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.333 04:03:49 -- accel/accel.sh@42 -- # jq -r . 00:06:35.333 [2024-05-14 04:03:49.567892] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:35.333 [2024-05-14 04:03:49.567963] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3743507 ] 00:06:35.333 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.333 [2024-05-14 04:03:49.628577] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.333 [2024-05-14 04:03:49.690040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.274 04:03:50 -- accel/accel.sh@18 -- # out=' 00:06:36.274 SPDK Configuration: 00:06:36.274 Core mask: 0x1 00:06:36.274 00:06:36.274 Accel Perf Configuration: 00:06:36.274 Workload Type: copy_crc32c 00:06:36.274 CRC-32C seed: 0 00:06:36.274 Vector size: 4096 bytes 00:06:36.274 Transfer size: 4096 bytes 00:06:36.274 Vector count 1 00:06:36.274 Module: software 00:06:36.274 Queue depth: 32 00:06:36.274 Allocate depth: 32 00:06:36.274 # threads/core: 1 00:06:36.274 Run time: 1 seconds 00:06:36.274 Verify: Yes 00:06:36.274 00:06:36.274 Running for 1 seconds... 00:06:36.274 00:06:36.274 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:36.274 ------------------------------------------------------------------------------------ 00:06:36.274 0,0 248096/s 969 MiB/s 0 0 00:06:36.274 ==================================================================================== 00:06:36.274 Total 248096/s 969 MiB/s 0 0' 00:06:36.274 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.274 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.274 04:03:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:36.274 04:03:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:36.274 04:03:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.274 04:03:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.274 04:03:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.274 04:03:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.274 04:03:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.274 04:03:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.274 04:03:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.274 04:03:50 -- accel/accel.sh@42 -- # jq -r . 00:06:36.274 [2024-05-14 04:03:50.843003] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:36.274 [2024-05-14 04:03:50.843109] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3743700 ] 00:06:36.535 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.535 [2024-05-14 04:03:50.903844] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.535 [2024-05-14 04:03:50.965808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val= 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val= 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val=0x1 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val= 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val= 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val=0 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val= 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.535 04:03:50 -- accel/accel.sh@21 -- # val=software 00:06:36.535 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.535 04:03:50 -- accel/accel.sh@23 -- # accel_module=software 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.535 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.536 04:03:50 -- accel/accel.sh@21 -- # val=32 00:06:36.536 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.536 04:03:50 -- accel/accel.sh@21 -- # val=32 00:06:36.536 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.536 04:03:50 -- accel/accel.sh@21 -- # val=1 00:06:36.536 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.536 04:03:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:36.536 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.536 04:03:50 -- accel/accel.sh@21 -- # val=Yes 00:06:36.536 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.536 04:03:50 -- accel/accel.sh@21 -- # val= 00:06:36.536 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:36.536 04:03:50 -- accel/accel.sh@21 -- # val= 00:06:36.536 04:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # IFS=: 00:06:36.536 04:03:50 -- accel/accel.sh@20 -- # read -r var val 00:06:37.919 04:03:52 -- accel/accel.sh@21 -- # val= 00:06:37.919 04:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # IFS=: 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # read -r var val 00:06:37.919 04:03:52 -- accel/accel.sh@21 -- # val= 00:06:37.919 04:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # IFS=: 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # read -r var val 00:06:37.919 04:03:52 -- accel/accel.sh@21 -- # val= 00:06:37.919 04:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # IFS=: 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # read -r var val 00:06:37.919 04:03:52 -- accel/accel.sh@21 -- # val= 00:06:37.919 04:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # IFS=: 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # read -r var val 00:06:37.919 04:03:52 -- accel/accel.sh@21 -- # val= 00:06:37.919 04:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # IFS=: 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # read -r var val 00:06:37.919 04:03:52 -- accel/accel.sh@21 -- # val= 00:06:37.919 04:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # IFS=: 00:06:37.919 04:03:52 -- accel/accel.sh@20 -- # read -r var val 00:06:37.919 04:03:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:37.919 04:03:52 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:37.919 04:03:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:37.919 00:06:37.919 real 0m2.550s 00:06:37.919 user 0m2.355s 00:06:37.919 sys 0m0.190s 00:06:37.919 04:03:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:37.919 04:03:52 -- common/autotest_common.sh@10 -- # set +x 00:06:37.919 ************************************ 00:06:37.919 END TEST accel_copy_crc32c 00:06:37.919 ************************************ 00:06:37.919 04:03:52 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:37.919 04:03:52 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:37.919 04:03:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:37.919 04:03:52 -- common/autotest_common.sh@10 -- # set +x 00:06:37.919 ************************************ 00:06:37.919 START TEST accel_copy_crc32c_C2 00:06:37.919 ************************************ 00:06:37.919 04:03:52 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:37.919 04:03:52 -- accel/accel.sh@16 -- # local accel_opc 00:06:37.919 04:03:52 -- accel/accel.sh@17 -- # local accel_module 00:06:37.919 04:03:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:37.919 04:03:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:37.919 04:03:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:37.919 04:03:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:37.919 04:03:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:37.919 04:03:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:37.919 04:03:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:37.919 04:03:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:37.919 04:03:52 -- accel/accel.sh@41 -- # local IFS=, 00:06:37.919 04:03:52 -- accel/accel.sh@42 -- # jq -r . 00:06:37.919 [2024-05-14 04:03:52.153480] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:37.919 [2024-05-14 04:03:52.153554] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3743889 ] 00:06:37.919 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.919 [2024-05-14 04:03:52.214550] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.919 [2024-05-14 04:03:52.278704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.913 04:03:53 -- accel/accel.sh@18 -- # out=' 00:06:38.913 SPDK Configuration: 00:06:38.913 Core mask: 0x1 00:06:38.913 00:06:38.913 Accel Perf Configuration: 00:06:38.913 Workload Type: copy_crc32c 00:06:38.913 CRC-32C seed: 0 00:06:38.913 Vector size: 4096 bytes 00:06:38.913 Transfer size: 8192 bytes 00:06:38.913 Vector count 2 00:06:38.913 Module: software 00:06:38.913 Queue depth: 32 00:06:38.913 Allocate depth: 32 00:06:38.913 # threads/core: 1 00:06:38.913 Run time: 1 seconds 00:06:38.913 Verify: Yes 00:06:38.913 00:06:38.913 Running for 1 seconds... 00:06:38.913 00:06:38.913 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:38.913 ------------------------------------------------------------------------------------ 00:06:38.913 0,0 187296/s 1463 MiB/s 0 0 00:06:38.913 ==================================================================================== 00:06:38.913 Total 187296/s 731 MiB/s 0 0' 00:06:38.913 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:38.913 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:38.913 04:03:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:38.913 04:03:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:38.913 04:03:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.913 04:03:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.913 04:03:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.913 04:03:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.913 04:03:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.913 04:03:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.913 04:03:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.913 04:03:53 -- accel/accel.sh@42 -- # jq -r . 00:06:38.913 [2024-05-14 04:03:53.428748] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:38.913 [2024-05-14 04:03:53.428826] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3744222 ] 00:06:38.913 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.913 [2024-05-14 04:03:53.488913] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.173 [2024-05-14 04:03:53.549674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val= 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val= 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val=0x1 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val= 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val= 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val=0 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val='8192 bytes' 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val= 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val=software 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@23 -- # accel_module=software 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.173 04:03:53 -- accel/accel.sh@21 -- # val=32 00:06:39.173 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.173 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.174 04:03:53 -- accel/accel.sh@21 -- # val=32 00:06:39.174 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.174 04:03:53 -- accel/accel.sh@21 -- # val=1 00:06:39.174 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.174 04:03:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:39.174 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.174 04:03:53 -- accel/accel.sh@21 -- # val=Yes 00:06:39.174 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.174 04:03:53 -- accel/accel.sh@21 -- # val= 00:06:39.174 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:39.174 04:03:53 -- accel/accel.sh@21 -- # val= 00:06:39.174 04:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # IFS=: 00:06:39.174 04:03:53 -- accel/accel.sh@20 -- # read -r var val 00:06:40.124 04:03:54 -- accel/accel.sh@21 -- # val= 00:06:40.124 04:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # IFS=: 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # read -r var val 00:06:40.124 04:03:54 -- accel/accel.sh@21 -- # val= 00:06:40.124 04:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # IFS=: 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # read -r var val 00:06:40.124 04:03:54 -- accel/accel.sh@21 -- # val= 00:06:40.124 04:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # IFS=: 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # read -r var val 00:06:40.124 04:03:54 -- accel/accel.sh@21 -- # val= 00:06:40.124 04:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # IFS=: 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # read -r var val 00:06:40.124 04:03:54 -- accel/accel.sh@21 -- # val= 00:06:40.124 04:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # IFS=: 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # read -r var val 00:06:40.124 04:03:54 -- accel/accel.sh@21 -- # val= 00:06:40.124 04:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # IFS=: 00:06:40.124 04:03:54 -- accel/accel.sh@20 -- # read -r var val 00:06:40.124 04:03:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:40.124 04:03:54 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:40.124 04:03:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:40.124 00:06:40.124 real 0m2.547s 00:06:40.124 user 0m2.350s 00:06:40.124 sys 0m0.191s 00:06:40.124 04:03:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:40.124 04:03:54 -- common/autotest_common.sh@10 -- # set +x 00:06:40.124 ************************************ 00:06:40.124 END TEST accel_copy_crc32c_C2 00:06:40.124 ************************************ 00:06:40.124 04:03:54 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:40.124 04:03:54 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:40.124 04:03:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:40.124 04:03:54 -- common/autotest_common.sh@10 -- # set +x 00:06:40.386 ************************************ 00:06:40.386 START TEST accel_dualcast 00:06:40.386 ************************************ 00:06:40.386 04:03:54 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:06:40.386 04:03:54 -- accel/accel.sh@16 -- # local accel_opc 00:06:40.386 04:03:54 -- accel/accel.sh@17 -- # local accel_module 00:06:40.386 04:03:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:06:40.386 04:03:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:40.386 04:03:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:40.386 04:03:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:40.386 04:03:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:40.386 04:03:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:40.386 04:03:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:40.386 04:03:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:40.386 04:03:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:40.386 04:03:54 -- accel/accel.sh@42 -- # jq -r . 00:06:40.386 [2024-05-14 04:03:54.739098] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:40.386 [2024-05-14 04:03:54.739169] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3744571 ] 00:06:40.386 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.386 [2024-05-14 04:03:54.799204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:40.386 [2024-05-14 04:03:54.862166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.768 04:03:55 -- accel/accel.sh@18 -- # out=' 00:06:41.768 SPDK Configuration: 00:06:41.768 Core mask: 0x1 00:06:41.768 00:06:41.768 Accel Perf Configuration: 00:06:41.768 Workload Type: dualcast 00:06:41.768 Transfer size: 4096 bytes 00:06:41.768 Vector count 1 00:06:41.768 Module: software 00:06:41.768 Queue depth: 32 00:06:41.768 Allocate depth: 32 00:06:41.768 # threads/core: 1 00:06:41.768 Run time: 1 seconds 00:06:41.768 Verify: Yes 00:06:41.768 00:06:41.768 Running for 1 seconds... 00:06:41.768 00:06:41.768 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:41.768 ------------------------------------------------------------------------------------ 00:06:41.768 0,0 365408/s 1427 MiB/s 0 0 00:06:41.768 ==================================================================================== 00:06:41.768 Total 365408/s 1427 MiB/s 0 0' 00:06:41.768 04:03:55 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:55 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:41.768 04:03:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:41.768 04:03:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:41.768 04:03:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:41.768 04:03:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:41.768 04:03:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:41.768 04:03:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:41.768 04:03:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:41.768 04:03:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:41.768 04:03:55 -- accel/accel.sh@42 -- # jq -r . 00:06:41.768 [2024-05-14 04:03:56.014542] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:41.768 [2024-05-14 04:03:56.014646] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3744803 ] 00:06:41.768 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.768 [2024-05-14 04:03:56.077727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.768 [2024-05-14 04:03:56.140079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val= 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val= 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val=0x1 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val= 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val= 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val=dualcast 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val= 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val=software 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@23 -- # accel_module=software 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val=32 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val=32 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val=1 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val=Yes 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.768 04:03:56 -- accel/accel.sh@21 -- # val= 00:06:41.768 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.768 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.769 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:41.769 04:03:56 -- accel/accel.sh@21 -- # val= 00:06:41.769 04:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.769 04:03:56 -- accel/accel.sh@20 -- # IFS=: 00:06:41.769 04:03:56 -- accel/accel.sh@20 -- # read -r var val 00:06:42.709 04:03:57 -- accel/accel.sh@21 -- # val= 00:06:42.709 04:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:42.709 04:03:57 -- accel/accel.sh@21 -- # val= 00:06:42.709 04:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:42.709 04:03:57 -- accel/accel.sh@21 -- # val= 00:06:42.709 04:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:42.709 04:03:57 -- accel/accel.sh@21 -- # val= 00:06:42.709 04:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:42.709 04:03:57 -- accel/accel.sh@21 -- # val= 00:06:42.709 04:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:42.709 04:03:57 -- accel/accel.sh@21 -- # val= 00:06:42.709 04:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:42.709 04:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:42.709 04:03:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:42.709 04:03:57 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:42.709 04:03:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:42.709 00:06:42.709 real 0m2.552s 00:06:42.709 user 0m2.357s 00:06:42.709 sys 0m0.191s 00:06:42.709 04:03:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:42.709 04:03:57 -- common/autotest_common.sh@10 -- # set +x 00:06:42.709 ************************************ 00:06:42.709 END TEST accel_dualcast 00:06:42.709 ************************************ 00:06:42.970 04:03:57 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:42.970 04:03:57 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:42.970 04:03:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:42.970 04:03:57 -- common/autotest_common.sh@10 -- # set +x 00:06:42.970 ************************************ 00:06:42.970 START TEST accel_compare 00:06:42.970 ************************************ 00:06:42.970 04:03:57 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:06:42.970 04:03:57 -- accel/accel.sh@16 -- # local accel_opc 00:06:42.970 04:03:57 -- accel/accel.sh@17 -- # local accel_module 00:06:42.970 04:03:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:42.970 04:03:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:42.970 04:03:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:42.970 04:03:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:42.970 04:03:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:42.970 04:03:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:42.970 04:03:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:42.970 04:03:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:42.970 04:03:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:42.970 04:03:57 -- accel/accel.sh@42 -- # jq -r . 00:06:42.970 [2024-05-14 04:03:57.330275] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:42.970 [2024-05-14 04:03:57.330396] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3744973 ] 00:06:42.970 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.970 [2024-05-14 04:03:57.391362] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.970 [2024-05-14 04:03:57.453825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.355 04:03:58 -- accel/accel.sh@18 -- # out=' 00:06:44.355 SPDK Configuration: 00:06:44.355 Core mask: 0x1 00:06:44.355 00:06:44.355 Accel Perf Configuration: 00:06:44.355 Workload Type: compare 00:06:44.355 Transfer size: 4096 bytes 00:06:44.355 Vector count 1 00:06:44.355 Module: software 00:06:44.355 Queue depth: 32 00:06:44.355 Allocate depth: 32 00:06:44.355 # threads/core: 1 00:06:44.355 Run time: 1 seconds 00:06:44.355 Verify: Yes 00:06:44.355 00:06:44.355 Running for 1 seconds... 00:06:44.355 00:06:44.355 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:44.355 ------------------------------------------------------------------------------------ 00:06:44.355 0,0 436736/s 1706 MiB/s 0 0 00:06:44.355 ==================================================================================== 00:06:44.355 Total 436736/s 1706 MiB/s 0 0' 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:44.355 04:03:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:44.355 04:03:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:44.355 04:03:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:44.355 04:03:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:44.355 04:03:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:44.355 04:03:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:44.355 04:03:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:44.355 04:03:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:44.355 04:03:58 -- accel/accel.sh@42 -- # jq -r . 00:06:44.355 [2024-05-14 04:03:58.605251] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:44.355 [2024-05-14 04:03:58.605360] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3745281 ] 00:06:44.355 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.355 [2024-05-14 04:03:58.666626] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.355 [2024-05-14 04:03:58.728382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val= 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val= 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val=0x1 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val= 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val= 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val=compare 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val= 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val=software 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@23 -- # accel_module=software 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val=32 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val=32 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val=1 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val=Yes 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val= 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:44.355 04:03:58 -- accel/accel.sh@21 -- # val= 00:06:44.355 04:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:44.355 04:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:45.298 04:03:59 -- accel/accel.sh@21 -- # val= 00:06:45.298 04:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # IFS=: 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # read -r var val 00:06:45.298 04:03:59 -- accel/accel.sh@21 -- # val= 00:06:45.298 04:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # IFS=: 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # read -r var val 00:06:45.298 04:03:59 -- accel/accel.sh@21 -- # val= 00:06:45.298 04:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # IFS=: 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # read -r var val 00:06:45.298 04:03:59 -- accel/accel.sh@21 -- # val= 00:06:45.298 04:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # IFS=: 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # read -r var val 00:06:45.298 04:03:59 -- accel/accel.sh@21 -- # val= 00:06:45.298 04:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # IFS=: 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # read -r var val 00:06:45.298 04:03:59 -- accel/accel.sh@21 -- # val= 00:06:45.298 04:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # IFS=: 00:06:45.298 04:03:59 -- accel/accel.sh@20 -- # read -r var val 00:06:45.298 04:03:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:45.298 04:03:59 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:45.298 04:03:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:45.298 00:06:45.298 real 0m2.551s 00:06:45.298 user 0m2.346s 00:06:45.298 sys 0m0.199s 00:06:45.298 04:03:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:45.298 04:03:59 -- common/autotest_common.sh@10 -- # set +x 00:06:45.298 ************************************ 00:06:45.298 END TEST accel_compare 00:06:45.298 ************************************ 00:06:45.558 04:03:59 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:45.558 04:03:59 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:45.558 04:03:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:45.558 04:03:59 -- common/autotest_common.sh@10 -- # set +x 00:06:45.558 ************************************ 00:06:45.558 START TEST accel_xor 00:06:45.558 ************************************ 00:06:45.558 04:03:59 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:06:45.558 04:03:59 -- accel/accel.sh@16 -- # local accel_opc 00:06:45.558 04:03:59 -- accel/accel.sh@17 -- # local accel_module 00:06:45.558 04:03:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:45.558 04:03:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:45.558 04:03:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:45.558 04:03:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:45.558 04:03:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:45.558 04:03:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:45.558 04:03:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:45.558 04:03:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:45.558 04:03:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:45.558 04:03:59 -- accel/accel.sh@42 -- # jq -r . 00:06:45.558 [2024-05-14 04:03:59.918354] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:45.558 [2024-05-14 04:03:59.918456] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3745632 ] 00:06:45.558 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.558 [2024-05-14 04:03:59.979957] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.558 [2024-05-14 04:04:00.045588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.942 04:04:01 -- accel/accel.sh@18 -- # out=' 00:06:46.942 SPDK Configuration: 00:06:46.942 Core mask: 0x1 00:06:46.942 00:06:46.942 Accel Perf Configuration: 00:06:46.942 Workload Type: xor 00:06:46.942 Source buffers: 2 00:06:46.942 Transfer size: 4096 bytes 00:06:46.942 Vector count 1 00:06:46.942 Module: software 00:06:46.942 Queue depth: 32 00:06:46.942 Allocate depth: 32 00:06:46.942 # threads/core: 1 00:06:46.942 Run time: 1 seconds 00:06:46.942 Verify: Yes 00:06:46.942 00:06:46.942 Running for 1 seconds... 00:06:46.942 00:06:46.942 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:46.942 ------------------------------------------------------------------------------------ 00:06:46.942 0,0 359520/s 1404 MiB/s 0 0 00:06:46.943 ==================================================================================== 00:06:46.943 Total 359520/s 1404 MiB/s 0 0' 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:46.943 04:04:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:46.943 04:04:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:46.943 04:04:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:46.943 04:04:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:46.943 04:04:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:46.943 04:04:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:46.943 04:04:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:46.943 04:04:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:46.943 04:04:01 -- accel/accel.sh@42 -- # jq -r . 00:06:46.943 [2024-05-14 04:04:01.198553] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:46.943 [2024-05-14 04:04:01.198633] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3745921 ] 00:06:46.943 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.943 [2024-05-14 04:04:01.258770] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.943 [2024-05-14 04:04:01.320279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val= 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val= 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val=0x1 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val= 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val= 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val=xor 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val=2 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val= 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val=software 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@23 -- # accel_module=software 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val=32 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val=32 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val=1 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val=Yes 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val= 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:46.943 04:04:01 -- accel/accel.sh@21 -- # val= 00:06:46.943 04:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:46.943 04:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:47.884 04:04:02 -- accel/accel.sh@21 -- # val= 00:06:47.884 04:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # IFS=: 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # read -r var val 00:06:47.884 04:04:02 -- accel/accel.sh@21 -- # val= 00:06:47.884 04:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # IFS=: 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # read -r var val 00:06:47.884 04:04:02 -- accel/accel.sh@21 -- # val= 00:06:47.884 04:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # IFS=: 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # read -r var val 00:06:47.884 04:04:02 -- accel/accel.sh@21 -- # val= 00:06:47.884 04:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # IFS=: 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # read -r var val 00:06:47.884 04:04:02 -- accel/accel.sh@21 -- # val= 00:06:47.884 04:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # IFS=: 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # read -r var val 00:06:47.884 04:04:02 -- accel/accel.sh@21 -- # val= 00:06:47.884 04:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # IFS=: 00:06:47.884 04:04:02 -- accel/accel.sh@20 -- # read -r var val 00:06:47.884 04:04:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:47.884 04:04:02 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:47.884 04:04:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:47.884 00:06:47.884 real 0m2.554s 00:06:47.884 user 0m2.363s 00:06:47.884 sys 0m0.187s 00:06:47.884 04:04:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:47.884 04:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:47.884 ************************************ 00:06:47.884 END TEST accel_xor 00:06:47.884 ************************************ 00:06:48.144 04:04:02 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:48.144 04:04:02 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:48.144 04:04:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:48.144 04:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:48.144 ************************************ 00:06:48.144 START TEST accel_xor 00:06:48.144 ************************************ 00:06:48.144 04:04:02 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:06:48.144 04:04:02 -- accel/accel.sh@16 -- # local accel_opc 00:06:48.144 04:04:02 -- accel/accel.sh@17 -- # local accel_module 00:06:48.144 04:04:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:48.144 04:04:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:48.144 04:04:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.144 04:04:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.144 04:04:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.144 04:04:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.144 04:04:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.144 04:04:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.144 04:04:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.144 04:04:02 -- accel/accel.sh@42 -- # jq -r . 00:06:48.144 [2024-05-14 04:04:02.508573] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:48.144 [2024-05-14 04:04:02.508657] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3746095 ] 00:06:48.144 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.144 [2024-05-14 04:04:02.569766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.144 [2024-05-14 04:04:02.633368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.545 04:04:03 -- accel/accel.sh@18 -- # out=' 00:06:49.545 SPDK Configuration: 00:06:49.545 Core mask: 0x1 00:06:49.545 00:06:49.545 Accel Perf Configuration: 00:06:49.545 Workload Type: xor 00:06:49.545 Source buffers: 3 00:06:49.545 Transfer size: 4096 bytes 00:06:49.545 Vector count 1 00:06:49.545 Module: software 00:06:49.545 Queue depth: 32 00:06:49.545 Allocate depth: 32 00:06:49.545 # threads/core: 1 00:06:49.545 Run time: 1 seconds 00:06:49.545 Verify: Yes 00:06:49.545 00:06:49.545 Running for 1 seconds... 00:06:49.545 00:06:49.545 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:49.545 ------------------------------------------------------------------------------------ 00:06:49.545 0,0 344384/s 1345 MiB/s 0 0 00:06:49.545 ==================================================================================== 00:06:49.545 Total 344384/s 1345 MiB/s 0 0' 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:49.545 04:04:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:49.545 04:04:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.545 04:04:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.545 04:04:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.545 04:04:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.545 04:04:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.545 04:04:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.545 04:04:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.545 04:04:03 -- accel/accel.sh@42 -- # jq -r . 00:06:49.545 [2024-05-14 04:04:03.785920] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:49.545 [2024-05-14 04:04:03.786010] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3746342 ] 00:06:49.545 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.545 [2024-05-14 04:04:03.847405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.545 [2024-05-14 04:04:03.908177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val= 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val= 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val=0x1 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val= 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val= 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val=xor 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val=3 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val= 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val=software 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@23 -- # accel_module=software 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val=32 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val=32 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val=1 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val=Yes 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val= 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:49.545 04:04:03 -- accel/accel.sh@21 -- # val= 00:06:49.545 04:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:49.545 04:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:50.488 04:04:05 -- accel/accel.sh@21 -- # val= 00:06:50.488 04:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # IFS=: 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # read -r var val 00:06:50.488 04:04:05 -- accel/accel.sh@21 -- # val= 00:06:50.488 04:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # IFS=: 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # read -r var val 00:06:50.488 04:04:05 -- accel/accel.sh@21 -- # val= 00:06:50.488 04:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # IFS=: 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # read -r var val 00:06:50.488 04:04:05 -- accel/accel.sh@21 -- # val= 00:06:50.488 04:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # IFS=: 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # read -r var val 00:06:50.488 04:04:05 -- accel/accel.sh@21 -- # val= 00:06:50.488 04:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # IFS=: 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # read -r var val 00:06:50.488 04:04:05 -- accel/accel.sh@21 -- # val= 00:06:50.488 04:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # IFS=: 00:06:50.488 04:04:05 -- accel/accel.sh@20 -- # read -r var val 00:06:50.488 04:04:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:50.488 04:04:05 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:50.488 04:04:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:50.488 00:06:50.488 real 0m2.555s 00:06:50.488 user 0m2.377s 00:06:50.488 sys 0m0.185s 00:06:50.488 04:04:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:50.488 04:04:05 -- common/autotest_common.sh@10 -- # set +x 00:06:50.488 ************************************ 00:06:50.488 END TEST accel_xor 00:06:50.488 ************************************ 00:06:50.488 04:04:05 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:50.488 04:04:05 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:50.488 04:04:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:50.488 04:04:05 -- common/autotest_common.sh@10 -- # set +x 00:06:50.748 ************************************ 00:06:50.748 START TEST accel_dif_verify 00:06:50.748 ************************************ 00:06:50.748 04:04:05 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:06:50.748 04:04:05 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.749 04:04:05 -- accel/accel.sh@17 -- # local accel_module 00:06:50.749 04:04:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:50.749 04:04:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:50.749 04:04:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.749 04:04:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.749 04:04:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.749 04:04:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.749 04:04:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.749 04:04:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.749 04:04:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.749 04:04:05 -- accel/accel.sh@42 -- # jq -r . 00:06:50.749 [2024-05-14 04:04:05.113103] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:50.749 [2024-05-14 04:04:05.113215] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3746690 ] 00:06:50.749 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.749 [2024-05-14 04:04:05.179119] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.749 [2024-05-14 04:04:05.244791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.133 04:04:06 -- accel/accel.sh@18 -- # out=' 00:06:52.133 SPDK Configuration: 00:06:52.133 Core mask: 0x1 00:06:52.133 00:06:52.133 Accel Perf Configuration: 00:06:52.133 Workload Type: dif_verify 00:06:52.133 Vector size: 4096 bytes 00:06:52.133 Transfer size: 4096 bytes 00:06:52.133 Block size: 512 bytes 00:06:52.133 Metadata size: 8 bytes 00:06:52.133 Vector count 1 00:06:52.133 Module: software 00:06:52.133 Queue depth: 32 00:06:52.133 Allocate depth: 32 00:06:52.133 # threads/core: 1 00:06:52.133 Run time: 1 seconds 00:06:52.133 Verify: No 00:06:52.133 00:06:52.133 Running for 1 seconds... 00:06:52.133 00:06:52.133 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:52.133 ------------------------------------------------------------------------------------ 00:06:52.133 0,0 94528/s 375 MiB/s 0 0 00:06:52.133 ==================================================================================== 00:06:52.133 Total 94528/s 369 MiB/s 0 0' 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:52.133 04:04:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:52.133 04:04:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:52.133 04:04:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:52.133 04:04:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:52.133 04:04:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:52.133 04:04:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:52.133 04:04:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:52.133 04:04:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:52.133 04:04:06 -- accel/accel.sh@42 -- # jq -r . 00:06:52.133 [2024-05-14 04:04:06.397931] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:52.133 [2024-05-14 04:04:06.398019] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3747030 ] 00:06:52.133 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.133 [2024-05-14 04:04:06.459113] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.133 [2024-05-14 04:04:06.521824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val= 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val= 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val=0x1 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val= 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val= 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val=dif_verify 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val= 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val=software 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@23 -- # accel_module=software 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val=32 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val=32 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val=1 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val=No 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val= 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:52.133 04:04:06 -- accel/accel.sh@21 -- # val= 00:06:52.133 04:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:52.133 04:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:53.074 04:04:07 -- accel/accel.sh@21 -- # val= 00:06:53.074 04:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:53.074 04:04:07 -- accel/accel.sh@21 -- # val= 00:06:53.074 04:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:53.074 04:04:07 -- accel/accel.sh@21 -- # val= 00:06:53.074 04:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:53.074 04:04:07 -- accel/accel.sh@21 -- # val= 00:06:53.074 04:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:53.074 04:04:07 -- accel/accel.sh@21 -- # val= 00:06:53.074 04:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:53.074 04:04:07 -- accel/accel.sh@21 -- # val= 00:06:53.074 04:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:53.074 04:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:53.074 04:04:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:53.074 04:04:07 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:53.074 04:04:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.074 00:06:53.074 real 0m2.571s 00:06:53.074 user 0m2.378s 00:06:53.074 sys 0m0.201s 00:06:53.074 04:04:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:53.074 04:04:07 -- common/autotest_common.sh@10 -- # set +x 00:06:53.074 ************************************ 00:06:53.074 END TEST accel_dif_verify 00:06:53.074 ************************************ 00:06:53.335 04:04:07 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:53.335 04:04:07 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:53.336 04:04:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:53.336 04:04:07 -- common/autotest_common.sh@10 -- # set +x 00:06:53.336 ************************************ 00:06:53.336 START TEST accel_dif_generate 00:06:53.336 ************************************ 00:06:53.336 04:04:07 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:06:53.336 04:04:07 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.336 04:04:07 -- accel/accel.sh@17 -- # local accel_module 00:06:53.336 04:04:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:53.336 04:04:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:53.336 04:04:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.336 04:04:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.336 04:04:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.336 04:04:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.336 04:04:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.336 04:04:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.336 04:04:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.336 04:04:07 -- accel/accel.sh@42 -- # jq -r . 00:06:53.336 [2024-05-14 04:04:07.722615] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:53.336 [2024-05-14 04:04:07.722708] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3747241 ] 00:06:53.336 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.336 [2024-05-14 04:04:07.783977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.336 [2024-05-14 04:04:07.848971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.726 04:04:08 -- accel/accel.sh@18 -- # out=' 00:06:54.726 SPDK Configuration: 00:06:54.726 Core mask: 0x1 00:06:54.726 00:06:54.726 Accel Perf Configuration: 00:06:54.726 Workload Type: dif_generate 00:06:54.726 Vector size: 4096 bytes 00:06:54.726 Transfer size: 4096 bytes 00:06:54.726 Block size: 512 bytes 00:06:54.726 Metadata size: 8 bytes 00:06:54.726 Vector count 1 00:06:54.726 Module: software 00:06:54.726 Queue depth: 32 00:06:54.727 Allocate depth: 32 00:06:54.727 # threads/core: 1 00:06:54.727 Run time: 1 seconds 00:06:54.727 Verify: No 00:06:54.727 00:06:54.727 Running for 1 seconds... 00:06:54.727 00:06:54.727 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:54.727 ------------------------------------------------------------------------------------ 00:06:54.727 0,0 114112/s 452 MiB/s 0 0 00:06:54.727 ==================================================================================== 00:06:54.727 Total 114112/s 445 MiB/s 0 0' 00:06:54.727 04:04:08 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:08 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:54.727 04:04:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:54.727 04:04:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:54.727 04:04:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:54.727 04:04:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.727 04:04:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.727 04:04:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:54.727 04:04:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:54.727 04:04:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:54.727 04:04:08 -- accel/accel.sh@42 -- # jq -r . 00:06:54.727 [2024-05-14 04:04:09.003508] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:54.727 [2024-05-14 04:04:09.003610] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3747403 ] 00:06:54.727 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.727 [2024-05-14 04:04:09.066838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.727 [2024-05-14 04:04:09.128833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val= 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val= 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val=0x1 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val= 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val= 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val=dif_generate 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val= 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val=software 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@23 -- # accel_module=software 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val=32 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val=32 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val=1 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val=No 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val= 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:54.727 04:04:09 -- accel/accel.sh@21 -- # val= 00:06:54.727 04:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:54.727 04:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:55.726 04:04:10 -- accel/accel.sh@21 -- # val= 00:06:55.726 04:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:55.726 04:04:10 -- accel/accel.sh@21 -- # val= 00:06:55.726 04:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:55.726 04:04:10 -- accel/accel.sh@21 -- # val= 00:06:55.726 04:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:55.726 04:04:10 -- accel/accel.sh@21 -- # val= 00:06:55.726 04:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:55.726 04:04:10 -- accel/accel.sh@21 -- # val= 00:06:55.726 04:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:55.726 04:04:10 -- accel/accel.sh@21 -- # val= 00:06:55.726 04:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:55.726 04:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:55.726 04:04:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:55.726 04:04:10 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:55.726 04:04:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:55.726 00:06:55.726 real 0m2.564s 00:06:55.726 user 0m2.369s 00:06:55.726 sys 0m0.204s 00:06:55.726 04:04:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:55.726 04:04:10 -- common/autotest_common.sh@10 -- # set +x 00:06:55.726 ************************************ 00:06:55.726 END TEST accel_dif_generate 00:06:55.726 ************************************ 00:06:55.726 04:04:10 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:55.726 04:04:10 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:55.726 04:04:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:55.726 04:04:10 -- common/autotest_common.sh@10 -- # set +x 00:06:55.726 ************************************ 00:06:55.726 START TEST accel_dif_generate_copy 00:06:55.726 ************************************ 00:06:55.726 04:04:10 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:06:55.726 04:04:10 -- accel/accel.sh@16 -- # local accel_opc 00:06:55.726 04:04:10 -- accel/accel.sh@17 -- # local accel_module 00:06:55.726 04:04:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:55.726 04:04:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:55.726 04:04:10 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.726 04:04:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.726 04:04:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.726 04:04:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.726 04:04:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.726 04:04:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.726 04:04:10 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.726 04:04:10 -- accel/accel.sh@42 -- # jq -r . 00:06:55.986 [2024-05-14 04:04:10.331458] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:55.986 [2024-05-14 04:04:10.331562] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3747752 ] 00:06:55.986 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.986 [2024-05-14 04:04:10.394188] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.986 [2024-05-14 04:04:10.459660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.371 04:04:11 -- accel/accel.sh@18 -- # out=' 00:06:57.371 SPDK Configuration: 00:06:57.371 Core mask: 0x1 00:06:57.371 00:06:57.371 Accel Perf Configuration: 00:06:57.371 Workload Type: dif_generate_copy 00:06:57.371 Vector size: 4096 bytes 00:06:57.371 Transfer size: 4096 bytes 00:06:57.371 Vector count 1 00:06:57.371 Module: software 00:06:57.371 Queue depth: 32 00:06:57.371 Allocate depth: 32 00:06:57.371 # threads/core: 1 00:06:57.371 Run time: 1 seconds 00:06:57.371 Verify: No 00:06:57.371 00:06:57.371 Running for 1 seconds... 00:06:57.371 00:06:57.371 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.371 ------------------------------------------------------------------------------------ 00:06:57.371 0,0 87616/s 347 MiB/s 0 0 00:06:57.371 ==================================================================================== 00:06:57.371 Total 87616/s 342 MiB/s 0 0' 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:57.371 04:04:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:57.371 04:04:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.371 04:04:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.371 04:04:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.371 04:04:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.371 04:04:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.371 04:04:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.371 04:04:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.371 04:04:11 -- accel/accel.sh@42 -- # jq -r . 00:06:57.371 [2024-05-14 04:04:11.612323] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:57.371 [2024-05-14 04:04:11.612394] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3748094 ] 00:06:57.371 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.371 [2024-05-14 04:04:11.671794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.371 [2024-05-14 04:04:11.737213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val= 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val= 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val=0x1 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val= 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val= 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val= 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val=software 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@23 -- # accel_module=software 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val=32 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val=32 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val=1 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val=No 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val= 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:57.371 04:04:11 -- accel/accel.sh@21 -- # val= 00:06:57.371 04:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:57.371 04:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:58.313 04:04:12 -- accel/accel.sh@21 -- # val= 00:06:58.313 04:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:58.313 04:04:12 -- accel/accel.sh@21 -- # val= 00:06:58.313 04:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:58.313 04:04:12 -- accel/accel.sh@21 -- # val= 00:06:58.313 04:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:58.313 04:04:12 -- accel/accel.sh@21 -- # val= 00:06:58.313 04:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:58.313 04:04:12 -- accel/accel.sh@21 -- # val= 00:06:58.313 04:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:58.313 04:04:12 -- accel/accel.sh@21 -- # val= 00:06:58.313 04:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:58.313 04:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:58.313 04:04:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:58.313 04:04:12 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:58.313 04:04:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:58.313 00:06:58.313 real 0m2.564s 00:06:58.313 user 0m2.354s 00:06:58.313 sys 0m0.215s 00:06:58.313 04:04:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:58.313 04:04:12 -- common/autotest_common.sh@10 -- # set +x 00:06:58.313 ************************************ 00:06:58.313 END TEST accel_dif_generate_copy 00:06:58.313 ************************************ 00:06:58.574 04:04:12 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:58.574 04:04:12 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:58.574 04:04:12 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:58.574 04:04:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:58.574 04:04:12 -- common/autotest_common.sh@10 -- # set +x 00:06:58.574 ************************************ 00:06:58.574 START TEST accel_comp 00:06:58.574 ************************************ 00:06:58.574 04:04:12 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:58.574 04:04:12 -- accel/accel.sh@16 -- # local accel_opc 00:06:58.574 04:04:12 -- accel/accel.sh@17 -- # local accel_module 00:06:58.574 04:04:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:58.574 04:04:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:58.574 04:04:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.574 04:04:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.574 04:04:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.574 04:04:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.574 04:04:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.574 04:04:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.574 04:04:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.574 04:04:12 -- accel/accel.sh@42 -- # jq -r . 00:06:58.575 [2024-05-14 04:04:12.939882] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:58.575 [2024-05-14 04:04:12.939958] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3748399 ] 00:06:58.575 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.575 [2024-05-14 04:04:13.001227] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.575 [2024-05-14 04:04:13.065701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.967 04:04:14 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:59.967 00:06:59.967 SPDK Configuration: 00:06:59.967 Core mask: 0x1 00:06:59.967 00:06:59.967 Accel Perf Configuration: 00:06:59.967 Workload Type: compress 00:06:59.967 Transfer size: 4096 bytes 00:06:59.967 Vector count 1 00:06:59.967 Module: software 00:06:59.967 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:59.967 Queue depth: 32 00:06:59.967 Allocate depth: 32 00:06:59.967 # threads/core: 1 00:06:59.967 Run time: 1 seconds 00:06:59.967 Verify: No 00:06:59.967 00:06:59.967 Running for 1 seconds... 00:06:59.967 00:06:59.967 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:59.967 ------------------------------------------------------------------------------------ 00:06:59.967 0,0 47616/s 198 MiB/s 0 0 00:06:59.967 ==================================================================================== 00:06:59.967 Total 47616/s 186 MiB/s 0 0' 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:59.967 04:04:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:59.967 04:04:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.967 04:04:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.967 04:04:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.967 04:04:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.967 04:04:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.967 04:04:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.967 04:04:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.967 04:04:14 -- accel/accel.sh@42 -- # jq -r . 00:06:59.967 [2024-05-14 04:04:14.219497] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:59.967 [2024-05-14 04:04:14.219573] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3748534 ] 00:06:59.967 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.967 [2024-05-14 04:04:14.280001] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.967 [2024-05-14 04:04:14.341880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val= 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val= 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val= 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val=0x1 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val= 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val= 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val=compress 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val= 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val=software 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@23 -- # accel_module=software 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val=32 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.967 04:04:14 -- accel/accel.sh@21 -- # val=32 00:06:59.967 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.967 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.968 04:04:14 -- accel/accel.sh@21 -- # val=1 00:06:59.968 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.968 04:04:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:59.968 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.968 04:04:14 -- accel/accel.sh@21 -- # val=No 00:06:59.968 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.968 04:04:14 -- accel/accel.sh@21 -- # val= 00:06:59.968 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:59.968 04:04:14 -- accel/accel.sh@21 -- # val= 00:06:59.968 04:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:59.968 04:04:14 -- accel/accel.sh@20 -- # read -r var val 00:07:00.912 04:04:15 -- accel/accel.sh@21 -- # val= 00:07:00.912 04:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # IFS=: 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # read -r var val 00:07:00.912 04:04:15 -- accel/accel.sh@21 -- # val= 00:07:00.912 04:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # IFS=: 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # read -r var val 00:07:00.912 04:04:15 -- accel/accel.sh@21 -- # val= 00:07:00.912 04:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # IFS=: 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # read -r var val 00:07:00.912 04:04:15 -- accel/accel.sh@21 -- # val= 00:07:00.912 04:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # IFS=: 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # read -r var val 00:07:00.912 04:04:15 -- accel/accel.sh@21 -- # val= 00:07:00.912 04:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # IFS=: 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # read -r var val 00:07:00.912 04:04:15 -- accel/accel.sh@21 -- # val= 00:07:00.912 04:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # IFS=: 00:07:00.912 04:04:15 -- accel/accel.sh@20 -- # read -r var val 00:07:00.912 04:04:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:00.912 04:04:15 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:00.912 04:04:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:00.912 00:07:00.912 real 0m2.562s 00:07:00.912 user 0m2.374s 00:07:00.912 sys 0m0.196s 00:07:00.912 04:04:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:00.912 04:04:15 -- common/autotest_common.sh@10 -- # set +x 00:07:00.912 ************************************ 00:07:00.912 END TEST accel_comp 00:07:00.912 ************************************ 00:07:01.173 04:04:15 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:01.173 04:04:15 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:07:01.173 04:04:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:01.173 04:04:15 -- common/autotest_common.sh@10 -- # set +x 00:07:01.173 ************************************ 00:07:01.173 START TEST accel_decomp 00:07:01.173 ************************************ 00:07:01.173 04:04:15 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:01.173 04:04:15 -- accel/accel.sh@16 -- # local accel_opc 00:07:01.173 04:04:15 -- accel/accel.sh@17 -- # local accel_module 00:07:01.173 04:04:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:01.173 04:04:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:01.173 04:04:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.173 04:04:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.173 04:04:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.173 04:04:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.173 04:04:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.173 04:04:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.173 04:04:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.173 04:04:15 -- accel/accel.sh@42 -- # jq -r . 00:07:01.173 [2024-05-14 04:04:15.545060] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:01.173 [2024-05-14 04:04:15.545140] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3748820 ] 00:07:01.173 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.173 [2024-05-14 04:04:15.606746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.173 [2024-05-14 04:04:15.671516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.558 04:04:16 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:02.558 00:07:02.558 SPDK Configuration: 00:07:02.558 Core mask: 0x1 00:07:02.558 00:07:02.558 Accel Perf Configuration: 00:07:02.558 Workload Type: decompress 00:07:02.558 Transfer size: 4096 bytes 00:07:02.558 Vector count 1 00:07:02.558 Module: software 00:07:02.558 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:02.558 Queue depth: 32 00:07:02.558 Allocate depth: 32 00:07:02.558 # threads/core: 1 00:07:02.558 Run time: 1 seconds 00:07:02.558 Verify: Yes 00:07:02.558 00:07:02.558 Running for 1 seconds... 00:07:02.558 00:07:02.558 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:02.558 ------------------------------------------------------------------------------------ 00:07:02.558 0,0 63168/s 116 MiB/s 0 0 00:07:02.558 ==================================================================================== 00:07:02.558 Total 63168/s 246 MiB/s 0 0' 00:07:02.558 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:02.559 04:04:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:02.559 04:04:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.559 04:04:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.559 04:04:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.559 04:04:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.559 04:04:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.559 04:04:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.559 04:04:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.559 04:04:16 -- accel/accel.sh@42 -- # jq -r . 00:07:02.559 [2024-05-14 04:04:16.828536] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:02.559 [2024-05-14 04:04:16.828639] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3749155 ] 00:07:02.559 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.559 [2024-05-14 04:04:16.891336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.559 [2024-05-14 04:04:16.951881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val= 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val= 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val= 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val=0x1 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val= 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val= 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val=decompress 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val= 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val=software 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@23 -- # accel_module=software 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val=32 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val=32 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val=1 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val=Yes 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:16 -- accel/accel.sh@21 -- # val= 00:07:02.559 04:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:16 -- accel/accel.sh@20 -- # read -r var val 00:07:02.559 04:04:17 -- accel/accel.sh@21 -- # val= 00:07:02.559 04:04:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.559 04:04:17 -- accel/accel.sh@20 -- # IFS=: 00:07:02.559 04:04:17 -- accel/accel.sh@20 -- # read -r var val 00:07:03.501 04:04:18 -- accel/accel.sh@21 -- # val= 00:07:03.501 04:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # IFS=: 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # read -r var val 00:07:03.501 04:04:18 -- accel/accel.sh@21 -- # val= 00:07:03.501 04:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # IFS=: 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # read -r var val 00:07:03.501 04:04:18 -- accel/accel.sh@21 -- # val= 00:07:03.501 04:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # IFS=: 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # read -r var val 00:07:03.501 04:04:18 -- accel/accel.sh@21 -- # val= 00:07:03.501 04:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # IFS=: 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # read -r var val 00:07:03.501 04:04:18 -- accel/accel.sh@21 -- # val= 00:07:03.501 04:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # IFS=: 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # read -r var val 00:07:03.501 04:04:18 -- accel/accel.sh@21 -- # val= 00:07:03.501 04:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # IFS=: 00:07:03.501 04:04:18 -- accel/accel.sh@20 -- # read -r var val 00:07:03.501 04:04:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:03.501 04:04:18 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:03.501 04:04:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:03.501 00:07:03.501 real 0m2.567s 00:07:03.501 user 0m2.376s 00:07:03.501 sys 0m0.198s 00:07:03.501 04:04:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:03.501 04:04:18 -- common/autotest_common.sh@10 -- # set +x 00:07:03.501 ************************************ 00:07:03.501 END TEST accel_decomp 00:07:03.501 ************************************ 00:07:03.761 04:04:18 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:03.761 04:04:18 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:07:03.761 04:04:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:03.761 04:04:18 -- common/autotest_common.sh@10 -- # set +x 00:07:03.761 ************************************ 00:07:03.761 START TEST accel_decmop_full 00:07:03.761 ************************************ 00:07:03.761 04:04:18 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:03.761 04:04:18 -- accel/accel.sh@16 -- # local accel_opc 00:07:03.761 04:04:18 -- accel/accel.sh@17 -- # local accel_module 00:07:03.761 04:04:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:03.761 04:04:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:03.761 04:04:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.761 04:04:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.761 04:04:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.761 04:04:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.761 04:04:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.762 04:04:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.762 04:04:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.762 04:04:18 -- accel/accel.sh@42 -- # jq -r . 00:07:03.762 [2024-05-14 04:04:18.155992] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:03.762 [2024-05-14 04:04:18.156061] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3749506 ] 00:07:03.762 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.762 [2024-05-14 04:04:18.216085] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.762 [2024-05-14 04:04:18.277271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.148 04:04:19 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:05.148 00:07:05.148 SPDK Configuration: 00:07:05.148 Core mask: 0x1 00:07:05.148 00:07:05.148 Accel Perf Configuration: 00:07:05.148 Workload Type: decompress 00:07:05.148 Transfer size: 111250 bytes 00:07:05.148 Vector count 1 00:07:05.148 Module: software 00:07:05.148 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:05.148 Queue depth: 32 00:07:05.148 Allocate depth: 32 00:07:05.148 # threads/core: 1 00:07:05.148 Run time: 1 seconds 00:07:05.148 Verify: Yes 00:07:05.148 00:07:05.148 Running for 1 seconds... 00:07:05.148 00:07:05.148 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:05.148 ------------------------------------------------------------------------------------ 00:07:05.148 0,0 4064/s 167 MiB/s 0 0 00:07:05.148 ==================================================================================== 00:07:05.148 Total 4064/s 431 MiB/s 0 0' 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:05.148 04:04:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:05.148 04:04:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.148 04:04:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.148 04:04:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.148 04:04:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.148 04:04:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.148 04:04:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.148 04:04:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.148 04:04:19 -- accel/accel.sh@42 -- # jq -r . 00:07:05.148 [2024-05-14 04:04:19.440039] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:05.148 [2024-05-14 04:04:19.440110] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3749658 ] 00:07:05.148 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.148 [2024-05-14 04:04:19.500404] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.148 [2024-05-14 04:04:19.561632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val= 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val= 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val= 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val=0x1 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val= 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val= 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val=decompress 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val= 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val=software 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@23 -- # accel_module=software 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val=32 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val=32 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val=1 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val=Yes 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val= 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:05.148 04:04:19 -- accel/accel.sh@21 -- # val= 00:07:05.148 04:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # IFS=: 00:07:05.148 04:04:19 -- accel/accel.sh@20 -- # read -r var val 00:07:06.535 04:04:20 -- accel/accel.sh@21 -- # val= 00:07:06.535 04:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.535 04:04:20 -- accel/accel.sh@20 -- # IFS=: 00:07:06.535 04:04:20 -- accel/accel.sh@20 -- # read -r var val 00:07:06.535 04:04:20 -- accel/accel.sh@21 -- # val= 00:07:06.535 04:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.535 04:04:20 -- accel/accel.sh@20 -- # IFS=: 00:07:06.535 04:04:20 -- accel/accel.sh@20 -- # read -r var val 00:07:06.535 04:04:20 -- accel/accel.sh@21 -- # val= 00:07:06.535 04:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.535 04:04:20 -- accel/accel.sh@20 -- # IFS=: 00:07:06.535 04:04:20 -- accel/accel.sh@20 -- # read -r var val 00:07:06.535 04:04:20 -- accel/accel.sh@21 -- # val= 00:07:06.535 04:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.535 04:04:20 -- accel/accel.sh@20 -- # IFS=: 00:07:06.535 04:04:20 -- accel/accel.sh@20 -- # read -r var val 00:07:06.535 04:04:20 -- accel/accel.sh@21 -- # val= 00:07:06.535 04:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.535 04:04:20 -- accel/accel.sh@20 -- # IFS=: 00:07:06.536 04:04:20 -- accel/accel.sh@20 -- # read -r var val 00:07:06.536 04:04:20 -- accel/accel.sh@21 -- # val= 00:07:06.536 04:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.536 04:04:20 -- accel/accel.sh@20 -- # IFS=: 00:07:06.536 04:04:20 -- accel/accel.sh@20 -- # read -r var val 00:07:06.536 04:04:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:06.536 04:04:20 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:06.536 04:04:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:06.536 00:07:06.536 real 0m2.574s 00:07:06.536 user 0m2.391s 00:07:06.536 sys 0m0.189s 00:07:06.536 04:04:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:06.536 04:04:20 -- common/autotest_common.sh@10 -- # set +x 00:07:06.536 ************************************ 00:07:06.536 END TEST accel_decmop_full 00:07:06.536 ************************************ 00:07:06.536 04:04:20 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:06.536 04:04:20 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:07:06.536 04:04:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:06.536 04:04:20 -- common/autotest_common.sh@10 -- # set +x 00:07:06.536 ************************************ 00:07:06.536 START TEST accel_decomp_mcore 00:07:06.536 ************************************ 00:07:06.536 04:04:20 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:06.536 04:04:20 -- accel/accel.sh@16 -- # local accel_opc 00:07:06.536 04:04:20 -- accel/accel.sh@17 -- # local accel_module 00:07:06.536 04:04:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:06.536 04:04:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:06.536 04:04:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.536 04:04:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.536 04:04:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.536 04:04:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.536 04:04:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.536 04:04:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.536 04:04:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.536 04:04:20 -- accel/accel.sh@42 -- # jq -r . 00:07:06.536 [2024-05-14 04:04:20.773082] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:06.536 [2024-05-14 04:04:20.773151] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3749880 ] 00:07:06.536 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.536 [2024-05-14 04:04:20.835042] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:06.536 [2024-05-14 04:04:20.899396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:06.536 [2024-05-14 04:04:20.899498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:06.536 [2024-05-14 04:04:20.899640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:06.536 [2024-05-14 04:04:20.899641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.478 04:04:22 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:07.478 00:07:07.478 SPDK Configuration: 00:07:07.478 Core mask: 0xf 00:07:07.478 00:07:07.478 Accel Perf Configuration: 00:07:07.478 Workload Type: decompress 00:07:07.478 Transfer size: 4096 bytes 00:07:07.478 Vector count 1 00:07:07.478 Module: software 00:07:07.478 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:07.478 Queue depth: 32 00:07:07.478 Allocate depth: 32 00:07:07.478 # threads/core: 1 00:07:07.478 Run time: 1 seconds 00:07:07.478 Verify: Yes 00:07:07.478 00:07:07.478 Running for 1 seconds... 00:07:07.478 00:07:07.478 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:07.478 ------------------------------------------------------------------------------------ 00:07:07.478 0,0 58496/s 107 MiB/s 0 0 00:07:07.478 3,0 58816/s 108 MiB/s 0 0 00:07:07.478 2,0 86368/s 159 MiB/s 0 0 00:07:07.478 1,0 58720/s 108 MiB/s 0 0 00:07:07.478 ==================================================================================== 00:07:07.478 Total 262400/s 1025 MiB/s 0 0' 00:07:07.478 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.478 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.478 04:04:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:07.478 04:04:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:07.478 04:04:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.478 04:04:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.478 04:04:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.478 04:04:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.478 04:04:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.478 04:04:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.478 04:04:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.478 04:04:22 -- accel/accel.sh@42 -- # jq -r . 00:07:07.478 [2024-05-14 04:04:22.059468] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:07.478 [2024-05-14 04:04:22.059543] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3750219 ] 00:07:07.739 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.739 [2024-05-14 04:04:22.120286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:07.739 [2024-05-14 04:04:22.183554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:07.739 [2024-05-14 04:04:22.183668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:07.739 [2024-05-14 04:04:22.183823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.739 [2024-05-14 04:04:22.183823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val= 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val= 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val= 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val=0xf 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val= 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val= 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val=decompress 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val= 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.739 04:04:22 -- accel/accel.sh@21 -- # val=software 00:07:07.739 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.739 04:04:22 -- accel/accel.sh@23 -- # accel_module=software 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.739 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.740 04:04:22 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:07.740 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.740 04:04:22 -- accel/accel.sh@21 -- # val=32 00:07:07.740 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.740 04:04:22 -- accel/accel.sh@21 -- # val=32 00:07:07.740 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.740 04:04:22 -- accel/accel.sh@21 -- # val=1 00:07:07.740 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.740 04:04:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:07.740 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.740 04:04:22 -- accel/accel.sh@21 -- # val=Yes 00:07:07.740 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.740 04:04:22 -- accel/accel.sh@21 -- # val= 00:07:07.740 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:07.740 04:04:22 -- accel/accel.sh@21 -- # val= 00:07:07.740 04:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # IFS=: 00:07:07.740 04:04:22 -- accel/accel.sh@20 -- # read -r var val 00:07:09.133 04:04:23 -- accel/accel.sh@21 -- # val= 00:07:09.133 04:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.133 04:04:23 -- accel/accel.sh@20 -- # IFS=: 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # read -r var val 00:07:09.134 04:04:23 -- accel/accel.sh@21 -- # val= 00:07:09.134 04:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # IFS=: 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # read -r var val 00:07:09.134 04:04:23 -- accel/accel.sh@21 -- # val= 00:07:09.134 04:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # IFS=: 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # read -r var val 00:07:09.134 04:04:23 -- accel/accel.sh@21 -- # val= 00:07:09.134 04:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # IFS=: 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # read -r var val 00:07:09.134 04:04:23 -- accel/accel.sh@21 -- # val= 00:07:09.134 04:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # IFS=: 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # read -r var val 00:07:09.134 04:04:23 -- accel/accel.sh@21 -- # val= 00:07:09.134 04:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # IFS=: 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # read -r var val 00:07:09.134 04:04:23 -- accel/accel.sh@21 -- # val= 00:07:09.134 04:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # IFS=: 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # read -r var val 00:07:09.134 04:04:23 -- accel/accel.sh@21 -- # val= 00:07:09.134 04:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # IFS=: 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # read -r var val 00:07:09.134 04:04:23 -- accel/accel.sh@21 -- # val= 00:07:09.134 04:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # IFS=: 00:07:09.134 04:04:23 -- accel/accel.sh@20 -- # read -r var val 00:07:09.134 04:04:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:09.134 04:04:23 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:09.134 04:04:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:09.134 00:07:09.134 real 0m2.574s 00:07:09.134 user 0m8.826s 00:07:09.134 sys 0m0.212s 00:07:09.134 04:04:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:09.134 04:04:23 -- common/autotest_common.sh@10 -- # set +x 00:07:09.134 ************************************ 00:07:09.134 END TEST accel_decomp_mcore 00:07:09.134 ************************************ 00:07:09.134 04:04:23 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:09.134 04:04:23 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:07:09.134 04:04:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:09.134 04:04:23 -- common/autotest_common.sh@10 -- # set +x 00:07:09.134 ************************************ 00:07:09.134 START TEST accel_decomp_full_mcore 00:07:09.134 ************************************ 00:07:09.134 04:04:23 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:09.134 04:04:23 -- accel/accel.sh@16 -- # local accel_opc 00:07:09.134 04:04:23 -- accel/accel.sh@17 -- # local accel_module 00:07:09.134 04:04:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:09.134 04:04:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:09.134 04:04:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.134 04:04:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.134 04:04:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.134 04:04:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.134 04:04:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.134 04:04:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.134 04:04:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.134 04:04:23 -- accel/accel.sh@42 -- # jq -r . 00:07:09.134 [2024-05-14 04:04:23.393495] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:09.134 [2024-05-14 04:04:23.393566] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3750573 ] 00:07:09.134 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.134 [2024-05-14 04:04:23.455098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:09.134 [2024-05-14 04:04:23.522046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:09.134 [2024-05-14 04:04:23.522160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:09.134 [2024-05-14 04:04:23.522334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:09.134 [2024-05-14 04:04:23.522518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.521 04:04:24 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:10.521 00:07:10.521 SPDK Configuration: 00:07:10.521 Core mask: 0xf 00:07:10.521 00:07:10.521 Accel Perf Configuration: 00:07:10.521 Workload Type: decompress 00:07:10.521 Transfer size: 111250 bytes 00:07:10.521 Vector count 1 00:07:10.521 Module: software 00:07:10.521 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.521 Queue depth: 32 00:07:10.521 Allocate depth: 32 00:07:10.521 # threads/core: 1 00:07:10.521 Run time: 1 seconds 00:07:10.521 Verify: Yes 00:07:10.521 00:07:10.522 Running for 1 seconds... 00:07:10.522 00:07:10.522 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:10.522 ------------------------------------------------------------------------------------ 00:07:10.522 0,0 4064/s 167 MiB/s 0 0 00:07:10.522 3,0 4096/s 169 MiB/s 0 0 00:07:10.522 2,0 5920/s 244 MiB/s 0 0 00:07:10.522 1,0 4096/s 169 MiB/s 0 0 00:07:10.522 ==================================================================================== 00:07:10.522 Total 18176/s 1928 MiB/s 0 0' 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:10.522 04:04:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:10.522 04:04:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.522 04:04:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.522 04:04:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.522 04:04:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.522 04:04:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.522 04:04:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.522 04:04:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.522 04:04:24 -- accel/accel.sh@42 -- # jq -r . 00:07:10.522 [2024-05-14 04:04:24.694940] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:10.522 [2024-05-14 04:04:24.695016] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3750800 ] 00:07:10.522 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.522 [2024-05-14 04:04:24.774273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:10.522 [2024-05-14 04:04:24.839830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:10.522 [2024-05-14 04:04:24.839943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:10.522 [2024-05-14 04:04:24.840096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.522 [2024-05-14 04:04:24.840097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val= 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val= 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val= 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val=0xf 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val= 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val= 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val=decompress 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val= 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val=software 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@23 -- # accel_module=software 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val=32 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val=32 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val=1 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val=Yes 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val= 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:10.522 04:04:24 -- accel/accel.sh@21 -- # val= 00:07:10.522 04:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # IFS=: 00:07:10.522 04:04:24 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@21 -- # val= 00:07:11.464 04:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # IFS=: 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@21 -- # val= 00:07:11.464 04:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # IFS=: 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@21 -- # val= 00:07:11.464 04:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # IFS=: 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@21 -- # val= 00:07:11.464 04:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # IFS=: 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@21 -- # val= 00:07:11.464 04:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # IFS=: 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@21 -- # val= 00:07:11.464 04:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # IFS=: 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@21 -- # val= 00:07:11.464 04:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # IFS=: 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@21 -- # val= 00:07:11.464 04:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # IFS=: 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@21 -- # val= 00:07:11.464 04:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # IFS=: 00:07:11.464 04:04:25 -- accel/accel.sh@20 -- # read -r var val 00:07:11.464 04:04:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:11.464 04:04:25 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:11.464 04:04:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:11.464 00:07:11.464 real 0m2.628s 00:07:11.464 user 0m8.951s 00:07:11.464 sys 0m0.228s 00:07:11.464 04:04:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:11.464 04:04:25 -- common/autotest_common.sh@10 -- # set +x 00:07:11.464 ************************************ 00:07:11.464 END TEST accel_decomp_full_mcore 00:07:11.464 ************************************ 00:07:11.464 04:04:26 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:11.464 04:04:26 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:07:11.464 04:04:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:11.464 04:04:26 -- common/autotest_common.sh@10 -- # set +x 00:07:11.464 ************************************ 00:07:11.464 START TEST accel_decomp_mthread 00:07:11.464 ************************************ 00:07:11.464 04:04:26 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:11.464 04:04:26 -- accel/accel.sh@16 -- # local accel_opc 00:07:11.464 04:04:26 -- accel/accel.sh@17 -- # local accel_module 00:07:11.464 04:04:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:11.464 04:04:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:11.464 04:04:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.464 04:04:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.464 04:04:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.464 04:04:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.464 04:04:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.464 04:04:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.464 04:04:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.464 04:04:26 -- accel/accel.sh@42 -- # jq -r . 00:07:11.725 [2024-05-14 04:04:26.065766] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:11.725 [2024-05-14 04:04:26.065870] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3750990 ] 00:07:11.725 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.725 [2024-05-14 04:04:26.129819] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.725 [2024-05-14 04:04:26.194111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.144 04:04:27 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:13.144 00:07:13.144 SPDK Configuration: 00:07:13.144 Core mask: 0x1 00:07:13.144 00:07:13.144 Accel Perf Configuration: 00:07:13.144 Workload Type: decompress 00:07:13.144 Transfer size: 4096 bytes 00:07:13.144 Vector count 1 00:07:13.144 Module: software 00:07:13.144 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.144 Queue depth: 32 00:07:13.144 Allocate depth: 32 00:07:13.144 # threads/core: 2 00:07:13.144 Run time: 1 seconds 00:07:13.144 Verify: Yes 00:07:13.144 00:07:13.144 Running for 1 seconds... 00:07:13.144 00:07:13.144 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:13.144 ------------------------------------------------------------------------------------ 00:07:13.144 0,1 31904/s 58 MiB/s 0 0 00:07:13.144 0,0 31808/s 58 MiB/s 0 0 00:07:13.144 ==================================================================================== 00:07:13.144 Total 63712/s 248 MiB/s 0 0' 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:13.144 04:04:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:13.144 04:04:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.144 04:04:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.144 04:04:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.144 04:04:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.144 04:04:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.144 04:04:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.144 04:04:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.144 04:04:27 -- accel/accel.sh@42 -- # jq -r . 00:07:13.144 [2024-05-14 04:04:27.351830] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:13.144 [2024-05-14 04:04:27.351907] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3751288 ] 00:07:13.144 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.144 [2024-05-14 04:04:27.411806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.144 [2024-05-14 04:04:27.473150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val= 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val= 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val= 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val=0x1 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val= 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val= 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val=decompress 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val= 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val=software 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@23 -- # accel_module=software 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.144 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.144 04:04:27 -- accel/accel.sh@21 -- # val=32 00:07:13.144 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.145 04:04:27 -- accel/accel.sh@21 -- # val=32 00:07:13.145 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.145 04:04:27 -- accel/accel.sh@21 -- # val=2 00:07:13.145 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.145 04:04:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:13.145 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.145 04:04:27 -- accel/accel.sh@21 -- # val=Yes 00:07:13.145 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.145 04:04:27 -- accel/accel.sh@21 -- # val= 00:07:13.145 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:13.145 04:04:27 -- accel/accel.sh@21 -- # val= 00:07:13.145 04:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # IFS=: 00:07:13.145 04:04:27 -- accel/accel.sh@20 -- # read -r var val 00:07:14.089 04:04:28 -- accel/accel.sh@21 -- # val= 00:07:14.089 04:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # IFS=: 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # read -r var val 00:07:14.089 04:04:28 -- accel/accel.sh@21 -- # val= 00:07:14.089 04:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # IFS=: 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # read -r var val 00:07:14.089 04:04:28 -- accel/accel.sh@21 -- # val= 00:07:14.089 04:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # IFS=: 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # read -r var val 00:07:14.089 04:04:28 -- accel/accel.sh@21 -- # val= 00:07:14.089 04:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # IFS=: 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # read -r var val 00:07:14.089 04:04:28 -- accel/accel.sh@21 -- # val= 00:07:14.089 04:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # IFS=: 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # read -r var val 00:07:14.089 04:04:28 -- accel/accel.sh@21 -- # val= 00:07:14.089 04:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # IFS=: 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # read -r var val 00:07:14.089 04:04:28 -- accel/accel.sh@21 -- # val= 00:07:14.089 04:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # IFS=: 00:07:14.089 04:04:28 -- accel/accel.sh@20 -- # read -r var val 00:07:14.089 04:04:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:14.089 04:04:28 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:14.089 04:04:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:14.089 00:07:14.089 real 0m2.573s 00:07:14.089 user 0m2.392s 00:07:14.089 sys 0m0.189s 00:07:14.089 04:04:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:14.089 04:04:28 -- common/autotest_common.sh@10 -- # set +x 00:07:14.089 ************************************ 00:07:14.089 END TEST accel_decomp_mthread 00:07:14.089 ************************************ 00:07:14.089 04:04:28 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:14.089 04:04:28 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:07:14.089 04:04:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:14.089 04:04:28 -- common/autotest_common.sh@10 -- # set +x 00:07:14.089 ************************************ 00:07:14.089 START TEST accel_deomp_full_mthread 00:07:14.089 ************************************ 00:07:14.089 04:04:28 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:14.089 04:04:28 -- accel/accel.sh@16 -- # local accel_opc 00:07:14.089 04:04:28 -- accel/accel.sh@17 -- # local accel_module 00:07:14.089 04:04:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:14.089 04:04:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:14.089 04:04:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.089 04:04:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.089 04:04:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.089 04:04:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.089 04:04:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.089 04:04:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.089 04:04:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.089 04:04:28 -- accel/accel.sh@42 -- # jq -r . 00:07:14.350 [2024-05-14 04:04:28.680851] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:14.350 [2024-05-14 04:04:28.680929] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3751641 ] 00:07:14.350 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.350 [2024-05-14 04:04:28.752005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.350 [2024-05-14 04:04:28.817753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.733 04:04:29 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:15.734 00:07:15.734 SPDK Configuration: 00:07:15.734 Core mask: 0x1 00:07:15.734 00:07:15.734 Accel Perf Configuration: 00:07:15.734 Workload Type: decompress 00:07:15.734 Transfer size: 111250 bytes 00:07:15.734 Vector count 1 00:07:15.734 Module: software 00:07:15.734 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:15.734 Queue depth: 32 00:07:15.734 Allocate depth: 32 00:07:15.734 # threads/core: 2 00:07:15.734 Run time: 1 seconds 00:07:15.734 Verify: Yes 00:07:15.734 00:07:15.734 Running for 1 seconds... 00:07:15.734 00:07:15.734 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:15.734 ------------------------------------------------------------------------------------ 00:07:15.734 0,1 2080/s 85 MiB/s 0 0 00:07:15.734 0,0 2048/s 84 MiB/s 0 0 00:07:15.734 ==================================================================================== 00:07:15.734 Total 4128/s 437 MiB/s 0 0' 00:07:15.734 04:04:29 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:29 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:15.734 04:04:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:15.734 04:04:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.734 04:04:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:15.734 04:04:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.734 04:04:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.734 04:04:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:15.734 04:04:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:15.734 04:04:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:15.734 04:04:29 -- accel/accel.sh@42 -- # jq -r . 00:07:15.734 [2024-05-14 04:04:29.999677] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:15.734 [2024-05-14 04:04:29.999751] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3751990 ] 00:07:15.734 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.734 [2024-05-14 04:04:30.060961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.734 [2024-05-14 04:04:30.125448] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val= 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val= 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val= 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val=0x1 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val= 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val= 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val=decompress 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val= 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val=software 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@23 -- # accel_module=software 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val=32 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val=32 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val=2 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val=Yes 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val= 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:15.734 04:04:30 -- accel/accel.sh@21 -- # val= 00:07:15.734 04:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # IFS=: 00:07:15.734 04:04:30 -- accel/accel.sh@20 -- # read -r var val 00:07:17.119 04:04:31 -- accel/accel.sh@21 -- # val= 00:07:17.119 04:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # IFS=: 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # read -r var val 00:07:17.119 04:04:31 -- accel/accel.sh@21 -- # val= 00:07:17.119 04:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # IFS=: 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # read -r var val 00:07:17.119 04:04:31 -- accel/accel.sh@21 -- # val= 00:07:17.119 04:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # IFS=: 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # read -r var val 00:07:17.119 04:04:31 -- accel/accel.sh@21 -- # val= 00:07:17.119 04:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # IFS=: 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # read -r var val 00:07:17.119 04:04:31 -- accel/accel.sh@21 -- # val= 00:07:17.119 04:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # IFS=: 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # read -r var val 00:07:17.119 04:04:31 -- accel/accel.sh@21 -- # val= 00:07:17.119 04:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # IFS=: 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # read -r var val 00:07:17.119 04:04:31 -- accel/accel.sh@21 -- # val= 00:07:17.119 04:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # IFS=: 00:07:17.119 04:04:31 -- accel/accel.sh@20 -- # read -r var val 00:07:17.119 04:04:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:17.119 04:04:31 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:17.119 04:04:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:17.119 00:07:17.119 real 0m2.633s 00:07:17.119 user 0m2.437s 00:07:17.119 sys 0m0.203s 00:07:17.119 04:04:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:17.119 04:04:31 -- common/autotest_common.sh@10 -- # set +x 00:07:17.119 ************************************ 00:07:17.119 END TEST accel_deomp_full_mthread 00:07:17.119 ************************************ 00:07:17.119 04:04:31 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:17.119 04:04:31 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:17.119 04:04:31 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:17.119 04:04:31 -- accel/accel.sh@129 -- # build_accel_config 00:07:17.119 04:04:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:17.119 04:04:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.119 04:04:31 -- common/autotest_common.sh@10 -- # set +x 00:07:17.119 04:04:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.119 04:04:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.119 04:04:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.119 04:04:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.119 04:04:31 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.119 04:04:31 -- accel/accel.sh@42 -- # jq -r . 00:07:17.119 ************************************ 00:07:17.119 START TEST accel_dif_functional_tests 00:07:17.119 ************************************ 00:07:17.119 04:04:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:17.119 [2024-05-14 04:04:31.376598] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:17.119 [2024-05-14 04:04:31.376660] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3752159 ] 00:07:17.120 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.120 [2024-05-14 04:04:31.440402] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:17.120 [2024-05-14 04:04:31.508986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:17.120 [2024-05-14 04:04:31.509100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:17.120 [2024-05-14 04:04:31.509102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.120 00:07:17.120 00:07:17.120 CUnit - A unit testing framework for C - Version 2.1-3 00:07:17.120 http://cunit.sourceforge.net/ 00:07:17.120 00:07:17.120 00:07:17.120 Suite: accel_dif 00:07:17.120 Test: verify: DIF generated, GUARD check ...passed 00:07:17.120 Test: verify: DIF generated, APPTAG check ...passed 00:07:17.120 Test: verify: DIF generated, REFTAG check ...passed 00:07:17.120 Test: verify: DIF not generated, GUARD check ...[2024-05-14 04:04:31.564661] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:17.120 [2024-05-14 04:04:31.564701] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:17.120 passed 00:07:17.120 Test: verify: DIF not generated, APPTAG check ...[2024-05-14 04:04:31.564736] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:17.120 [2024-05-14 04:04:31.564751] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:17.120 passed 00:07:17.120 Test: verify: DIF not generated, REFTAG check ...[2024-05-14 04:04:31.564766] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:17.120 [2024-05-14 04:04:31.564779] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:17.120 passed 00:07:17.120 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:17.120 Test: verify: APPTAG incorrect, APPTAG check ...[2024-05-14 04:04:31.564820] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:17.120 passed 00:07:17.120 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:17.120 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:17.120 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:17.120 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-05-14 04:04:31.564929] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:17.120 passed 00:07:17.120 Test: generate copy: DIF generated, GUARD check ...passed 00:07:17.120 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:17.120 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:17.120 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:17.120 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:17.120 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:17.120 Test: generate copy: iovecs-len validate ...[2024-05-14 04:04:31.565120] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:17.120 passed 00:07:17.120 Test: generate copy: buffer alignment validate ...passed 00:07:17.120 00:07:17.120 Run Summary: Type Total Ran Passed Failed Inactive 00:07:17.120 suites 1 1 n/a 0 0 00:07:17.120 tests 20 20 20 0 0 00:07:17.120 asserts 204 204 204 0 n/a 00:07:17.120 00:07:17.120 Elapsed time = 0.000 seconds 00:07:17.120 00:07:17.120 real 0m0.349s 00:07:17.120 user 0m0.488s 00:07:17.120 sys 0m0.122s 00:07:17.120 04:04:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:17.120 04:04:31 -- common/autotest_common.sh@10 -- # set +x 00:07:17.120 ************************************ 00:07:17.120 END TEST accel_dif_functional_tests 00:07:17.120 ************************************ 00:07:17.381 00:07:17.381 real 0m54.625s 00:07:17.381 user 1m3.154s 00:07:17.381 sys 0m5.550s 00:07:17.381 04:04:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:17.381 04:04:31 -- common/autotest_common.sh@10 -- # set +x 00:07:17.381 ************************************ 00:07:17.381 END TEST accel 00:07:17.381 ************************************ 00:07:17.381 04:04:31 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:17.381 04:04:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:17.381 04:04:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:17.381 04:04:31 -- common/autotest_common.sh@10 -- # set +x 00:07:17.381 ************************************ 00:07:17.381 START TEST accel_rpc 00:07:17.381 ************************************ 00:07:17.381 04:04:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:17.381 * Looking for test storage... 00:07:17.381 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:17.381 04:04:31 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:17.381 04:04:31 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3752415 00:07:17.381 04:04:31 -- accel/accel_rpc.sh@15 -- # waitforlisten 3752415 00:07:17.381 04:04:31 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:17.381 04:04:31 -- common/autotest_common.sh@819 -- # '[' -z 3752415 ']' 00:07:17.381 04:04:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:17.381 04:04:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:17.381 04:04:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:17.381 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:17.381 04:04:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:17.381 04:04:31 -- common/autotest_common.sh@10 -- # set +x 00:07:17.381 [2024-05-14 04:04:31.910499] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:17.381 [2024-05-14 04:04:31.910560] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3752415 ] 00:07:17.381 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.642 [2024-05-14 04:04:31.971321] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.642 [2024-05-14 04:04:32.033721] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:17.642 [2024-05-14 04:04:32.033847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.213 04:04:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:18.213 04:04:32 -- common/autotest_common.sh@852 -- # return 0 00:07:18.213 04:04:32 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:18.213 04:04:32 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:18.213 04:04:32 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:18.213 04:04:32 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:18.213 04:04:32 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:18.213 04:04:32 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:18.213 04:04:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:18.213 04:04:32 -- common/autotest_common.sh@10 -- # set +x 00:07:18.213 ************************************ 00:07:18.213 START TEST accel_assign_opcode 00:07:18.213 ************************************ 00:07:18.213 04:04:32 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:07:18.213 04:04:32 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:18.213 04:04:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.213 04:04:32 -- common/autotest_common.sh@10 -- # set +x 00:07:18.213 [2024-05-14 04:04:32.671692] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:18.213 04:04:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.213 04:04:32 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:18.213 04:04:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.213 04:04:32 -- common/autotest_common.sh@10 -- # set +x 00:07:18.213 [2024-05-14 04:04:32.683720] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:18.213 04:04:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.213 04:04:32 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:18.213 04:04:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.213 04:04:32 -- common/autotest_common.sh@10 -- # set +x 00:07:18.474 04:04:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.474 04:04:32 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:18.474 04:04:32 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:18.474 04:04:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.474 04:04:32 -- accel/accel_rpc.sh@42 -- # grep software 00:07:18.474 04:04:32 -- common/autotest_common.sh@10 -- # set +x 00:07:18.474 04:04:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.474 software 00:07:18.474 00:07:18.474 real 0m0.216s 00:07:18.474 user 0m0.048s 00:07:18.474 sys 0m0.010s 00:07:18.474 04:04:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:18.474 04:04:32 -- common/autotest_common.sh@10 -- # set +x 00:07:18.474 ************************************ 00:07:18.474 END TEST accel_assign_opcode 00:07:18.474 ************************************ 00:07:18.474 04:04:32 -- accel/accel_rpc.sh@55 -- # killprocess 3752415 00:07:18.474 04:04:32 -- common/autotest_common.sh@926 -- # '[' -z 3752415 ']' 00:07:18.474 04:04:32 -- common/autotest_common.sh@930 -- # kill -0 3752415 00:07:18.474 04:04:32 -- common/autotest_common.sh@931 -- # uname 00:07:18.474 04:04:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:18.474 04:04:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3752415 00:07:18.474 04:04:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:18.474 04:04:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:18.474 04:04:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3752415' 00:07:18.474 killing process with pid 3752415 00:07:18.474 04:04:32 -- common/autotest_common.sh@945 -- # kill 3752415 00:07:18.474 04:04:32 -- common/autotest_common.sh@950 -- # wait 3752415 00:07:18.735 00:07:18.735 real 0m1.417s 00:07:18.735 user 0m1.475s 00:07:18.735 sys 0m0.372s 00:07:18.735 04:04:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:18.735 04:04:33 -- common/autotest_common.sh@10 -- # set +x 00:07:18.735 ************************************ 00:07:18.735 END TEST accel_rpc 00:07:18.735 ************************************ 00:07:18.735 04:04:33 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:18.735 04:04:33 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:18.735 04:04:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:18.735 04:04:33 -- common/autotest_common.sh@10 -- # set +x 00:07:18.735 ************************************ 00:07:18.735 START TEST app_cmdline 00:07:18.735 ************************************ 00:07:18.735 04:04:33 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:18.735 * Looking for test storage... 00:07:18.996 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:18.996 04:04:33 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:18.996 04:04:33 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3752789 00:07:18.996 04:04:33 -- app/cmdline.sh@18 -- # waitforlisten 3752789 00:07:18.996 04:04:33 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:18.996 04:04:33 -- common/autotest_common.sh@819 -- # '[' -z 3752789 ']' 00:07:18.996 04:04:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:18.996 04:04:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:18.996 04:04:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:18.996 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:18.996 04:04:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:18.996 04:04:33 -- common/autotest_common.sh@10 -- # set +x 00:07:18.996 [2024-05-14 04:04:33.380119] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:18.996 [2024-05-14 04:04:33.380201] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3752789 ] 00:07:18.996 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.996 [2024-05-14 04:04:33.443780] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.996 [2024-05-14 04:04:33.516244] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:18.996 [2024-05-14 04:04:33.516400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.567 04:04:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:19.567 04:04:34 -- common/autotest_common.sh@852 -- # return 0 00:07:19.567 04:04:34 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:19.829 { 00:07:19.829 "version": "SPDK v24.01.1-pre git sha1 36faa8c31", 00:07:19.829 "fields": { 00:07:19.829 "major": 24, 00:07:19.829 "minor": 1, 00:07:19.829 "patch": 1, 00:07:19.829 "suffix": "-pre", 00:07:19.829 "commit": "36faa8c31" 00:07:19.829 } 00:07:19.829 } 00:07:19.829 04:04:34 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:19.829 04:04:34 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:19.829 04:04:34 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:19.829 04:04:34 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:19.829 04:04:34 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:19.829 04:04:34 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:19.829 04:04:34 -- app/cmdline.sh@26 -- # sort 00:07:19.829 04:04:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.829 04:04:34 -- common/autotest_common.sh@10 -- # set +x 00:07:19.829 04:04:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.829 04:04:34 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:19.829 04:04:34 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:19.829 04:04:34 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:19.829 04:04:34 -- common/autotest_common.sh@640 -- # local es=0 00:07:19.829 04:04:34 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:19.829 04:04:34 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:19.829 04:04:34 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:19.829 04:04:34 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:19.829 04:04:34 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:19.829 04:04:34 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:19.829 04:04:34 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:19.829 04:04:34 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:19.829 04:04:34 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:19.829 04:04:34 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:20.091 request: 00:07:20.091 { 00:07:20.091 "method": "env_dpdk_get_mem_stats", 00:07:20.091 "req_id": 1 00:07:20.091 } 00:07:20.091 Got JSON-RPC error response 00:07:20.091 response: 00:07:20.091 { 00:07:20.091 "code": -32601, 00:07:20.091 "message": "Method not found" 00:07:20.091 } 00:07:20.091 04:04:34 -- common/autotest_common.sh@643 -- # es=1 00:07:20.091 04:04:34 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:20.091 04:04:34 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:07:20.091 04:04:34 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:20.091 04:04:34 -- app/cmdline.sh@1 -- # killprocess 3752789 00:07:20.091 04:04:34 -- common/autotest_common.sh@926 -- # '[' -z 3752789 ']' 00:07:20.091 04:04:34 -- common/autotest_common.sh@930 -- # kill -0 3752789 00:07:20.091 04:04:34 -- common/autotest_common.sh@931 -- # uname 00:07:20.091 04:04:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:20.091 04:04:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3752789 00:07:20.091 04:04:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:20.091 04:04:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:20.091 04:04:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3752789' 00:07:20.091 killing process with pid 3752789 00:07:20.091 04:04:34 -- common/autotest_common.sh@945 -- # kill 3752789 00:07:20.091 04:04:34 -- common/autotest_common.sh@950 -- # wait 3752789 00:07:20.352 00:07:20.352 real 0m1.507s 00:07:20.352 user 0m1.784s 00:07:20.352 sys 0m0.399s 00:07:20.352 04:04:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:20.352 04:04:34 -- common/autotest_common.sh@10 -- # set +x 00:07:20.352 ************************************ 00:07:20.352 END TEST app_cmdline 00:07:20.352 ************************************ 00:07:20.352 04:04:34 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:20.352 04:04:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:20.352 04:04:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:20.352 04:04:34 -- common/autotest_common.sh@10 -- # set +x 00:07:20.352 ************************************ 00:07:20.352 START TEST version 00:07:20.352 ************************************ 00:07:20.352 04:04:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:20.352 * Looking for test storage... 00:07:20.352 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:20.352 04:04:34 -- app/version.sh@17 -- # get_header_version major 00:07:20.352 04:04:34 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:20.352 04:04:34 -- app/version.sh@14 -- # cut -f2 00:07:20.352 04:04:34 -- app/version.sh@14 -- # tr -d '"' 00:07:20.352 04:04:34 -- app/version.sh@17 -- # major=24 00:07:20.352 04:04:34 -- app/version.sh@18 -- # get_header_version minor 00:07:20.352 04:04:34 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:20.353 04:04:34 -- app/version.sh@14 -- # cut -f2 00:07:20.353 04:04:34 -- app/version.sh@14 -- # tr -d '"' 00:07:20.353 04:04:34 -- app/version.sh@18 -- # minor=1 00:07:20.353 04:04:34 -- app/version.sh@19 -- # get_header_version patch 00:07:20.353 04:04:34 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:20.353 04:04:34 -- app/version.sh@14 -- # cut -f2 00:07:20.353 04:04:34 -- app/version.sh@14 -- # tr -d '"' 00:07:20.353 04:04:34 -- app/version.sh@19 -- # patch=1 00:07:20.353 04:04:34 -- app/version.sh@20 -- # get_header_version suffix 00:07:20.353 04:04:34 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:20.353 04:04:34 -- app/version.sh@14 -- # cut -f2 00:07:20.353 04:04:34 -- app/version.sh@14 -- # tr -d '"' 00:07:20.353 04:04:34 -- app/version.sh@20 -- # suffix=-pre 00:07:20.353 04:04:34 -- app/version.sh@22 -- # version=24.1 00:07:20.353 04:04:34 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:20.353 04:04:34 -- app/version.sh@25 -- # version=24.1.1 00:07:20.353 04:04:34 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:20.353 04:04:34 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:20.353 04:04:34 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:20.614 04:04:34 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:20.614 04:04:34 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:20.614 00:07:20.614 real 0m0.178s 00:07:20.614 user 0m0.092s 00:07:20.614 sys 0m0.130s 00:07:20.614 04:04:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:20.614 04:04:34 -- common/autotest_common.sh@10 -- # set +x 00:07:20.614 ************************************ 00:07:20.614 END TEST version 00:07:20.614 ************************************ 00:07:20.614 04:04:35 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:07:20.614 04:04:35 -- spdk/autotest.sh@204 -- # uname -s 00:07:20.614 04:04:35 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:07:20.614 04:04:35 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:07:20.614 04:04:35 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:07:20.614 04:04:35 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:07:20.614 04:04:35 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:07:20.614 04:04:35 -- spdk/autotest.sh@268 -- # timing_exit lib 00:07:20.614 04:04:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:20.614 04:04:35 -- common/autotest_common.sh@10 -- # set +x 00:07:20.614 04:04:35 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:07:20.614 04:04:35 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:07:20.614 04:04:35 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:07:20.614 04:04:35 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:07:20.614 04:04:35 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:07:20.614 04:04:35 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:07:20.614 04:04:35 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:20.614 04:04:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:20.614 04:04:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:20.614 04:04:35 -- common/autotest_common.sh@10 -- # set +x 00:07:20.614 ************************************ 00:07:20.614 START TEST nvmf_tcp 00:07:20.614 ************************************ 00:07:20.614 04:04:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:20.614 * Looking for test storage... 00:07:20.614 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:20.614 04:04:35 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:20.614 04:04:35 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:20.614 04:04:35 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:20.614 04:04:35 -- nvmf/common.sh@7 -- # uname -s 00:07:20.614 04:04:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:20.614 04:04:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:20.614 04:04:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:20.614 04:04:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:20.614 04:04:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:20.614 04:04:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:20.614 04:04:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:20.614 04:04:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:20.614 04:04:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:20.614 04:04:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:20.614 04:04:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:20.614 04:04:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:20.614 04:04:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:20.614 04:04:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:20.614 04:04:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:20.614 04:04:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:20.614 04:04:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:20.614 04:04:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:20.614 04:04:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:20.614 04:04:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:20.614 04:04:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:20.614 04:04:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:20.614 04:04:35 -- paths/export.sh@5 -- # export PATH 00:07:20.615 04:04:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:20.615 04:04:35 -- nvmf/common.sh@46 -- # : 0 00:07:20.615 04:04:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:20.615 04:04:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:20.615 04:04:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:20.615 04:04:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:20.615 04:04:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:20.615 04:04:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:20.615 04:04:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:20.615 04:04:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:20.615 04:04:35 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:20.615 04:04:35 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:20.615 04:04:35 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:20.615 04:04:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:20.615 04:04:35 -- common/autotest_common.sh@10 -- # set +x 00:07:20.615 04:04:35 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:20.615 04:04:35 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:20.615 04:04:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:20.615 04:04:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:20.615 04:04:35 -- common/autotest_common.sh@10 -- # set +x 00:07:20.615 ************************************ 00:07:20.615 START TEST nvmf_example 00:07:20.615 ************************************ 00:07:20.615 04:04:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:20.875 * Looking for test storage... 00:07:20.875 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:20.875 04:04:35 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:20.875 04:04:35 -- nvmf/common.sh@7 -- # uname -s 00:07:20.875 04:04:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:20.875 04:04:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:20.875 04:04:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:20.875 04:04:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:20.875 04:04:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:20.875 04:04:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:20.875 04:04:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:20.875 04:04:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:20.875 04:04:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:20.875 04:04:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:20.875 04:04:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:20.875 04:04:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:20.875 04:04:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:20.875 04:04:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:20.875 04:04:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:20.875 04:04:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:20.875 04:04:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:20.875 04:04:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:20.875 04:04:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:20.875 04:04:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:20.875 04:04:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:20.875 04:04:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:20.875 04:04:35 -- paths/export.sh@5 -- # export PATH 00:07:20.875 04:04:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:20.875 04:04:35 -- nvmf/common.sh@46 -- # : 0 00:07:20.875 04:04:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:20.875 04:04:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:20.875 04:04:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:20.876 04:04:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:20.876 04:04:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:20.876 04:04:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:20.876 04:04:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:20.876 04:04:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:20.876 04:04:35 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:20.876 04:04:35 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:20.876 04:04:35 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:20.876 04:04:35 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:20.876 04:04:35 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:20.876 04:04:35 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:20.876 04:04:35 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:20.876 04:04:35 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:20.876 04:04:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:20.876 04:04:35 -- common/autotest_common.sh@10 -- # set +x 00:07:20.876 04:04:35 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:20.876 04:04:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:20.876 04:04:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:20.876 04:04:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:20.876 04:04:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:20.876 04:04:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:20.876 04:04:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:20.876 04:04:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:20.876 04:04:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:20.876 04:04:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:20.876 04:04:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:20.876 04:04:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:20.876 04:04:35 -- common/autotest_common.sh@10 -- # set +x 00:07:27.467 04:04:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:27.467 04:04:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:27.467 04:04:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:27.467 04:04:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:27.467 04:04:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:27.467 04:04:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:27.467 04:04:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:27.467 04:04:42 -- nvmf/common.sh@294 -- # net_devs=() 00:07:27.467 04:04:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:27.467 04:04:42 -- nvmf/common.sh@295 -- # e810=() 00:07:27.467 04:04:42 -- nvmf/common.sh@295 -- # local -ga e810 00:07:27.467 04:04:42 -- nvmf/common.sh@296 -- # x722=() 00:07:27.467 04:04:42 -- nvmf/common.sh@296 -- # local -ga x722 00:07:27.467 04:04:42 -- nvmf/common.sh@297 -- # mlx=() 00:07:27.467 04:04:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:27.467 04:04:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:27.467 04:04:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:27.467 04:04:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:27.467 04:04:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:27.467 04:04:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:27.467 04:04:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:07:27.467 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:07:27.467 04:04:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:27.467 04:04:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:07:27.467 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:07:27.467 04:04:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:27.467 04:04:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:27.467 04:04:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:27.467 04:04:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:27.467 04:04:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:27.467 04:04:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:27.467 04:04:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:07:27.467 Found net devices under 0000:4b:00.0: cvl_0_0 00:07:27.467 04:04:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:27.467 04:04:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:27.467 04:04:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:27.467 04:04:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:27.467 04:04:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:27.467 04:04:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:07:27.467 Found net devices under 0000:4b:00.1: cvl_0_1 00:07:27.467 04:04:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:27.467 04:04:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:27.467 04:04:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:27.729 04:04:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:27.729 04:04:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:27.729 04:04:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:27.729 04:04:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:27.729 04:04:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:27.729 04:04:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:27.729 04:04:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:27.729 04:04:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:27.729 04:04:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:27.729 04:04:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:27.729 04:04:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:27.729 04:04:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:27.729 04:04:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:27.729 04:04:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:27.729 04:04:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:27.729 04:04:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:27.729 04:04:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:27.729 04:04:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:27.729 04:04:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:27.729 04:04:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:27.991 04:04:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:27.991 04:04:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:27.991 04:04:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:27.991 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:27.991 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.624 ms 00:07:27.991 00:07:27.991 --- 10.0.0.2 ping statistics --- 00:07:27.991 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:27.991 rtt min/avg/max/mdev = 0.624/0.624/0.624/0.000 ms 00:07:27.991 04:04:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:27.991 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:27.991 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.371 ms 00:07:27.991 00:07:27.991 --- 10.0.0.1 ping statistics --- 00:07:27.991 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:27.991 rtt min/avg/max/mdev = 0.371/0.371/0.371/0.000 ms 00:07:27.991 04:04:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:27.991 04:04:42 -- nvmf/common.sh@410 -- # return 0 00:07:27.991 04:04:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:27.991 04:04:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:27.991 04:04:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:27.991 04:04:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:27.991 04:04:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:27.991 04:04:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:27.991 04:04:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:27.991 04:04:42 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:27.991 04:04:42 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:27.991 04:04:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:27.991 04:04:42 -- common/autotest_common.sh@10 -- # set +x 00:07:27.991 04:04:42 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:27.991 04:04:42 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:27.991 04:04:42 -- target/nvmf_example.sh@34 -- # nvmfpid=3756925 00:07:27.991 04:04:42 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:27.991 04:04:42 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:27.991 04:04:42 -- target/nvmf_example.sh@36 -- # waitforlisten 3756925 00:07:27.991 04:04:42 -- common/autotest_common.sh@819 -- # '[' -z 3756925 ']' 00:07:27.991 04:04:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:27.991 04:04:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:27.991 04:04:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:27.991 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:27.991 04:04:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:27.991 04:04:42 -- common/autotest_common.sh@10 -- # set +x 00:07:27.991 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.934 04:04:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:28.934 04:04:43 -- common/autotest_common.sh@852 -- # return 0 00:07:28.934 04:04:43 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:28.934 04:04:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:28.934 04:04:43 -- common/autotest_common.sh@10 -- # set +x 00:07:28.934 04:04:43 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:28.934 04:04:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:28.934 04:04:43 -- common/autotest_common.sh@10 -- # set +x 00:07:28.934 04:04:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:28.934 04:04:43 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:28.934 04:04:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:28.934 04:04:43 -- common/autotest_common.sh@10 -- # set +x 00:07:28.934 04:04:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:28.934 04:04:43 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:28.934 04:04:43 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:28.934 04:04:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:28.934 04:04:43 -- common/autotest_common.sh@10 -- # set +x 00:07:28.934 04:04:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:28.934 04:04:43 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:28.934 04:04:43 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:28.934 04:04:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:28.934 04:04:43 -- common/autotest_common.sh@10 -- # set +x 00:07:28.934 04:04:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:28.934 04:04:43 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:28.934 04:04:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:28.934 04:04:43 -- common/autotest_common.sh@10 -- # set +x 00:07:28.934 04:04:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:28.934 04:04:43 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:28.934 04:04:43 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:28.934 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.000 Initializing NVMe Controllers 00:07:39.000 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:39.000 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:39.000 Initialization complete. Launching workers. 00:07:39.000 ======================================================== 00:07:39.000 Latency(us) 00:07:39.000 Device Information : IOPS MiB/s Average min max 00:07:39.000 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14627.26 57.14 4375.07 869.56 16576.77 00:07:39.000 ======================================================== 00:07:39.000 Total : 14627.26 57.14 4375.07 869.56 16576.77 00:07:39.000 00:07:39.000 04:04:53 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:39.000 04:04:53 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:39.000 04:04:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:39.000 04:04:53 -- nvmf/common.sh@116 -- # sync 00:07:39.000 04:04:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:39.000 04:04:53 -- nvmf/common.sh@119 -- # set +e 00:07:39.000 04:04:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:39.000 04:04:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:39.000 rmmod nvme_tcp 00:07:39.000 rmmod nvme_fabrics 00:07:39.000 rmmod nvme_keyring 00:07:39.000 04:04:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:39.000 04:04:53 -- nvmf/common.sh@123 -- # set -e 00:07:39.000 04:04:53 -- nvmf/common.sh@124 -- # return 0 00:07:39.000 04:04:53 -- nvmf/common.sh@477 -- # '[' -n 3756925 ']' 00:07:39.000 04:04:53 -- nvmf/common.sh@478 -- # killprocess 3756925 00:07:39.000 04:04:53 -- common/autotest_common.sh@926 -- # '[' -z 3756925 ']' 00:07:39.000 04:04:53 -- common/autotest_common.sh@930 -- # kill -0 3756925 00:07:39.000 04:04:53 -- common/autotest_common.sh@931 -- # uname 00:07:39.261 04:04:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:39.261 04:04:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3756925 00:07:39.261 04:04:53 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:07:39.261 04:04:53 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:07:39.261 04:04:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3756925' 00:07:39.261 killing process with pid 3756925 00:07:39.261 04:04:53 -- common/autotest_common.sh@945 -- # kill 3756925 00:07:39.261 04:04:53 -- common/autotest_common.sh@950 -- # wait 3756925 00:07:39.261 nvmf threads initialize successfully 00:07:39.261 bdev subsystem init successfully 00:07:39.261 created a nvmf target service 00:07:39.261 create targets's poll groups done 00:07:39.261 all subsystems of target started 00:07:39.261 nvmf target is running 00:07:39.261 all subsystems of target stopped 00:07:39.261 destroy targets's poll groups done 00:07:39.261 destroyed the nvmf target service 00:07:39.261 bdev subsystem finish successfully 00:07:39.261 nvmf threads destroy successfully 00:07:39.261 04:04:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:39.261 04:04:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:39.261 04:04:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:39.261 04:04:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:39.261 04:04:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:39.261 04:04:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:39.261 04:04:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:39.261 04:04:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:41.823 04:04:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:41.823 04:04:55 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:41.823 04:04:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:41.823 04:04:55 -- common/autotest_common.sh@10 -- # set +x 00:07:41.823 00:07:41.823 real 0m20.674s 00:07:41.823 user 0m46.028s 00:07:41.823 sys 0m6.353s 00:07:41.823 04:04:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:41.823 04:04:55 -- common/autotest_common.sh@10 -- # set +x 00:07:41.823 ************************************ 00:07:41.823 END TEST nvmf_example 00:07:41.823 ************************************ 00:07:41.823 04:04:55 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:41.823 04:04:55 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:41.823 04:04:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:41.823 04:04:55 -- common/autotest_common.sh@10 -- # set +x 00:07:41.823 ************************************ 00:07:41.823 START TEST nvmf_filesystem 00:07:41.823 ************************************ 00:07:41.823 04:04:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:41.823 * Looking for test storage... 00:07:41.823 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:41.823 04:04:56 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:07:41.823 04:04:56 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:41.823 04:04:56 -- common/autotest_common.sh@34 -- # set -e 00:07:41.823 04:04:56 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:41.823 04:04:56 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:41.823 04:04:56 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:41.823 04:04:56 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:07:41.823 04:04:56 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:41.823 04:04:56 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:41.823 04:04:56 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:41.823 04:04:56 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:41.823 04:04:56 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:41.823 04:04:56 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:41.823 04:04:56 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:41.823 04:04:56 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:41.823 04:04:56 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:41.823 04:04:56 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:41.823 04:04:56 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:41.823 04:04:56 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:41.823 04:04:56 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:41.823 04:04:56 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:41.823 04:04:56 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:41.823 04:04:56 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:41.823 04:04:56 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:41.823 04:04:56 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:41.823 04:04:56 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:41.823 04:04:56 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:41.823 04:04:56 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:41.823 04:04:56 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:41.823 04:04:56 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:41.823 04:04:56 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:41.823 04:04:56 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:41.823 04:04:56 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:41.823 04:04:56 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:41.823 04:04:56 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:41.823 04:04:56 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:41.823 04:04:56 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:41.823 04:04:56 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:41.823 04:04:56 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:41.823 04:04:56 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:41.823 04:04:56 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:41.823 04:04:56 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:41.823 04:04:56 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:07:41.823 04:04:56 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:41.823 04:04:56 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:41.823 04:04:56 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:41.823 04:04:56 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:41.823 04:04:56 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:07:41.823 04:04:56 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:41.823 04:04:56 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:41.823 04:04:56 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:41.823 04:04:56 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:41.823 04:04:56 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:41.824 04:04:56 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:41.824 04:04:56 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:41.824 04:04:56 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:41.824 04:04:56 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:41.824 04:04:56 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:07:41.824 04:04:56 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:41.824 04:04:56 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:07:41.824 04:04:56 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:07:41.824 04:04:56 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:07:41.824 04:04:56 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:07:41.824 04:04:56 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:07:41.824 04:04:56 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:07:41.824 04:04:56 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:07:41.824 04:04:56 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=n 00:07:41.824 04:04:56 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:07:41.824 04:04:56 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:07:41.824 04:04:56 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:07:41.824 04:04:56 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:07:41.824 04:04:56 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:07:41.824 04:04:56 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:41.824 04:04:56 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:07:41.824 04:04:56 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:07:41.824 04:04:56 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:07:41.824 04:04:56 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:07:41.824 04:04:56 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:07:41.824 04:04:56 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:07:41.824 04:04:56 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:07:41.824 04:04:56 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:07:41.824 04:04:56 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:07:41.824 04:04:56 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:07:41.824 04:04:56 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:41.824 04:04:56 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:07:41.824 04:04:56 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:07:41.824 04:04:56 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:41.824 04:04:56 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:41.824 04:04:56 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:41.824 04:04:56 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:41.824 04:04:56 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:41.824 04:04:56 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:41.824 04:04:56 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:41.824 04:04:56 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:41.824 04:04:56 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:41.824 04:04:56 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:41.824 04:04:56 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:41.824 04:04:56 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:41.824 04:04:56 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:41.824 04:04:56 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:41.824 04:04:56 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:07:41.824 04:04:56 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:41.824 #define SPDK_CONFIG_H 00:07:41.824 #define SPDK_CONFIG_APPS 1 00:07:41.824 #define SPDK_CONFIG_ARCH native 00:07:41.824 #undef SPDK_CONFIG_ASAN 00:07:41.824 #undef SPDK_CONFIG_AVAHI 00:07:41.824 #undef SPDK_CONFIG_CET 00:07:41.824 #define SPDK_CONFIG_COVERAGE 1 00:07:41.824 #define SPDK_CONFIG_CROSS_PREFIX 00:07:41.824 #undef SPDK_CONFIG_CRYPTO 00:07:41.824 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:41.824 #undef SPDK_CONFIG_CUSTOMOCF 00:07:41.824 #undef SPDK_CONFIG_DAOS 00:07:41.824 #define SPDK_CONFIG_DAOS_DIR 00:07:41.824 #define SPDK_CONFIG_DEBUG 1 00:07:41.824 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:41.824 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:07:41.824 #define SPDK_CONFIG_DPDK_INC_DIR 00:07:41.824 #define SPDK_CONFIG_DPDK_LIB_DIR 00:07:41.824 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:41.824 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:41.824 #define SPDK_CONFIG_EXAMPLES 1 00:07:41.824 #undef SPDK_CONFIG_FC 00:07:41.824 #define SPDK_CONFIG_FC_PATH 00:07:41.824 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:41.824 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:41.824 #undef SPDK_CONFIG_FUSE 00:07:41.824 #undef SPDK_CONFIG_FUZZER 00:07:41.824 #define SPDK_CONFIG_FUZZER_LIB 00:07:41.824 #undef SPDK_CONFIG_GOLANG 00:07:41.824 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:41.824 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:41.824 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:41.824 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:41.824 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:41.824 #define SPDK_CONFIG_IDXD 1 00:07:41.824 #undef SPDK_CONFIG_IDXD_KERNEL 00:07:41.824 #undef SPDK_CONFIG_IPSEC_MB 00:07:41.824 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:41.824 #define SPDK_CONFIG_ISAL 1 00:07:41.824 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:41.824 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:41.824 #define SPDK_CONFIG_LIBDIR 00:07:41.824 #undef SPDK_CONFIG_LTO 00:07:41.824 #define SPDK_CONFIG_MAX_LCORES 00:07:41.824 #define SPDK_CONFIG_NVME_CUSE 1 00:07:41.824 #undef SPDK_CONFIG_OCF 00:07:41.824 #define SPDK_CONFIG_OCF_PATH 00:07:41.824 #define SPDK_CONFIG_OPENSSL_PATH 00:07:41.824 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:41.824 #undef SPDK_CONFIG_PGO_USE 00:07:41.824 #define SPDK_CONFIG_PREFIX /usr/local 00:07:41.824 #undef SPDK_CONFIG_RAID5F 00:07:41.824 #undef SPDK_CONFIG_RBD 00:07:41.824 #define SPDK_CONFIG_RDMA 1 00:07:41.824 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:41.824 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:41.824 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:41.824 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:41.824 #define SPDK_CONFIG_SHARED 1 00:07:41.824 #undef SPDK_CONFIG_SMA 00:07:41.824 #define SPDK_CONFIG_TESTS 1 00:07:41.824 #undef SPDK_CONFIG_TSAN 00:07:41.824 #define SPDK_CONFIG_UBLK 1 00:07:41.824 #define SPDK_CONFIG_UBSAN 1 00:07:41.824 #undef SPDK_CONFIG_UNIT_TESTS 00:07:41.824 #undef SPDK_CONFIG_URING 00:07:41.824 #define SPDK_CONFIG_URING_PATH 00:07:41.824 #undef SPDK_CONFIG_URING_ZNS 00:07:41.824 #undef SPDK_CONFIG_USDT 00:07:41.824 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:41.824 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:41.824 #undef SPDK_CONFIG_VFIO_USER 00:07:41.824 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:41.824 #define SPDK_CONFIG_VHOST 1 00:07:41.824 #define SPDK_CONFIG_VIRTIO 1 00:07:41.824 #undef SPDK_CONFIG_VTUNE 00:07:41.824 #define SPDK_CONFIG_VTUNE_DIR 00:07:41.824 #define SPDK_CONFIG_WERROR 1 00:07:41.824 #define SPDK_CONFIG_WPDK_DIR 00:07:41.824 #undef SPDK_CONFIG_XNVME 00:07:41.824 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:41.824 04:04:56 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:41.824 04:04:56 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:41.824 04:04:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:41.824 04:04:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:41.824 04:04:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:41.824 04:04:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.824 04:04:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.824 04:04:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.824 04:04:56 -- paths/export.sh@5 -- # export PATH 00:07:41.824 04:04:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.824 04:04:56 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:41.824 04:04:56 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:41.824 04:04:56 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:41.824 04:04:56 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:41.824 04:04:56 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:41.824 04:04:56 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:41.824 04:04:56 -- pm/common@16 -- # TEST_TAG=N/A 00:07:41.824 04:04:56 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:07:41.824 04:04:56 -- common/autotest_common.sh@52 -- # : 1 00:07:41.824 04:04:56 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:07:41.824 04:04:56 -- common/autotest_common.sh@56 -- # : 0 00:07:41.824 04:04:56 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:41.824 04:04:56 -- common/autotest_common.sh@58 -- # : 0 00:07:41.824 04:04:56 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:07:41.824 04:04:56 -- common/autotest_common.sh@60 -- # : 1 00:07:41.825 04:04:56 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:41.825 04:04:56 -- common/autotest_common.sh@62 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:07:41.825 04:04:56 -- common/autotest_common.sh@64 -- # : 00:07:41.825 04:04:56 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:07:41.825 04:04:56 -- common/autotest_common.sh@66 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:07:41.825 04:04:56 -- common/autotest_common.sh@68 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:07:41.825 04:04:56 -- common/autotest_common.sh@70 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:07:41.825 04:04:56 -- common/autotest_common.sh@72 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:41.825 04:04:56 -- common/autotest_common.sh@74 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:07:41.825 04:04:56 -- common/autotest_common.sh@76 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:07:41.825 04:04:56 -- common/autotest_common.sh@78 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:07:41.825 04:04:56 -- common/autotest_common.sh@80 -- # : 1 00:07:41.825 04:04:56 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:07:41.825 04:04:56 -- common/autotest_common.sh@82 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:07:41.825 04:04:56 -- common/autotest_common.sh@84 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:07:41.825 04:04:56 -- common/autotest_common.sh@86 -- # : 1 00:07:41.825 04:04:56 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:07:41.825 04:04:56 -- common/autotest_common.sh@88 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:07:41.825 04:04:56 -- common/autotest_common.sh@90 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:41.825 04:04:56 -- common/autotest_common.sh@92 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:07:41.825 04:04:56 -- common/autotest_common.sh@94 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:07:41.825 04:04:56 -- common/autotest_common.sh@96 -- # : tcp 00:07:41.825 04:04:56 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:41.825 04:04:56 -- common/autotest_common.sh@98 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:07:41.825 04:04:56 -- common/autotest_common.sh@100 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:07:41.825 04:04:56 -- common/autotest_common.sh@102 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:07:41.825 04:04:56 -- common/autotest_common.sh@104 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:07:41.825 04:04:56 -- common/autotest_common.sh@106 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:07:41.825 04:04:56 -- common/autotest_common.sh@108 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:07:41.825 04:04:56 -- common/autotest_common.sh@110 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:07:41.825 04:04:56 -- common/autotest_common.sh@112 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:41.825 04:04:56 -- common/autotest_common.sh@114 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:07:41.825 04:04:56 -- common/autotest_common.sh@116 -- # : 1 00:07:41.825 04:04:56 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:07:41.825 04:04:56 -- common/autotest_common.sh@118 -- # : 00:07:41.825 04:04:56 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:41.825 04:04:56 -- common/autotest_common.sh@120 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:07:41.825 04:04:56 -- common/autotest_common.sh@122 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:07:41.825 04:04:56 -- common/autotest_common.sh@124 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:07:41.825 04:04:56 -- common/autotest_common.sh@126 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:07:41.825 04:04:56 -- common/autotest_common.sh@128 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:07:41.825 04:04:56 -- common/autotest_common.sh@130 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:07:41.825 04:04:56 -- common/autotest_common.sh@132 -- # : 00:07:41.825 04:04:56 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:07:41.825 04:04:56 -- common/autotest_common.sh@134 -- # : true 00:07:41.825 04:04:56 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:07:41.825 04:04:56 -- common/autotest_common.sh@136 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:07:41.825 04:04:56 -- common/autotest_common.sh@138 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:07:41.825 04:04:56 -- common/autotest_common.sh@140 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:07:41.825 04:04:56 -- common/autotest_common.sh@142 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:07:41.825 04:04:56 -- common/autotest_common.sh@144 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:07:41.825 04:04:56 -- common/autotest_common.sh@146 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:07:41.825 04:04:56 -- common/autotest_common.sh@148 -- # : e810 00:07:41.825 04:04:56 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:07:41.825 04:04:56 -- common/autotest_common.sh@150 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:07:41.825 04:04:56 -- common/autotest_common.sh@152 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:07:41.825 04:04:56 -- common/autotest_common.sh@154 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:07:41.825 04:04:56 -- common/autotest_common.sh@156 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:07:41.825 04:04:56 -- common/autotest_common.sh@158 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:07:41.825 04:04:56 -- common/autotest_common.sh@160 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:07:41.825 04:04:56 -- common/autotest_common.sh@163 -- # : 00:07:41.825 04:04:56 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:07:41.825 04:04:56 -- common/autotest_common.sh@165 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:07:41.825 04:04:56 -- common/autotest_common.sh@167 -- # : 0 00:07:41.825 04:04:56 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:41.825 04:04:56 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:41.825 04:04:56 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:41.825 04:04:56 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:07:41.825 04:04:56 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:07:41.825 04:04:56 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:41.825 04:04:56 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:41.825 04:04:56 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:41.825 04:04:56 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:41.825 04:04:56 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:41.825 04:04:56 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:41.825 04:04:56 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:41.825 04:04:56 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:41.825 04:04:56 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:41.825 04:04:56 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:07:41.825 04:04:56 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:41.825 04:04:56 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:41.826 04:04:56 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:41.826 04:04:56 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:41.826 04:04:56 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:41.826 04:04:56 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:07:41.826 04:04:56 -- common/autotest_common.sh@196 -- # cat 00:07:41.826 04:04:56 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:07:41.826 04:04:56 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:41.826 04:04:56 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:41.826 04:04:56 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:41.826 04:04:56 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:41.826 04:04:56 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:07:41.826 04:04:56 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:07:41.826 04:04:56 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:41.826 04:04:56 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:41.826 04:04:56 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:41.826 04:04:56 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:41.826 04:04:56 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:41.826 04:04:56 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:41.826 04:04:56 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:41.826 04:04:56 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:41.826 04:04:56 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:41.826 04:04:56 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:41.826 04:04:56 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:41.826 04:04:56 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:41.826 04:04:56 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:07:41.826 04:04:56 -- common/autotest_common.sh@249 -- # export valgrind= 00:07:41.826 04:04:56 -- common/autotest_common.sh@249 -- # valgrind= 00:07:41.826 04:04:56 -- common/autotest_common.sh@255 -- # uname -s 00:07:41.826 04:04:56 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:07:41.826 04:04:56 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:07:41.826 04:04:56 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:07:41.826 04:04:56 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:07:41.826 04:04:56 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:07:41.826 04:04:56 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:07:41.826 04:04:56 -- common/autotest_common.sh@265 -- # MAKE=make 00:07:41.826 04:04:56 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j144 00:07:41.826 04:04:56 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:07:41.826 04:04:56 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:07:41.826 04:04:56 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:07:41.826 04:04:56 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:07:41.826 04:04:56 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:07:41.826 04:04:56 -- common/autotest_common.sh@291 -- # for i in "$@" 00:07:41.826 04:04:56 -- common/autotest_common.sh@292 -- # case "$i" in 00:07:41.826 04:04:56 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:07:41.826 04:04:56 -- common/autotest_common.sh@309 -- # [[ -z 3759757 ]] 00:07:41.826 04:04:56 -- common/autotest_common.sh@309 -- # kill -0 3759757 00:07:41.826 04:04:56 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:07:41.826 04:04:56 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:07:41.826 04:04:56 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:07:41.826 04:04:56 -- common/autotest_common.sh@322 -- # local mount target_dir 00:07:41.826 04:04:56 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:07:41.826 04:04:56 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:07:41.826 04:04:56 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:07:41.826 04:04:56 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:07:41.826 04:04:56 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.v5CuiS 00:07:41.826 04:04:56 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:41.826 04:04:56 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:07:41.826 04:04:56 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:07:41.826 04:04:56 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.v5CuiS/tests/target /tmp/spdk.v5CuiS 00:07:41.826 04:04:56 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:07:41.826 04:04:56 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:41.826 04:04:56 -- common/autotest_common.sh@318 -- # df -T 00:07:41.826 04:04:56 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:07:41.826 04:04:56 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:07:41.826 04:04:56 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # avails["$mount"]=976818176 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:07:41.826 04:04:56 -- common/autotest_common.sh@354 -- # uses["$mount"]=4307611648 00:07:41.826 04:04:56 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # avails["$mount"]=115436257280 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # sizes["$mount"]=129370943488 00:07:41.826 04:04:56 -- common/autotest_common.sh@354 -- # uses["$mount"]=13934686208 00:07:41.826 04:04:56 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # avails["$mount"]=64584925184 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # sizes["$mount"]=64685469696 00:07:41.826 04:04:56 -- common/autotest_common.sh@354 -- # uses["$mount"]=100544512 00:07:41.826 04:04:56 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # avails["$mount"]=25864491008 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # sizes["$mount"]=25874190336 00:07:41.826 04:04:56 -- common/autotest_common.sh@354 -- # uses["$mount"]=9699328 00:07:41.826 04:04:56 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # mounts["$mount"]=efivarfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # fss["$mount"]=efivarfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # avails["$mount"]=234496 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # sizes["$mount"]=507904 00:07:41.826 04:04:56 -- common/autotest_common.sh@354 -- # uses["$mount"]=269312 00:07:41.826 04:04:56 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # avails["$mount"]=64683700224 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # sizes["$mount"]=64685473792 00:07:41.826 04:04:56 -- common/autotest_common.sh@354 -- # uses["$mount"]=1773568 00:07:41.826 04:04:56 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # avails["$mount"]=12937089024 00:07:41.826 04:04:56 -- common/autotest_common.sh@353 -- # sizes["$mount"]=12937093120 00:07:41.826 04:04:56 -- common/autotest_common.sh@354 -- # uses["$mount"]=4096 00:07:41.826 04:04:56 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:41.826 04:04:56 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:07:41.826 * Looking for test storage... 00:07:41.826 04:04:56 -- common/autotest_common.sh@359 -- # local target_space new_size 00:07:41.826 04:04:56 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:07:41.826 04:04:56 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:41.826 04:04:56 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:41.826 04:04:56 -- common/autotest_common.sh@363 -- # mount=/ 00:07:41.826 04:04:56 -- common/autotest_common.sh@365 -- # target_space=115436257280 00:07:41.826 04:04:56 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:07:41.826 04:04:56 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:07:41.826 04:04:56 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:07:41.826 04:04:56 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:07:41.826 04:04:56 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:07:41.826 04:04:56 -- common/autotest_common.sh@372 -- # new_size=16149278720 00:07:41.826 04:04:56 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:41.826 04:04:56 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:41.826 04:04:56 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:41.826 04:04:56 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:41.826 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:41.826 04:04:56 -- common/autotest_common.sh@380 -- # return 0 00:07:41.826 04:04:56 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:07:41.826 04:04:56 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:07:41.826 04:04:56 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:41.826 04:04:56 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:41.826 04:04:56 -- common/autotest_common.sh@1672 -- # true 00:07:41.827 04:04:56 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:07:41.827 04:04:56 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:41.827 04:04:56 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:41.827 04:04:56 -- common/autotest_common.sh@27 -- # exec 00:07:41.827 04:04:56 -- common/autotest_common.sh@29 -- # exec 00:07:41.827 04:04:56 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:41.827 04:04:56 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:41.827 04:04:56 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:41.827 04:04:56 -- common/autotest_common.sh@18 -- # set -x 00:07:41.827 04:04:56 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:41.827 04:04:56 -- nvmf/common.sh@7 -- # uname -s 00:07:41.827 04:04:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:41.827 04:04:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:41.827 04:04:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:41.827 04:04:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:41.827 04:04:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:41.827 04:04:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:41.827 04:04:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:41.827 04:04:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:41.827 04:04:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:41.827 04:04:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:41.827 04:04:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:41.827 04:04:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:41.827 04:04:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:41.827 04:04:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:41.827 04:04:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:41.827 04:04:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:41.827 04:04:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:41.827 04:04:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:41.827 04:04:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:41.827 04:04:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.827 04:04:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.827 04:04:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.827 04:04:56 -- paths/export.sh@5 -- # export PATH 00:07:41.827 04:04:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.827 04:04:56 -- nvmf/common.sh@46 -- # : 0 00:07:41.827 04:04:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:41.827 04:04:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:41.827 04:04:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:41.827 04:04:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:41.827 04:04:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:41.827 04:04:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:41.827 04:04:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:41.827 04:04:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:41.827 04:04:56 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:41.827 04:04:56 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:41.827 04:04:56 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:41.827 04:04:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:41.827 04:04:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:41.827 04:04:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:41.827 04:04:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:41.827 04:04:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:41.827 04:04:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:41.827 04:04:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:41.827 04:04:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:41.827 04:04:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:41.827 04:04:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:41.827 04:04:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:41.827 04:04:56 -- common/autotest_common.sh@10 -- # set +x 00:07:49.975 04:05:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:49.975 04:05:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:49.975 04:05:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:49.975 04:05:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:49.975 04:05:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:49.975 04:05:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:49.975 04:05:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:49.975 04:05:03 -- nvmf/common.sh@294 -- # net_devs=() 00:07:49.975 04:05:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:49.975 04:05:03 -- nvmf/common.sh@295 -- # e810=() 00:07:49.975 04:05:03 -- nvmf/common.sh@295 -- # local -ga e810 00:07:49.975 04:05:03 -- nvmf/common.sh@296 -- # x722=() 00:07:49.975 04:05:03 -- nvmf/common.sh@296 -- # local -ga x722 00:07:49.975 04:05:03 -- nvmf/common.sh@297 -- # mlx=() 00:07:49.975 04:05:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:49.975 04:05:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:49.975 04:05:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:49.975 04:05:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:49.975 04:05:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:49.975 04:05:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:49.975 04:05:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:07:49.975 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:07:49.975 04:05:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:49.975 04:05:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:07:49.975 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:07:49.975 04:05:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:49.975 04:05:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:49.975 04:05:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:49.975 04:05:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:49.975 04:05:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:49.975 04:05:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:07:49.975 Found net devices under 0000:4b:00.0: cvl_0_0 00:07:49.975 04:05:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:49.975 04:05:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:49.975 04:05:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:49.975 04:05:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:49.975 04:05:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:49.975 04:05:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:07:49.975 Found net devices under 0000:4b:00.1: cvl_0_1 00:07:49.975 04:05:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:49.975 04:05:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:49.975 04:05:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:49.975 04:05:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:49.975 04:05:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:49.975 04:05:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:49.975 04:05:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:49.975 04:05:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:49.975 04:05:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:49.975 04:05:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:49.975 04:05:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:49.975 04:05:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:49.975 04:05:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:49.975 04:05:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:49.975 04:05:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:49.975 04:05:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:49.975 04:05:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:49.975 04:05:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:49.975 04:05:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:49.975 04:05:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:49.975 04:05:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:49.975 04:05:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:49.975 04:05:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:49.975 04:05:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:49.975 04:05:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:49.975 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:49.975 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.619 ms 00:07:49.975 00:07:49.975 --- 10.0.0.2 ping statistics --- 00:07:49.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:49.975 rtt min/avg/max/mdev = 0.619/0.619/0.619/0.000 ms 00:07:49.975 04:05:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:49.975 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:49.975 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.408 ms 00:07:49.975 00:07:49.975 --- 10.0.0.1 ping statistics --- 00:07:49.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:49.976 rtt min/avg/max/mdev = 0.408/0.408/0.408/0.000 ms 00:07:49.976 04:05:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:49.976 04:05:03 -- nvmf/common.sh@410 -- # return 0 00:07:49.976 04:05:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:49.976 04:05:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:49.976 04:05:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:49.976 04:05:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:49.976 04:05:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:49.976 04:05:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:49.976 04:05:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:49.976 04:05:03 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:49.976 04:05:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:49.976 04:05:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:49.976 04:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 ************************************ 00:07:49.976 START TEST nvmf_filesystem_no_in_capsule 00:07:49.976 ************************************ 00:07:49.976 04:05:03 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:07:49.976 04:05:03 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:49.976 04:05:03 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:49.976 04:05:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:49.976 04:05:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:49.976 04:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 04:05:03 -- nvmf/common.sh@469 -- # nvmfpid=3763395 00:07:49.976 04:05:03 -- nvmf/common.sh@470 -- # waitforlisten 3763395 00:07:49.976 04:05:03 -- common/autotest_common.sh@819 -- # '[' -z 3763395 ']' 00:07:49.976 04:05:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:49.976 04:05:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:49.976 04:05:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:49.976 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:49.976 04:05:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:49.976 04:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 04:05:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:49.976 [2024-05-14 04:05:03.474358] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:49.976 [2024-05-14 04:05:03.474423] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:49.976 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.976 [2024-05-14 04:05:03.544358] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:49.976 [2024-05-14 04:05:03.619222] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:49.976 [2024-05-14 04:05:03.619350] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:49.976 [2024-05-14 04:05:03.619359] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:49.976 [2024-05-14 04:05:03.619366] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:49.976 [2024-05-14 04:05:03.619504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:49.976 [2024-05-14 04:05:03.619707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:49.976 [2024-05-14 04:05:03.619864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.976 [2024-05-14 04:05:03.619864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:49.976 04:05:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:49.976 04:05:04 -- common/autotest_common.sh@852 -- # return 0 00:07:49.976 04:05:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:49.976 04:05:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:49.976 04:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 04:05:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:49.976 04:05:04 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:49.976 04:05:04 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:49.976 04:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.976 04:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 [2024-05-14 04:05:04.296467] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:49.976 04:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.976 04:05:04 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:49.976 04:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.976 04:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 Malloc1 00:07:49.976 04:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.976 04:05:04 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:49.976 04:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.976 04:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 04:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.976 04:05:04 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:49.976 04:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.976 04:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 04:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.976 04:05:04 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:49.976 04:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.976 04:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 [2024-05-14 04:05:04.427584] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:49.976 04:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.976 04:05:04 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:49.976 04:05:04 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:07:49.976 04:05:04 -- common/autotest_common.sh@1358 -- # local bdev_info 00:07:49.976 04:05:04 -- common/autotest_common.sh@1359 -- # local bs 00:07:49.976 04:05:04 -- common/autotest_common.sh@1360 -- # local nb 00:07:49.976 04:05:04 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:49.976 04:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.976 04:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.976 04:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.976 04:05:04 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:07:49.976 { 00:07:49.976 "name": "Malloc1", 00:07:49.976 "aliases": [ 00:07:49.976 "cd19c0ee-621a-4da8-81b0-a66e2d07f56a" 00:07:49.976 ], 00:07:49.976 "product_name": "Malloc disk", 00:07:49.976 "block_size": 512, 00:07:49.976 "num_blocks": 1048576, 00:07:49.976 "uuid": "cd19c0ee-621a-4da8-81b0-a66e2d07f56a", 00:07:49.976 "assigned_rate_limits": { 00:07:49.976 "rw_ios_per_sec": 0, 00:07:49.976 "rw_mbytes_per_sec": 0, 00:07:49.976 "r_mbytes_per_sec": 0, 00:07:49.976 "w_mbytes_per_sec": 0 00:07:49.976 }, 00:07:49.976 "claimed": true, 00:07:49.976 "claim_type": "exclusive_write", 00:07:49.976 "zoned": false, 00:07:49.976 "supported_io_types": { 00:07:49.976 "read": true, 00:07:49.976 "write": true, 00:07:49.976 "unmap": true, 00:07:49.976 "write_zeroes": true, 00:07:49.976 "flush": true, 00:07:49.976 "reset": true, 00:07:49.976 "compare": false, 00:07:49.976 "compare_and_write": false, 00:07:49.976 "abort": true, 00:07:49.976 "nvme_admin": false, 00:07:49.976 "nvme_io": false 00:07:49.976 }, 00:07:49.976 "memory_domains": [ 00:07:49.976 { 00:07:49.976 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:49.976 "dma_device_type": 2 00:07:49.976 } 00:07:49.976 ], 00:07:49.976 "driver_specific": {} 00:07:49.976 } 00:07:49.976 ]' 00:07:49.976 04:05:04 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:07:49.976 04:05:04 -- common/autotest_common.sh@1362 -- # bs=512 00:07:49.976 04:05:04 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:07:49.976 04:05:04 -- common/autotest_common.sh@1363 -- # nb=1048576 00:07:49.976 04:05:04 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:07:49.976 04:05:04 -- common/autotest_common.sh@1367 -- # echo 512 00:07:49.976 04:05:04 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:49.976 04:05:04 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:51.890 04:05:06 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:51.890 04:05:06 -- common/autotest_common.sh@1177 -- # local i=0 00:07:51.890 04:05:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:07:51.890 04:05:06 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:07:51.890 04:05:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:07:53.805 04:05:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:07:53.805 04:05:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:07:53.805 04:05:08 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:07:53.805 04:05:08 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:07:53.805 04:05:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:07:53.805 04:05:08 -- common/autotest_common.sh@1187 -- # return 0 00:07:53.805 04:05:08 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:53.805 04:05:08 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:53.805 04:05:08 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:53.805 04:05:08 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:53.805 04:05:08 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:53.805 04:05:08 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:53.805 04:05:08 -- setup/common.sh@80 -- # echo 536870912 00:07:53.805 04:05:08 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:53.805 04:05:08 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:53.805 04:05:08 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:53.805 04:05:08 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:54.065 04:05:08 -- target/filesystem.sh@69 -- # partprobe 00:07:55.008 04:05:09 -- target/filesystem.sh@70 -- # sleep 1 00:07:55.951 04:05:10 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:55.951 04:05:10 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:55.951 04:05:10 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:55.951 04:05:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:55.951 04:05:10 -- common/autotest_common.sh@10 -- # set +x 00:07:55.951 ************************************ 00:07:55.951 START TEST filesystem_ext4 00:07:55.951 ************************************ 00:07:55.951 04:05:10 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:55.951 04:05:10 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:55.951 04:05:10 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:55.951 04:05:10 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:55.951 04:05:10 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:07:55.951 04:05:10 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:55.951 04:05:10 -- common/autotest_common.sh@904 -- # local i=0 00:07:55.951 04:05:10 -- common/autotest_common.sh@905 -- # local force 00:07:55.951 04:05:10 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:07:55.951 04:05:10 -- common/autotest_common.sh@908 -- # force=-F 00:07:55.951 04:05:10 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:55.951 mke2fs 1.46.5 (30-Dec-2021) 00:07:55.952 Discarding device blocks: 0/522240 done 00:07:55.952 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:55.952 Filesystem UUID: 3177ec7d-92ab-446b-945e-ac43763d2efa 00:07:55.952 Superblock backups stored on blocks: 00:07:55.952 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:55.952 00:07:55.952 Allocating group tables: 0/64 done 00:07:55.952 Writing inode tables: 0/64 done 00:07:59.248 Creating journal (8192 blocks): done 00:07:59.248 Writing superblocks and filesystem accounting information: 0/64 done 00:07:59.248 00:07:59.248 04:05:13 -- common/autotest_common.sh@921 -- # return 0 00:07:59.248 04:05:13 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:59.509 04:05:13 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:59.509 04:05:14 -- target/filesystem.sh@25 -- # sync 00:07:59.509 04:05:14 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:59.509 04:05:14 -- target/filesystem.sh@27 -- # sync 00:07:59.509 04:05:14 -- target/filesystem.sh@29 -- # i=0 00:07:59.509 04:05:14 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:59.509 04:05:14 -- target/filesystem.sh@37 -- # kill -0 3763395 00:07:59.509 04:05:14 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:59.509 04:05:14 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:59.509 04:05:14 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:59.509 04:05:14 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:59.509 00:07:59.509 real 0m3.729s 00:07:59.509 user 0m0.030s 00:07:59.509 sys 0m0.071s 00:07:59.509 04:05:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:59.509 04:05:14 -- common/autotest_common.sh@10 -- # set +x 00:07:59.509 ************************************ 00:07:59.509 END TEST filesystem_ext4 00:07:59.509 ************************************ 00:07:59.768 04:05:14 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:59.768 04:05:14 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:59.768 04:05:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:59.768 04:05:14 -- common/autotest_common.sh@10 -- # set +x 00:07:59.768 ************************************ 00:07:59.768 START TEST filesystem_btrfs 00:07:59.768 ************************************ 00:07:59.768 04:05:14 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:59.768 04:05:14 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:59.768 04:05:14 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:59.768 04:05:14 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:59.768 04:05:14 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:07:59.768 04:05:14 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:59.768 04:05:14 -- common/autotest_common.sh@904 -- # local i=0 00:07:59.768 04:05:14 -- common/autotest_common.sh@905 -- # local force 00:07:59.768 04:05:14 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:07:59.768 04:05:14 -- common/autotest_common.sh@910 -- # force=-f 00:07:59.768 04:05:14 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:00.029 btrfs-progs v6.6.2 00:08:00.029 See https://btrfs.readthedocs.io for more information. 00:08:00.029 00:08:00.029 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:00.029 NOTE: several default settings have changed in version 5.15, please make sure 00:08:00.029 this does not affect your deployments: 00:08:00.029 - DUP for metadata (-m dup) 00:08:00.029 - enabled no-holes (-O no-holes) 00:08:00.029 - enabled free-space-tree (-R free-space-tree) 00:08:00.029 00:08:00.029 Label: (null) 00:08:00.029 UUID: 40a8469c-5e67-485c-84d0-0f7605e7bc6b 00:08:00.029 Node size: 16384 00:08:00.029 Sector size: 4096 00:08:00.029 Filesystem size: 510.00MiB 00:08:00.029 Block group profiles: 00:08:00.029 Data: single 8.00MiB 00:08:00.029 Metadata: DUP 32.00MiB 00:08:00.029 System: DUP 8.00MiB 00:08:00.029 SSD detected: yes 00:08:00.029 Zoned device: no 00:08:00.029 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:00.029 Runtime features: free-space-tree 00:08:00.029 Checksum: crc32c 00:08:00.029 Number of devices: 1 00:08:00.029 Devices: 00:08:00.029 ID SIZE PATH 00:08:00.029 1 510.00MiB /dev/nvme0n1p1 00:08:00.029 00:08:00.029 04:05:14 -- common/autotest_common.sh@921 -- # return 0 00:08:00.029 04:05:14 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:00.599 04:05:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:00.599 04:05:15 -- target/filesystem.sh@25 -- # sync 00:08:00.859 04:05:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:00.859 04:05:15 -- target/filesystem.sh@27 -- # sync 00:08:00.859 04:05:15 -- target/filesystem.sh@29 -- # i=0 00:08:00.859 04:05:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:00.859 04:05:15 -- target/filesystem.sh@37 -- # kill -0 3763395 00:08:00.859 04:05:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:00.859 04:05:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:00.859 04:05:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:00.859 04:05:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:00.859 00:08:00.859 real 0m1.130s 00:08:00.859 user 0m0.038s 00:08:00.859 sys 0m0.118s 00:08:00.859 04:05:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:00.859 04:05:15 -- common/autotest_common.sh@10 -- # set +x 00:08:00.859 ************************************ 00:08:00.859 END TEST filesystem_btrfs 00:08:00.859 ************************************ 00:08:00.859 04:05:15 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:00.859 04:05:15 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:00.859 04:05:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:00.859 04:05:15 -- common/autotest_common.sh@10 -- # set +x 00:08:00.859 ************************************ 00:08:00.859 START TEST filesystem_xfs 00:08:00.859 ************************************ 00:08:00.859 04:05:15 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:08:00.859 04:05:15 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:00.859 04:05:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:00.859 04:05:15 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:00.859 04:05:15 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:08:00.859 04:05:15 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:00.859 04:05:15 -- common/autotest_common.sh@904 -- # local i=0 00:08:00.859 04:05:15 -- common/autotest_common.sh@905 -- # local force 00:08:00.859 04:05:15 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:08:00.860 04:05:15 -- common/autotest_common.sh@910 -- # force=-f 00:08:00.860 04:05:15 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:00.860 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:00.860 = sectsz=512 attr=2, projid32bit=1 00:08:00.860 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:00.860 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:00.860 data = bsize=4096 blocks=130560, imaxpct=25 00:08:00.860 = sunit=0 swidth=0 blks 00:08:00.860 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:00.860 log =internal log bsize=4096 blocks=16384, version=2 00:08:00.860 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:00.860 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:01.802 Discarding blocks...Done. 00:08:01.802 04:05:16 -- common/autotest_common.sh@921 -- # return 0 00:08:01.802 04:05:16 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:03.794 04:05:18 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:03.794 04:05:18 -- target/filesystem.sh@25 -- # sync 00:08:03.794 04:05:18 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:03.794 04:05:18 -- target/filesystem.sh@27 -- # sync 00:08:03.794 04:05:18 -- target/filesystem.sh@29 -- # i=0 00:08:03.794 04:05:18 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:03.794 04:05:18 -- target/filesystem.sh@37 -- # kill -0 3763395 00:08:03.794 04:05:18 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:03.794 04:05:18 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:03.794 04:05:18 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:03.794 04:05:18 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:03.794 00:08:03.794 real 0m3.037s 00:08:03.794 user 0m0.027s 00:08:03.794 sys 0m0.075s 00:08:03.794 04:05:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:03.794 04:05:18 -- common/autotest_common.sh@10 -- # set +x 00:08:03.794 ************************************ 00:08:03.794 END TEST filesystem_xfs 00:08:03.794 ************************************ 00:08:03.794 04:05:18 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:04.365 04:05:18 -- target/filesystem.sh@93 -- # sync 00:08:04.365 04:05:18 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:04.365 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.365 04:05:18 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:04.365 04:05:18 -- common/autotest_common.sh@1198 -- # local i=0 00:08:04.365 04:05:18 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:08:04.365 04:05:18 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:04.365 04:05:18 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:08:04.365 04:05:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:04.365 04:05:18 -- common/autotest_common.sh@1210 -- # return 0 00:08:04.365 04:05:18 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:04.365 04:05:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:04.365 04:05:18 -- common/autotest_common.sh@10 -- # set +x 00:08:04.365 04:05:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:04.365 04:05:18 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:04.365 04:05:18 -- target/filesystem.sh@101 -- # killprocess 3763395 00:08:04.365 04:05:18 -- common/autotest_common.sh@926 -- # '[' -z 3763395 ']' 00:08:04.365 04:05:18 -- common/autotest_common.sh@930 -- # kill -0 3763395 00:08:04.365 04:05:18 -- common/autotest_common.sh@931 -- # uname 00:08:04.365 04:05:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:04.365 04:05:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3763395 00:08:04.365 04:05:18 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:04.365 04:05:18 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:04.365 04:05:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3763395' 00:08:04.365 killing process with pid 3763395 00:08:04.365 04:05:18 -- common/autotest_common.sh@945 -- # kill 3763395 00:08:04.365 04:05:18 -- common/autotest_common.sh@950 -- # wait 3763395 00:08:04.625 04:05:19 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:04.625 00:08:04.625 real 0m15.735s 00:08:04.625 user 1m2.081s 00:08:04.625 sys 0m1.199s 00:08:04.625 04:05:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:04.625 04:05:19 -- common/autotest_common.sh@10 -- # set +x 00:08:04.625 ************************************ 00:08:04.625 END TEST nvmf_filesystem_no_in_capsule 00:08:04.625 ************************************ 00:08:04.625 04:05:19 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:04.625 04:05:19 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:04.625 04:05:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:04.625 04:05:19 -- common/autotest_common.sh@10 -- # set +x 00:08:04.625 ************************************ 00:08:04.625 START TEST nvmf_filesystem_in_capsule 00:08:04.625 ************************************ 00:08:04.625 04:05:19 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:08:04.625 04:05:19 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:04.625 04:05:19 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:04.625 04:05:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:04.625 04:05:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:04.625 04:05:19 -- common/autotest_common.sh@10 -- # set +x 00:08:04.625 04:05:19 -- nvmf/common.sh@469 -- # nvmfpid=3766696 00:08:04.625 04:05:19 -- nvmf/common.sh@470 -- # waitforlisten 3766696 00:08:04.625 04:05:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:04.625 04:05:19 -- common/autotest_common.sh@819 -- # '[' -z 3766696 ']' 00:08:04.625 04:05:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:04.625 04:05:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:04.625 04:05:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:04.625 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:04.625 04:05:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:04.625 04:05:19 -- common/autotest_common.sh@10 -- # set +x 00:08:04.885 [2024-05-14 04:05:19.255995] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:08:04.885 [2024-05-14 04:05:19.256050] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:04.885 EAL: No free 2048 kB hugepages reported on node 1 00:08:04.885 [2024-05-14 04:05:19.323939] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:04.885 [2024-05-14 04:05:19.389577] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:04.885 [2024-05-14 04:05:19.389719] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:04.885 [2024-05-14 04:05:19.389728] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:04.885 [2024-05-14 04:05:19.389737] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:04.885 [2024-05-14 04:05:19.389875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:04.885 [2024-05-14 04:05:19.389992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:04.885 [2024-05-14 04:05:19.390148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:04.885 [2024-05-14 04:05:19.390150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:05.457 04:05:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:05.457 04:05:20 -- common/autotest_common.sh@852 -- # return 0 00:08:05.457 04:05:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:05.457 04:05:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:05.457 04:05:20 -- common/autotest_common.sh@10 -- # set +x 00:08:05.717 04:05:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:05.717 04:05:20 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:05.717 04:05:20 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:05.717 04:05:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:05.717 04:05:20 -- common/autotest_common.sh@10 -- # set +x 00:08:05.717 [2024-05-14 04:05:20.071574] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:05.717 04:05:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:05.717 04:05:20 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:05.717 04:05:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:05.717 04:05:20 -- common/autotest_common.sh@10 -- # set +x 00:08:05.717 Malloc1 00:08:05.717 04:05:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:05.717 04:05:20 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:05.717 04:05:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:05.717 04:05:20 -- common/autotest_common.sh@10 -- # set +x 00:08:05.717 04:05:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:05.717 04:05:20 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:05.717 04:05:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:05.717 04:05:20 -- common/autotest_common.sh@10 -- # set +x 00:08:05.717 04:05:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:05.717 04:05:20 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:05.717 04:05:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:05.717 04:05:20 -- common/autotest_common.sh@10 -- # set +x 00:08:05.717 [2024-05-14 04:05:20.209591] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:05.717 04:05:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:05.717 04:05:20 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:05.717 04:05:20 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:08:05.717 04:05:20 -- common/autotest_common.sh@1358 -- # local bdev_info 00:08:05.717 04:05:20 -- common/autotest_common.sh@1359 -- # local bs 00:08:05.717 04:05:20 -- common/autotest_common.sh@1360 -- # local nb 00:08:05.717 04:05:20 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:05.717 04:05:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:05.717 04:05:20 -- common/autotest_common.sh@10 -- # set +x 00:08:05.717 04:05:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:05.717 04:05:20 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:08:05.717 { 00:08:05.717 "name": "Malloc1", 00:08:05.717 "aliases": [ 00:08:05.717 "78fad801-32f8-47a2-a966-874c2232c4ed" 00:08:05.717 ], 00:08:05.717 "product_name": "Malloc disk", 00:08:05.717 "block_size": 512, 00:08:05.717 "num_blocks": 1048576, 00:08:05.717 "uuid": "78fad801-32f8-47a2-a966-874c2232c4ed", 00:08:05.717 "assigned_rate_limits": { 00:08:05.717 "rw_ios_per_sec": 0, 00:08:05.717 "rw_mbytes_per_sec": 0, 00:08:05.717 "r_mbytes_per_sec": 0, 00:08:05.717 "w_mbytes_per_sec": 0 00:08:05.717 }, 00:08:05.717 "claimed": true, 00:08:05.717 "claim_type": "exclusive_write", 00:08:05.717 "zoned": false, 00:08:05.717 "supported_io_types": { 00:08:05.717 "read": true, 00:08:05.717 "write": true, 00:08:05.717 "unmap": true, 00:08:05.717 "write_zeroes": true, 00:08:05.717 "flush": true, 00:08:05.717 "reset": true, 00:08:05.717 "compare": false, 00:08:05.717 "compare_and_write": false, 00:08:05.717 "abort": true, 00:08:05.717 "nvme_admin": false, 00:08:05.717 "nvme_io": false 00:08:05.717 }, 00:08:05.717 "memory_domains": [ 00:08:05.717 { 00:08:05.717 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:05.717 "dma_device_type": 2 00:08:05.717 } 00:08:05.717 ], 00:08:05.717 "driver_specific": {} 00:08:05.717 } 00:08:05.717 ]' 00:08:05.717 04:05:20 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:08:05.717 04:05:20 -- common/autotest_common.sh@1362 -- # bs=512 00:08:05.717 04:05:20 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:08:05.978 04:05:20 -- common/autotest_common.sh@1363 -- # nb=1048576 00:08:05.978 04:05:20 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:08:05.978 04:05:20 -- common/autotest_common.sh@1367 -- # echo 512 00:08:05.978 04:05:20 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:05.978 04:05:20 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:07.365 04:05:21 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:07.365 04:05:21 -- common/autotest_common.sh@1177 -- # local i=0 00:08:07.365 04:05:21 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:08:07.365 04:05:21 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:08:07.365 04:05:21 -- common/autotest_common.sh@1184 -- # sleep 2 00:08:09.912 04:05:23 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:08:09.912 04:05:23 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:08:09.912 04:05:23 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:08:09.912 04:05:23 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:08:09.912 04:05:23 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:08:09.912 04:05:23 -- common/autotest_common.sh@1187 -- # return 0 00:08:09.912 04:05:23 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:09.912 04:05:23 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:09.912 04:05:23 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:09.912 04:05:23 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:09.912 04:05:23 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:09.912 04:05:23 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:09.912 04:05:23 -- setup/common.sh@80 -- # echo 536870912 00:08:09.912 04:05:23 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:09.912 04:05:23 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:09.912 04:05:23 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:09.912 04:05:23 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:09.912 04:05:24 -- target/filesystem.sh@69 -- # partprobe 00:08:09.912 04:05:24 -- target/filesystem.sh@70 -- # sleep 1 00:08:11.298 04:05:25 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:11.298 04:05:25 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:11.298 04:05:25 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:11.299 04:05:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:11.299 04:05:25 -- common/autotest_common.sh@10 -- # set +x 00:08:11.299 ************************************ 00:08:11.299 START TEST filesystem_in_capsule_ext4 00:08:11.299 ************************************ 00:08:11.299 04:05:25 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:11.299 04:05:25 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:11.299 04:05:25 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:11.299 04:05:25 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:11.299 04:05:25 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:08:11.299 04:05:25 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:11.299 04:05:25 -- common/autotest_common.sh@904 -- # local i=0 00:08:11.299 04:05:25 -- common/autotest_common.sh@905 -- # local force 00:08:11.299 04:05:25 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:08:11.299 04:05:25 -- common/autotest_common.sh@908 -- # force=-F 00:08:11.299 04:05:25 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:11.299 mke2fs 1.46.5 (30-Dec-2021) 00:08:11.299 Discarding device blocks: 0/522240 done 00:08:11.299 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:11.299 Filesystem UUID: 9a47f50b-88d0-4e3d-95bf-fa26ed868826 00:08:11.299 Superblock backups stored on blocks: 00:08:11.299 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:11.299 00:08:11.299 Allocating group tables: 0/64 done 00:08:11.299 Writing inode tables: 0/64 done 00:08:11.560 Creating journal (8192 blocks): done 00:08:12.392 Writing superblocks and filesystem accounting information: 0/64 done 00:08:12.392 00:08:12.652 04:05:26 -- common/autotest_common.sh@921 -- # return 0 00:08:12.652 04:05:26 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:12.652 04:05:27 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:12.913 04:05:27 -- target/filesystem.sh@25 -- # sync 00:08:12.913 04:05:27 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:12.913 04:05:27 -- target/filesystem.sh@27 -- # sync 00:08:12.913 04:05:27 -- target/filesystem.sh@29 -- # i=0 00:08:12.913 04:05:27 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:12.913 04:05:27 -- target/filesystem.sh@37 -- # kill -0 3766696 00:08:12.913 04:05:27 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:12.913 04:05:27 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:12.913 04:05:27 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:12.913 04:05:27 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:12.913 00:08:12.913 real 0m1.836s 00:08:12.913 user 0m0.019s 00:08:12.913 sys 0m0.077s 00:08:12.913 04:05:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:12.913 04:05:27 -- common/autotest_common.sh@10 -- # set +x 00:08:12.913 ************************************ 00:08:12.913 END TEST filesystem_in_capsule_ext4 00:08:12.913 ************************************ 00:08:12.913 04:05:27 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:12.913 04:05:27 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:12.913 04:05:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:12.913 04:05:27 -- common/autotest_common.sh@10 -- # set +x 00:08:12.913 ************************************ 00:08:12.913 START TEST filesystem_in_capsule_btrfs 00:08:12.913 ************************************ 00:08:12.913 04:05:27 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:12.913 04:05:27 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:12.913 04:05:27 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:12.913 04:05:27 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:12.913 04:05:27 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:08:12.913 04:05:27 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:12.913 04:05:27 -- common/autotest_common.sh@904 -- # local i=0 00:08:12.913 04:05:27 -- common/autotest_common.sh@905 -- # local force 00:08:12.913 04:05:27 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:08:12.913 04:05:27 -- common/autotest_common.sh@910 -- # force=-f 00:08:12.913 04:05:27 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:13.174 btrfs-progs v6.6.2 00:08:13.174 See https://btrfs.readthedocs.io for more information. 00:08:13.174 00:08:13.174 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:13.174 NOTE: several default settings have changed in version 5.15, please make sure 00:08:13.174 this does not affect your deployments: 00:08:13.174 - DUP for metadata (-m dup) 00:08:13.174 - enabled no-holes (-O no-holes) 00:08:13.174 - enabled free-space-tree (-R free-space-tree) 00:08:13.174 00:08:13.174 Label: (null) 00:08:13.174 UUID: d7fed163-a148-42b7-8eed-73a71effd97e 00:08:13.174 Node size: 16384 00:08:13.174 Sector size: 4096 00:08:13.174 Filesystem size: 510.00MiB 00:08:13.174 Block group profiles: 00:08:13.174 Data: single 8.00MiB 00:08:13.174 Metadata: DUP 32.00MiB 00:08:13.174 System: DUP 8.00MiB 00:08:13.174 SSD detected: yes 00:08:13.174 Zoned device: no 00:08:13.174 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:13.174 Runtime features: free-space-tree 00:08:13.174 Checksum: crc32c 00:08:13.174 Number of devices: 1 00:08:13.174 Devices: 00:08:13.174 ID SIZE PATH 00:08:13.174 1 510.00MiB /dev/nvme0n1p1 00:08:13.174 00:08:13.174 04:05:27 -- common/autotest_common.sh@921 -- # return 0 00:08:13.174 04:05:27 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:14.116 04:05:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:14.116 04:05:28 -- target/filesystem.sh@25 -- # sync 00:08:14.116 04:05:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:14.116 04:05:28 -- target/filesystem.sh@27 -- # sync 00:08:14.116 04:05:28 -- target/filesystem.sh@29 -- # i=0 00:08:14.116 04:05:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:14.116 04:05:28 -- target/filesystem.sh@37 -- # kill -0 3766696 00:08:14.116 04:05:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:14.116 04:05:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:14.116 04:05:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:14.116 04:05:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:14.116 00:08:14.116 real 0m1.109s 00:08:14.116 user 0m0.022s 00:08:14.116 sys 0m0.137s 00:08:14.116 04:05:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:14.116 04:05:28 -- common/autotest_common.sh@10 -- # set +x 00:08:14.116 ************************************ 00:08:14.116 END TEST filesystem_in_capsule_btrfs 00:08:14.116 ************************************ 00:08:14.116 04:05:28 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:14.116 04:05:28 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:14.116 04:05:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:14.116 04:05:28 -- common/autotest_common.sh@10 -- # set +x 00:08:14.116 ************************************ 00:08:14.116 START TEST filesystem_in_capsule_xfs 00:08:14.116 ************************************ 00:08:14.116 04:05:28 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:08:14.116 04:05:28 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:14.116 04:05:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:14.116 04:05:28 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:14.116 04:05:28 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:08:14.116 04:05:28 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:14.116 04:05:28 -- common/autotest_common.sh@904 -- # local i=0 00:08:14.116 04:05:28 -- common/autotest_common.sh@905 -- # local force 00:08:14.116 04:05:28 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:08:14.116 04:05:28 -- common/autotest_common.sh@910 -- # force=-f 00:08:14.116 04:05:28 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:14.116 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:14.116 = sectsz=512 attr=2, projid32bit=1 00:08:14.116 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:14.116 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:14.116 data = bsize=4096 blocks=130560, imaxpct=25 00:08:14.116 = sunit=0 swidth=0 blks 00:08:14.116 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:14.116 log =internal log bsize=4096 blocks=16384, version=2 00:08:14.116 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:14.116 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:15.057 Discarding blocks...Done. 00:08:15.057 04:05:29 -- common/autotest_common.sh@921 -- # return 0 00:08:15.057 04:05:29 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:16.970 04:05:31 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:16.970 04:05:31 -- target/filesystem.sh@25 -- # sync 00:08:16.970 04:05:31 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:16.970 04:05:31 -- target/filesystem.sh@27 -- # sync 00:08:16.970 04:05:31 -- target/filesystem.sh@29 -- # i=0 00:08:16.970 04:05:31 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:16.970 04:05:31 -- target/filesystem.sh@37 -- # kill -0 3766696 00:08:16.970 04:05:31 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:16.970 04:05:31 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:16.970 04:05:31 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:16.970 04:05:31 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:16.970 00:08:16.970 real 0m2.855s 00:08:16.970 user 0m0.020s 00:08:16.970 sys 0m0.085s 00:08:16.970 04:05:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:16.970 04:05:31 -- common/autotest_common.sh@10 -- # set +x 00:08:16.970 ************************************ 00:08:16.970 END TEST filesystem_in_capsule_xfs 00:08:16.970 ************************************ 00:08:16.970 04:05:31 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:16.970 04:05:31 -- target/filesystem.sh@93 -- # sync 00:08:17.540 04:05:31 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:17.540 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.540 04:05:31 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:17.540 04:05:31 -- common/autotest_common.sh@1198 -- # local i=0 00:08:17.540 04:05:31 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:08:17.540 04:05:31 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:17.540 04:05:31 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:08:17.540 04:05:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:17.540 04:05:31 -- common/autotest_common.sh@1210 -- # return 0 00:08:17.540 04:05:31 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:17.540 04:05:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:17.540 04:05:31 -- common/autotest_common.sh@10 -- # set +x 00:08:17.540 04:05:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:17.540 04:05:31 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:17.540 04:05:31 -- target/filesystem.sh@101 -- # killprocess 3766696 00:08:17.540 04:05:31 -- common/autotest_common.sh@926 -- # '[' -z 3766696 ']' 00:08:17.540 04:05:31 -- common/autotest_common.sh@930 -- # kill -0 3766696 00:08:17.540 04:05:31 -- common/autotest_common.sh@931 -- # uname 00:08:17.540 04:05:31 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:17.540 04:05:31 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3766696 00:08:17.540 04:05:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:17.540 04:05:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:17.540 04:05:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3766696' 00:08:17.540 killing process with pid 3766696 00:08:17.540 04:05:32 -- common/autotest_common.sh@945 -- # kill 3766696 00:08:17.540 04:05:32 -- common/autotest_common.sh@950 -- # wait 3766696 00:08:17.800 04:05:32 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:17.800 00:08:17.800 real 0m13.068s 00:08:17.800 user 0m51.422s 00:08:17.800 sys 0m1.207s 00:08:17.800 04:05:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:17.800 04:05:32 -- common/autotest_common.sh@10 -- # set +x 00:08:17.800 ************************************ 00:08:17.800 END TEST nvmf_filesystem_in_capsule 00:08:17.800 ************************************ 00:08:17.800 04:05:32 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:17.800 04:05:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:17.800 04:05:32 -- nvmf/common.sh@116 -- # sync 00:08:17.800 04:05:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:17.800 04:05:32 -- nvmf/common.sh@119 -- # set +e 00:08:17.800 04:05:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:17.800 04:05:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:17.800 rmmod nvme_tcp 00:08:17.800 rmmod nvme_fabrics 00:08:17.800 rmmod nvme_keyring 00:08:17.800 04:05:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:17.800 04:05:32 -- nvmf/common.sh@123 -- # set -e 00:08:17.800 04:05:32 -- nvmf/common.sh@124 -- # return 0 00:08:17.800 04:05:32 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:17.800 04:05:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:17.800 04:05:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:17.800 04:05:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:17.800 04:05:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:17.800 04:05:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:17.800 04:05:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:17.800 04:05:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:17.800 04:05:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:20.343 04:05:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:20.343 00:08:20.343 real 0m38.530s 00:08:20.343 user 1m55.611s 00:08:20.343 sys 0m7.963s 00:08:20.343 04:05:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:20.343 04:05:34 -- common/autotest_common.sh@10 -- # set +x 00:08:20.343 ************************************ 00:08:20.343 END TEST nvmf_filesystem 00:08:20.343 ************************************ 00:08:20.343 04:05:34 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:20.343 04:05:34 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:20.343 04:05:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:20.343 04:05:34 -- common/autotest_common.sh@10 -- # set +x 00:08:20.343 ************************************ 00:08:20.343 START TEST nvmf_discovery 00:08:20.343 ************************************ 00:08:20.343 04:05:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:20.343 * Looking for test storage... 00:08:20.343 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:20.343 04:05:34 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:20.343 04:05:34 -- nvmf/common.sh@7 -- # uname -s 00:08:20.343 04:05:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:20.343 04:05:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:20.343 04:05:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:20.343 04:05:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:20.343 04:05:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:20.343 04:05:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:20.343 04:05:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:20.343 04:05:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:20.343 04:05:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:20.343 04:05:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:20.343 04:05:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:20.344 04:05:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:20.344 04:05:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:20.344 04:05:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:20.344 04:05:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:20.344 04:05:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:20.344 04:05:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:20.344 04:05:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:20.344 04:05:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:20.344 04:05:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:20.344 04:05:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:20.344 04:05:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:20.344 04:05:34 -- paths/export.sh@5 -- # export PATH 00:08:20.344 04:05:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:20.344 04:05:34 -- nvmf/common.sh@46 -- # : 0 00:08:20.344 04:05:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:20.344 04:05:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:20.344 04:05:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:20.344 04:05:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:20.344 04:05:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:20.344 04:05:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:20.344 04:05:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:20.344 04:05:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:20.344 04:05:34 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:20.344 04:05:34 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:20.344 04:05:34 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:20.344 04:05:34 -- target/discovery.sh@15 -- # hash nvme 00:08:20.344 04:05:34 -- target/discovery.sh@20 -- # nvmftestinit 00:08:20.344 04:05:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:20.344 04:05:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:20.344 04:05:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:20.344 04:05:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:20.344 04:05:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:20.344 04:05:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:20.344 04:05:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:20.344 04:05:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:20.344 04:05:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:20.344 04:05:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:20.344 04:05:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:20.344 04:05:34 -- common/autotest_common.sh@10 -- # set +x 00:08:26.992 04:05:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:26.992 04:05:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:26.992 04:05:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:26.992 04:05:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:26.992 04:05:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:26.992 04:05:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:26.992 04:05:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:26.992 04:05:41 -- nvmf/common.sh@294 -- # net_devs=() 00:08:26.992 04:05:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:26.992 04:05:41 -- nvmf/common.sh@295 -- # e810=() 00:08:26.992 04:05:41 -- nvmf/common.sh@295 -- # local -ga e810 00:08:26.992 04:05:41 -- nvmf/common.sh@296 -- # x722=() 00:08:26.992 04:05:41 -- nvmf/common.sh@296 -- # local -ga x722 00:08:26.992 04:05:41 -- nvmf/common.sh@297 -- # mlx=() 00:08:26.992 04:05:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:26.992 04:05:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:26.992 04:05:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:26.992 04:05:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:26.992 04:05:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:26.992 04:05:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:26.992 04:05:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:08:26.992 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:08:26.992 04:05:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:26.992 04:05:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:08:26.992 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:08:26.992 04:05:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:26.992 04:05:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:26.992 04:05:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:26.992 04:05:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:26.992 04:05:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:26.992 04:05:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:08:26.992 Found net devices under 0000:4b:00.0: cvl_0_0 00:08:26.992 04:05:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:26.992 04:05:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:26.992 04:05:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:26.992 04:05:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:26.992 04:05:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:26.992 04:05:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:08:26.992 Found net devices under 0000:4b:00.1: cvl_0_1 00:08:26.992 04:05:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:26.992 04:05:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:26.992 04:05:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:26.992 04:05:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:26.992 04:05:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:26.992 04:05:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:26.992 04:05:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:26.992 04:05:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:26.992 04:05:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:26.992 04:05:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:26.992 04:05:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:26.992 04:05:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:26.992 04:05:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:26.992 04:05:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:26.992 04:05:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:26.992 04:05:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:26.992 04:05:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:26.992 04:05:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:26.992 04:05:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:26.992 04:05:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:26.992 04:05:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:26.992 04:05:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:26.992 04:05:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:26.993 04:05:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:26.993 04:05:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:26.993 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:26.993 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.704 ms 00:08:26.993 00:08:26.993 --- 10.0.0.2 ping statistics --- 00:08:26.993 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:26.993 rtt min/avg/max/mdev = 0.704/0.704/0.704/0.000 ms 00:08:26.993 04:05:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:26.993 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:26.993 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.444 ms 00:08:26.993 00:08:26.993 --- 10.0.0.1 ping statistics --- 00:08:26.993 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:26.993 rtt min/avg/max/mdev = 0.444/0.444/0.444/0.000 ms 00:08:26.993 04:05:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:26.993 04:05:41 -- nvmf/common.sh@410 -- # return 0 00:08:26.993 04:05:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:26.993 04:05:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:26.993 04:05:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:26.993 04:05:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:26.993 04:05:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:26.993 04:05:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:26.993 04:05:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:26.993 04:05:41 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:26.993 04:05:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:26.993 04:05:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:26.993 04:05:41 -- common/autotest_common.sh@10 -- # set +x 00:08:26.993 04:05:41 -- nvmf/common.sh@469 -- # nvmfpid=3773633 00:08:26.993 04:05:41 -- nvmf/common.sh@470 -- # waitforlisten 3773633 00:08:26.993 04:05:41 -- common/autotest_common.sh@819 -- # '[' -z 3773633 ']' 00:08:26.993 04:05:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:26.993 04:05:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:26.993 04:05:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:26.993 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:26.993 04:05:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:26.993 04:05:41 -- common/autotest_common.sh@10 -- # set +x 00:08:26.993 04:05:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:27.254 [2024-05-14 04:05:41.608615] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:08:27.254 [2024-05-14 04:05:41.608679] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:27.254 EAL: No free 2048 kB hugepages reported on node 1 00:08:27.254 [2024-05-14 04:05:41.679044] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:27.254 [2024-05-14 04:05:41.752100] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:27.254 [2024-05-14 04:05:41.752239] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:27.254 [2024-05-14 04:05:41.752248] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:27.254 [2024-05-14 04:05:41.752256] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:27.254 [2024-05-14 04:05:41.752339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:27.254 [2024-05-14 04:05:41.752441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:27.254 [2024-05-14 04:05:41.752603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:27.254 [2024-05-14 04:05:41.752605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:27.826 04:05:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:27.826 04:05:42 -- common/autotest_common.sh@852 -- # return 0 00:08:27.826 04:05:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:27.826 04:05:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:27.826 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:27.826 04:05:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:27.826 04:05:42 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:27.826 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:27.826 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:27.826 [2024-05-14 04:05:42.413373] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@26 -- # seq 1 4 00:08:28.087 04:05:42 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.087 04:05:42 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 Null1 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 [2024-05-14 04:05:42.473692] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.087 04:05:42 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 Null2 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.087 04:05:42 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 Null3 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:28.087 04:05:42 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 Null4 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:28.087 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.087 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.087 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.087 04:05:42 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 4420 00:08:28.348 00:08:28.348 Discovery Log Number of Records 6, Generation counter 6 00:08:28.348 =====Discovery Log Entry 0====== 00:08:28.348 trtype: tcp 00:08:28.348 adrfam: ipv4 00:08:28.348 subtype: current discovery subsystem 00:08:28.348 treq: not required 00:08:28.348 portid: 0 00:08:28.348 trsvcid: 4420 00:08:28.348 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:28.348 traddr: 10.0.0.2 00:08:28.348 eflags: explicit discovery connections, duplicate discovery information 00:08:28.348 sectype: none 00:08:28.348 =====Discovery Log Entry 1====== 00:08:28.348 trtype: tcp 00:08:28.348 adrfam: ipv4 00:08:28.348 subtype: nvme subsystem 00:08:28.348 treq: not required 00:08:28.348 portid: 0 00:08:28.348 trsvcid: 4420 00:08:28.348 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:28.348 traddr: 10.0.0.2 00:08:28.348 eflags: none 00:08:28.348 sectype: none 00:08:28.348 =====Discovery Log Entry 2====== 00:08:28.348 trtype: tcp 00:08:28.348 adrfam: ipv4 00:08:28.348 subtype: nvme subsystem 00:08:28.348 treq: not required 00:08:28.348 portid: 0 00:08:28.348 trsvcid: 4420 00:08:28.348 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:28.348 traddr: 10.0.0.2 00:08:28.348 eflags: none 00:08:28.348 sectype: none 00:08:28.348 =====Discovery Log Entry 3====== 00:08:28.348 trtype: tcp 00:08:28.348 adrfam: ipv4 00:08:28.348 subtype: nvme subsystem 00:08:28.348 treq: not required 00:08:28.348 portid: 0 00:08:28.348 trsvcid: 4420 00:08:28.348 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:28.348 traddr: 10.0.0.2 00:08:28.348 eflags: none 00:08:28.348 sectype: none 00:08:28.348 =====Discovery Log Entry 4====== 00:08:28.348 trtype: tcp 00:08:28.348 adrfam: ipv4 00:08:28.348 subtype: nvme subsystem 00:08:28.348 treq: not required 00:08:28.348 portid: 0 00:08:28.348 trsvcid: 4420 00:08:28.348 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:28.348 traddr: 10.0.0.2 00:08:28.348 eflags: none 00:08:28.348 sectype: none 00:08:28.348 =====Discovery Log Entry 5====== 00:08:28.348 trtype: tcp 00:08:28.348 adrfam: ipv4 00:08:28.348 subtype: discovery subsystem referral 00:08:28.348 treq: not required 00:08:28.348 portid: 0 00:08:28.348 trsvcid: 4430 00:08:28.348 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:28.348 traddr: 10.0.0.2 00:08:28.348 eflags: none 00:08:28.348 sectype: none 00:08:28.348 04:05:42 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:28.348 Perform nvmf subsystem discovery via RPC 00:08:28.348 04:05:42 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:28.348 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.348 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.348 [2024-05-14 04:05:42.774603] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:28.348 [ 00:08:28.348 { 00:08:28.348 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:28.348 "subtype": "Discovery", 00:08:28.348 "listen_addresses": [ 00:08:28.348 { 00:08:28.348 "transport": "TCP", 00:08:28.348 "trtype": "TCP", 00:08:28.348 "adrfam": "IPv4", 00:08:28.348 "traddr": "10.0.0.2", 00:08:28.348 "trsvcid": "4420" 00:08:28.348 } 00:08:28.348 ], 00:08:28.348 "allow_any_host": true, 00:08:28.348 "hosts": [] 00:08:28.348 }, 00:08:28.348 { 00:08:28.348 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:28.348 "subtype": "NVMe", 00:08:28.348 "listen_addresses": [ 00:08:28.348 { 00:08:28.348 "transport": "TCP", 00:08:28.348 "trtype": "TCP", 00:08:28.348 "adrfam": "IPv4", 00:08:28.348 "traddr": "10.0.0.2", 00:08:28.348 "trsvcid": "4420" 00:08:28.348 } 00:08:28.348 ], 00:08:28.348 "allow_any_host": true, 00:08:28.348 "hosts": [], 00:08:28.348 "serial_number": "SPDK00000000000001", 00:08:28.348 "model_number": "SPDK bdev Controller", 00:08:28.348 "max_namespaces": 32, 00:08:28.348 "min_cntlid": 1, 00:08:28.348 "max_cntlid": 65519, 00:08:28.348 "namespaces": [ 00:08:28.348 { 00:08:28.348 "nsid": 1, 00:08:28.348 "bdev_name": "Null1", 00:08:28.348 "name": "Null1", 00:08:28.348 "nguid": "DD03A23D175F45AB84E753E2D92AC93D", 00:08:28.348 "uuid": "dd03a23d-175f-45ab-84e7-53e2d92ac93d" 00:08:28.348 } 00:08:28.348 ] 00:08:28.348 }, 00:08:28.348 { 00:08:28.348 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:28.348 "subtype": "NVMe", 00:08:28.348 "listen_addresses": [ 00:08:28.348 { 00:08:28.348 "transport": "TCP", 00:08:28.348 "trtype": "TCP", 00:08:28.348 "adrfam": "IPv4", 00:08:28.348 "traddr": "10.0.0.2", 00:08:28.348 "trsvcid": "4420" 00:08:28.348 } 00:08:28.348 ], 00:08:28.348 "allow_any_host": true, 00:08:28.349 "hosts": [], 00:08:28.349 "serial_number": "SPDK00000000000002", 00:08:28.349 "model_number": "SPDK bdev Controller", 00:08:28.349 "max_namespaces": 32, 00:08:28.349 "min_cntlid": 1, 00:08:28.349 "max_cntlid": 65519, 00:08:28.349 "namespaces": [ 00:08:28.349 { 00:08:28.349 "nsid": 1, 00:08:28.349 "bdev_name": "Null2", 00:08:28.349 "name": "Null2", 00:08:28.349 "nguid": "805A19F5F8FD4A8083B292AD77F59879", 00:08:28.349 "uuid": "805a19f5-f8fd-4a80-83b2-92ad77f59879" 00:08:28.349 } 00:08:28.349 ] 00:08:28.349 }, 00:08:28.349 { 00:08:28.349 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:28.349 "subtype": "NVMe", 00:08:28.349 "listen_addresses": [ 00:08:28.349 { 00:08:28.349 "transport": "TCP", 00:08:28.349 "trtype": "TCP", 00:08:28.349 "adrfam": "IPv4", 00:08:28.349 "traddr": "10.0.0.2", 00:08:28.349 "trsvcid": "4420" 00:08:28.349 } 00:08:28.349 ], 00:08:28.349 "allow_any_host": true, 00:08:28.349 "hosts": [], 00:08:28.349 "serial_number": "SPDK00000000000003", 00:08:28.349 "model_number": "SPDK bdev Controller", 00:08:28.349 "max_namespaces": 32, 00:08:28.349 "min_cntlid": 1, 00:08:28.349 "max_cntlid": 65519, 00:08:28.349 "namespaces": [ 00:08:28.349 { 00:08:28.349 "nsid": 1, 00:08:28.349 "bdev_name": "Null3", 00:08:28.349 "name": "Null3", 00:08:28.349 "nguid": "7A1D55D362FE49CAB269B6507DC46226", 00:08:28.349 "uuid": "7a1d55d3-62fe-49ca-b269-b6507dc46226" 00:08:28.349 } 00:08:28.349 ] 00:08:28.349 }, 00:08:28.349 { 00:08:28.349 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:28.349 "subtype": "NVMe", 00:08:28.349 "listen_addresses": [ 00:08:28.349 { 00:08:28.349 "transport": "TCP", 00:08:28.349 "trtype": "TCP", 00:08:28.349 "adrfam": "IPv4", 00:08:28.349 "traddr": "10.0.0.2", 00:08:28.349 "trsvcid": "4420" 00:08:28.349 } 00:08:28.349 ], 00:08:28.349 "allow_any_host": true, 00:08:28.349 "hosts": [], 00:08:28.349 "serial_number": "SPDK00000000000004", 00:08:28.349 "model_number": "SPDK bdev Controller", 00:08:28.349 "max_namespaces": 32, 00:08:28.349 "min_cntlid": 1, 00:08:28.349 "max_cntlid": 65519, 00:08:28.349 "namespaces": [ 00:08:28.349 { 00:08:28.349 "nsid": 1, 00:08:28.349 "bdev_name": "Null4", 00:08:28.349 "name": "Null4", 00:08:28.349 "nguid": "34F48B3A13214678BE7A30927A71F615", 00:08:28.349 "uuid": "34f48b3a-1321-4678-be7a-30927a71f615" 00:08:28.349 } 00:08:28.349 ] 00:08:28.349 } 00:08:28.349 ] 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@42 -- # seq 1 4 00:08:28.349 04:05:42 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:28.349 04:05:42 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:28.349 04:05:42 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:28.349 04:05:42 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:28.349 04:05:42 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.349 04:05:42 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:28.349 04:05:42 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:28.349 04:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:28.349 04:05:42 -- common/autotest_common.sh@10 -- # set +x 00:08:28.349 04:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:28.611 04:05:42 -- target/discovery.sh@49 -- # check_bdevs= 00:08:28.611 04:05:42 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:28.611 04:05:42 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:28.611 04:05:42 -- target/discovery.sh@57 -- # nvmftestfini 00:08:28.611 04:05:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:28.611 04:05:42 -- nvmf/common.sh@116 -- # sync 00:08:28.611 04:05:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:28.611 04:05:42 -- nvmf/common.sh@119 -- # set +e 00:08:28.611 04:05:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:28.611 04:05:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:28.611 rmmod nvme_tcp 00:08:28.611 rmmod nvme_fabrics 00:08:28.611 rmmod nvme_keyring 00:08:28.611 04:05:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:28.611 04:05:43 -- nvmf/common.sh@123 -- # set -e 00:08:28.611 04:05:43 -- nvmf/common.sh@124 -- # return 0 00:08:28.611 04:05:43 -- nvmf/common.sh@477 -- # '[' -n 3773633 ']' 00:08:28.611 04:05:43 -- nvmf/common.sh@478 -- # killprocess 3773633 00:08:28.611 04:05:43 -- common/autotest_common.sh@926 -- # '[' -z 3773633 ']' 00:08:28.611 04:05:43 -- common/autotest_common.sh@930 -- # kill -0 3773633 00:08:28.611 04:05:43 -- common/autotest_common.sh@931 -- # uname 00:08:28.611 04:05:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:28.611 04:05:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3773633 00:08:28.611 04:05:43 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:28.611 04:05:43 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:28.611 04:05:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3773633' 00:08:28.611 killing process with pid 3773633 00:08:28.611 04:05:43 -- common/autotest_common.sh@945 -- # kill 3773633 00:08:28.611 [2024-05-14 04:05:43.059855] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:28.611 04:05:43 -- common/autotest_common.sh@950 -- # wait 3773633 00:08:28.611 04:05:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:28.611 04:05:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:28.611 04:05:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:28.611 04:05:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:28.611 04:05:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:28.611 04:05:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:28.611 04:05:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:28.611 04:05:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:31.159 04:05:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:31.159 00:08:31.159 real 0m10.769s 00:08:31.159 user 0m7.824s 00:08:31.159 sys 0m5.532s 00:08:31.159 04:05:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:31.159 04:05:45 -- common/autotest_common.sh@10 -- # set +x 00:08:31.159 ************************************ 00:08:31.159 END TEST nvmf_discovery 00:08:31.159 ************************************ 00:08:31.159 04:05:45 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:31.159 04:05:45 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:31.159 04:05:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:31.159 04:05:45 -- common/autotest_common.sh@10 -- # set +x 00:08:31.159 ************************************ 00:08:31.159 START TEST nvmf_referrals 00:08:31.159 ************************************ 00:08:31.159 04:05:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:31.159 * Looking for test storage... 00:08:31.159 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:31.159 04:05:45 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:31.159 04:05:45 -- nvmf/common.sh@7 -- # uname -s 00:08:31.159 04:05:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:31.159 04:05:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:31.159 04:05:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:31.159 04:05:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:31.159 04:05:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:31.159 04:05:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:31.159 04:05:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:31.159 04:05:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:31.159 04:05:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:31.159 04:05:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:31.159 04:05:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:31.159 04:05:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:31.159 04:05:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:31.159 04:05:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:31.159 04:05:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:31.159 04:05:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:31.159 04:05:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:31.159 04:05:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:31.159 04:05:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:31.159 04:05:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.159 04:05:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.159 04:05:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.159 04:05:45 -- paths/export.sh@5 -- # export PATH 00:08:31.159 04:05:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.159 04:05:45 -- nvmf/common.sh@46 -- # : 0 00:08:31.159 04:05:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:31.159 04:05:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:31.159 04:05:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:31.159 04:05:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:31.159 04:05:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:31.159 04:05:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:31.159 04:05:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:31.159 04:05:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:31.159 04:05:45 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:31.159 04:05:45 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:31.159 04:05:45 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:31.159 04:05:45 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:31.159 04:05:45 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:31.159 04:05:45 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:31.159 04:05:45 -- target/referrals.sh@37 -- # nvmftestinit 00:08:31.159 04:05:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:31.159 04:05:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:31.159 04:05:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:31.159 04:05:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:31.159 04:05:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:31.159 04:05:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:31.159 04:05:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:31.159 04:05:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:31.159 04:05:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:31.159 04:05:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:31.159 04:05:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:31.159 04:05:45 -- common/autotest_common.sh@10 -- # set +x 00:08:37.756 04:05:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:37.756 04:05:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:37.756 04:05:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:37.756 04:05:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:37.756 04:05:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:37.756 04:05:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:37.756 04:05:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:37.756 04:05:52 -- nvmf/common.sh@294 -- # net_devs=() 00:08:37.756 04:05:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:37.756 04:05:52 -- nvmf/common.sh@295 -- # e810=() 00:08:37.756 04:05:52 -- nvmf/common.sh@295 -- # local -ga e810 00:08:37.756 04:05:52 -- nvmf/common.sh@296 -- # x722=() 00:08:37.756 04:05:52 -- nvmf/common.sh@296 -- # local -ga x722 00:08:37.756 04:05:52 -- nvmf/common.sh@297 -- # mlx=() 00:08:37.756 04:05:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:37.757 04:05:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:37.757 04:05:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:37.757 04:05:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:37.757 04:05:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:37.757 04:05:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:37.757 04:05:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:08:37.757 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:08:37.757 04:05:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:37.757 04:05:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:08:37.757 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:08:37.757 04:05:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:37.757 04:05:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:37.757 04:05:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:37.757 04:05:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:37.757 04:05:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:37.757 04:05:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:08:37.757 Found net devices under 0000:4b:00.0: cvl_0_0 00:08:37.757 04:05:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:37.757 04:05:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:37.757 04:05:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:37.757 04:05:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:37.757 04:05:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:37.757 04:05:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:08:37.757 Found net devices under 0000:4b:00.1: cvl_0_1 00:08:37.757 04:05:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:37.757 04:05:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:37.757 04:05:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:37.757 04:05:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:37.757 04:05:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:37.757 04:05:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:37.757 04:05:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:37.757 04:05:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:37.757 04:05:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:37.757 04:05:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:37.757 04:05:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:37.757 04:05:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:37.757 04:05:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:37.757 04:05:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:37.757 04:05:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:37.757 04:05:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:37.757 04:05:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:37.757 04:05:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:38.019 04:05:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:38.019 04:05:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:38.019 04:05:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:38.019 04:05:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:38.019 04:05:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:38.019 04:05:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:38.019 04:05:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:38.019 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:38.019 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.617 ms 00:08:38.019 00:08:38.019 --- 10.0.0.2 ping statistics --- 00:08:38.019 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:38.019 rtt min/avg/max/mdev = 0.617/0.617/0.617/0.000 ms 00:08:38.019 04:05:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:38.019 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:38.019 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.458 ms 00:08:38.019 00:08:38.019 --- 10.0.0.1 ping statistics --- 00:08:38.019 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:38.019 rtt min/avg/max/mdev = 0.458/0.458/0.458/0.000 ms 00:08:38.019 04:05:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:38.019 04:05:52 -- nvmf/common.sh@410 -- # return 0 00:08:38.019 04:05:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:38.019 04:05:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:38.019 04:05:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:38.019 04:05:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:38.019 04:05:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:38.019 04:05:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:38.019 04:05:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:38.019 04:05:52 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:38.019 04:05:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:38.019 04:05:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:38.019 04:05:52 -- common/autotest_common.sh@10 -- # set +x 00:08:38.281 04:05:52 -- nvmf/common.sh@469 -- # nvmfpid=3778092 00:08:38.281 04:05:52 -- nvmf/common.sh@470 -- # waitforlisten 3778092 00:08:38.281 04:05:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:38.281 04:05:52 -- common/autotest_common.sh@819 -- # '[' -z 3778092 ']' 00:08:38.281 04:05:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:38.281 04:05:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:38.281 04:05:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:38.281 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:38.281 04:05:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:38.281 04:05:52 -- common/autotest_common.sh@10 -- # set +x 00:08:38.281 [2024-05-14 04:05:52.660319] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:08:38.281 [2024-05-14 04:05:52.660394] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:38.281 EAL: No free 2048 kB hugepages reported on node 1 00:08:38.281 [2024-05-14 04:05:52.730996] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:38.281 [2024-05-14 04:05:52.804018] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:38.281 [2024-05-14 04:05:52.804157] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:38.281 [2024-05-14 04:05:52.804167] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:38.281 [2024-05-14 04:05:52.804175] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:38.281 [2024-05-14 04:05:52.804341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:38.281 [2024-05-14 04:05:52.804565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:38.281 [2024-05-14 04:05:52.804397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:38.281 [2024-05-14 04:05:52.804566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:39.224 04:05:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:39.224 04:05:53 -- common/autotest_common.sh@852 -- # return 0 00:08:39.224 04:05:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:39.224 04:05:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:39.224 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.224 04:05:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:39.224 04:05:53 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:39.224 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.224 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.224 [2024-05-14 04:05:53.488532] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:39.224 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.224 04:05:53 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:39.224 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.224 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.224 [2024-05-14 04:05:53.504698] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:39.224 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.224 04:05:53 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:39.224 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.224 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.224 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.224 04:05:53 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:39.224 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.224 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.224 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.224 04:05:53 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:39.224 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.224 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.224 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.224 04:05:53 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:39.224 04:05:53 -- target/referrals.sh@48 -- # jq length 00:08:39.224 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.224 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.224 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.224 04:05:53 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:39.224 04:05:53 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:39.224 04:05:53 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:39.224 04:05:53 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:39.224 04:05:53 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:39.224 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.224 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.224 04:05:53 -- target/referrals.sh@21 -- # sort 00:08:39.224 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.224 04:05:53 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:39.224 04:05:53 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:39.224 04:05:53 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:39.224 04:05:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:39.224 04:05:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:39.224 04:05:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:39.224 04:05:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:39.224 04:05:53 -- target/referrals.sh@26 -- # sort 00:08:39.483 04:05:53 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:39.483 04:05:53 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:39.483 04:05:53 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:39.483 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.483 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.483 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.483 04:05:53 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:39.483 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.483 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.483 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.483 04:05:53 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:39.483 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.483 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.483 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.483 04:05:53 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:39.483 04:05:53 -- target/referrals.sh@56 -- # jq length 00:08:39.483 04:05:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.483 04:05:53 -- common/autotest_common.sh@10 -- # set +x 00:08:39.483 04:05:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.483 04:05:53 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:39.483 04:05:53 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:39.483 04:05:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:39.483 04:05:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:39.483 04:05:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:39.483 04:05:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:39.483 04:05:53 -- target/referrals.sh@26 -- # sort 00:08:39.483 04:05:54 -- target/referrals.sh@26 -- # echo 00:08:39.483 04:05:54 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:39.483 04:05:54 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:39.483 04:05:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.483 04:05:54 -- common/autotest_common.sh@10 -- # set +x 00:08:39.483 04:05:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.483 04:05:54 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:39.483 04:05:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.483 04:05:54 -- common/autotest_common.sh@10 -- # set +x 00:08:39.484 04:05:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.744 04:05:54 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:39.744 04:05:54 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:39.744 04:05:54 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:39.744 04:05:54 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:39.744 04:05:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.744 04:05:54 -- target/referrals.sh@21 -- # sort 00:08:39.744 04:05:54 -- common/autotest_common.sh@10 -- # set +x 00:08:39.744 04:05:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.744 04:05:54 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:39.744 04:05:54 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:39.744 04:05:54 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:39.744 04:05:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:39.744 04:05:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:39.744 04:05:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:39.744 04:05:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:39.744 04:05:54 -- target/referrals.sh@26 -- # sort 00:08:39.744 04:05:54 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:39.744 04:05:54 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:39.744 04:05:54 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:39.744 04:05:54 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:39.744 04:05:54 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:39.744 04:05:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:39.744 04:05:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:40.006 04:05:54 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:40.006 04:05:54 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:40.006 04:05:54 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:40.006 04:05:54 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:40.006 04:05:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:40.006 04:05:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:40.006 04:05:54 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:40.006 04:05:54 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:40.006 04:05:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:40.006 04:05:54 -- common/autotest_common.sh@10 -- # set +x 00:08:40.006 04:05:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:40.006 04:05:54 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:40.006 04:05:54 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:40.006 04:05:54 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:40.006 04:05:54 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:40.006 04:05:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:40.006 04:05:54 -- common/autotest_common.sh@10 -- # set +x 00:08:40.006 04:05:54 -- target/referrals.sh@21 -- # sort 00:08:40.006 04:05:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:40.006 04:05:54 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:40.006 04:05:54 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:40.006 04:05:54 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:40.006 04:05:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:40.006 04:05:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:40.006 04:05:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:40.006 04:05:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:40.006 04:05:54 -- target/referrals.sh@26 -- # sort 00:08:40.268 04:05:54 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:40.268 04:05:54 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:40.268 04:05:54 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:40.268 04:05:54 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:40.268 04:05:54 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:40.268 04:05:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:40.268 04:05:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:40.529 04:05:54 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:40.529 04:05:54 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:40.529 04:05:54 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:40.529 04:05:54 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:40.529 04:05:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:40.529 04:05:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:40.529 04:05:55 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:40.529 04:05:55 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:40.529 04:05:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:40.529 04:05:55 -- common/autotest_common.sh@10 -- # set +x 00:08:40.529 04:05:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:40.529 04:05:55 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:40.529 04:05:55 -- target/referrals.sh@82 -- # jq length 00:08:40.529 04:05:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:40.529 04:05:55 -- common/autotest_common.sh@10 -- # set +x 00:08:40.529 04:05:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:40.529 04:05:55 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:40.529 04:05:55 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:40.529 04:05:55 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:40.529 04:05:55 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:40.529 04:05:55 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:40.529 04:05:55 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:40.529 04:05:55 -- target/referrals.sh@26 -- # sort 00:08:40.791 04:05:55 -- target/referrals.sh@26 -- # echo 00:08:40.791 04:05:55 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:40.791 04:05:55 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:40.791 04:05:55 -- target/referrals.sh@86 -- # nvmftestfini 00:08:40.791 04:05:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:40.791 04:05:55 -- nvmf/common.sh@116 -- # sync 00:08:40.791 04:05:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:40.791 04:05:55 -- nvmf/common.sh@119 -- # set +e 00:08:40.791 04:05:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:40.791 04:05:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:40.791 rmmod nvme_tcp 00:08:40.791 rmmod nvme_fabrics 00:08:40.791 rmmod nvme_keyring 00:08:40.791 04:05:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:40.791 04:05:55 -- nvmf/common.sh@123 -- # set -e 00:08:40.791 04:05:55 -- nvmf/common.sh@124 -- # return 0 00:08:40.791 04:05:55 -- nvmf/common.sh@477 -- # '[' -n 3778092 ']' 00:08:40.791 04:05:55 -- nvmf/common.sh@478 -- # killprocess 3778092 00:08:40.791 04:05:55 -- common/autotest_common.sh@926 -- # '[' -z 3778092 ']' 00:08:40.791 04:05:55 -- common/autotest_common.sh@930 -- # kill -0 3778092 00:08:40.791 04:05:55 -- common/autotest_common.sh@931 -- # uname 00:08:40.791 04:05:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:40.791 04:05:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3778092 00:08:40.791 04:05:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:40.791 04:05:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:40.791 04:05:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3778092' 00:08:40.791 killing process with pid 3778092 00:08:40.791 04:05:55 -- common/autotest_common.sh@945 -- # kill 3778092 00:08:40.791 04:05:55 -- common/autotest_common.sh@950 -- # wait 3778092 00:08:41.052 04:05:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:41.052 04:05:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:41.052 04:05:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:41.052 04:05:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:41.052 04:05:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:41.052 04:05:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:41.052 04:05:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:41.052 04:05:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:43.601 04:05:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:43.601 00:08:43.601 real 0m12.261s 00:08:43.601 user 0m13.681s 00:08:43.601 sys 0m6.003s 00:08:43.601 04:05:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:43.601 04:05:57 -- common/autotest_common.sh@10 -- # set +x 00:08:43.601 ************************************ 00:08:43.601 END TEST nvmf_referrals 00:08:43.601 ************************************ 00:08:43.601 04:05:57 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:43.601 04:05:57 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:43.601 04:05:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:43.601 04:05:57 -- common/autotest_common.sh@10 -- # set +x 00:08:43.601 ************************************ 00:08:43.601 START TEST nvmf_connect_disconnect 00:08:43.601 ************************************ 00:08:43.601 04:05:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:43.601 * Looking for test storage... 00:08:43.601 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:43.601 04:05:57 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:43.601 04:05:57 -- nvmf/common.sh@7 -- # uname -s 00:08:43.601 04:05:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:43.601 04:05:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:43.601 04:05:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:43.601 04:05:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:43.601 04:05:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:43.601 04:05:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:43.601 04:05:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:43.601 04:05:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:43.601 04:05:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:43.601 04:05:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:43.601 04:05:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:43.601 04:05:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:43.601 04:05:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:43.601 04:05:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:43.601 04:05:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:43.601 04:05:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:43.601 04:05:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:43.601 04:05:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:43.601 04:05:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:43.601 04:05:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.601 04:05:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.601 04:05:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.601 04:05:57 -- paths/export.sh@5 -- # export PATH 00:08:43.601 04:05:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.601 04:05:57 -- nvmf/common.sh@46 -- # : 0 00:08:43.601 04:05:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:43.601 04:05:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:43.601 04:05:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:43.601 04:05:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:43.601 04:05:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:43.601 04:05:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:43.601 04:05:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:43.601 04:05:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:43.601 04:05:57 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:43.601 04:05:57 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:43.601 04:05:57 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:43.601 04:05:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:43.601 04:05:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:43.601 04:05:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:43.601 04:05:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:43.601 04:05:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:43.601 04:05:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:43.601 04:05:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:43.601 04:05:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:43.601 04:05:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:43.601 04:05:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:43.601 04:05:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:43.601 04:05:57 -- common/autotest_common.sh@10 -- # set +x 00:08:50.247 04:06:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:50.247 04:06:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:50.247 04:06:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:50.247 04:06:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:50.247 04:06:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:50.247 04:06:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:50.247 04:06:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:50.247 04:06:04 -- nvmf/common.sh@294 -- # net_devs=() 00:08:50.247 04:06:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:50.247 04:06:04 -- nvmf/common.sh@295 -- # e810=() 00:08:50.247 04:06:04 -- nvmf/common.sh@295 -- # local -ga e810 00:08:50.247 04:06:04 -- nvmf/common.sh@296 -- # x722=() 00:08:50.247 04:06:04 -- nvmf/common.sh@296 -- # local -ga x722 00:08:50.247 04:06:04 -- nvmf/common.sh@297 -- # mlx=() 00:08:50.247 04:06:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:50.247 04:06:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:50.247 04:06:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:50.247 04:06:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:50.247 04:06:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:50.247 04:06:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:50.247 04:06:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:08:50.247 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:08:50.247 04:06:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:50.247 04:06:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:08:50.247 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:08:50.247 04:06:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:50.247 04:06:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:50.247 04:06:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:50.247 04:06:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:50.247 04:06:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:50.247 04:06:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:08:50.247 Found net devices under 0000:4b:00.0: cvl_0_0 00:08:50.247 04:06:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:50.247 04:06:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:50.247 04:06:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:50.247 04:06:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:50.247 04:06:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:50.247 04:06:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:08:50.247 Found net devices under 0000:4b:00.1: cvl_0_1 00:08:50.247 04:06:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:50.247 04:06:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:50.247 04:06:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:50.247 04:06:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:50.247 04:06:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:50.247 04:06:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:50.247 04:06:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:50.247 04:06:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:50.247 04:06:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:50.247 04:06:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:50.247 04:06:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:50.247 04:06:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:50.247 04:06:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:50.247 04:06:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:50.247 04:06:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:50.247 04:06:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:50.247 04:06:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:50.247 04:06:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:50.247 04:06:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:50.247 04:06:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:50.247 04:06:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:50.247 04:06:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:50.248 04:06:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:50.248 04:06:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:50.248 04:06:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:50.248 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:50.248 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.625 ms 00:08:50.248 00:08:50.248 --- 10.0.0.2 ping statistics --- 00:08:50.248 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:50.248 rtt min/avg/max/mdev = 0.625/0.625/0.625/0.000 ms 00:08:50.248 04:06:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:50.248 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:50.248 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.361 ms 00:08:50.248 00:08:50.248 --- 10.0.0.1 ping statistics --- 00:08:50.248 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:50.248 rtt min/avg/max/mdev = 0.361/0.361/0.361/0.000 ms 00:08:50.248 04:06:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:50.248 04:06:04 -- nvmf/common.sh@410 -- # return 0 00:08:50.248 04:06:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:50.248 04:06:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:50.248 04:06:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:50.248 04:06:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:50.248 04:06:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:50.248 04:06:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:50.248 04:06:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:50.248 04:06:04 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:50.248 04:06:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:50.248 04:06:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:50.248 04:06:04 -- common/autotest_common.sh@10 -- # set +x 00:08:50.248 04:06:04 -- nvmf/common.sh@469 -- # nvmfpid=3783029 00:08:50.248 04:06:04 -- nvmf/common.sh@470 -- # waitforlisten 3783029 00:08:50.248 04:06:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:50.248 04:06:04 -- common/autotest_common.sh@819 -- # '[' -z 3783029 ']' 00:08:50.248 04:06:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:50.248 04:06:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:50.248 04:06:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:50.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:50.248 04:06:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:50.248 04:06:04 -- common/autotest_common.sh@10 -- # set +x 00:08:50.509 [2024-05-14 04:06:04.844585] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:08:50.509 [2024-05-14 04:06:04.844633] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:50.509 EAL: No free 2048 kB hugepages reported on node 1 00:08:50.509 [2024-05-14 04:06:04.909877] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:50.509 [2024-05-14 04:06:04.973380] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:50.509 [2024-05-14 04:06:04.973514] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:50.509 [2024-05-14 04:06:04.973523] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:50.509 [2024-05-14 04:06:04.973532] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:50.509 [2024-05-14 04:06:04.973614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:50.509 [2024-05-14 04:06:04.973634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:50.509 [2024-05-14 04:06:04.973808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:50.509 [2024-05-14 04:06:04.973809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:51.081 04:06:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:51.081 04:06:05 -- common/autotest_common.sh@852 -- # return 0 00:08:51.081 04:06:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:51.081 04:06:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:51.081 04:06:05 -- common/autotest_common.sh@10 -- # set +x 00:08:51.081 04:06:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:51.081 04:06:05 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:51.081 04:06:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:51.081 04:06:05 -- common/autotest_common.sh@10 -- # set +x 00:08:51.081 [2024-05-14 04:06:05.664463] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:51.341 04:06:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:51.341 04:06:05 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:51.341 04:06:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:51.341 04:06:05 -- common/autotest_common.sh@10 -- # set +x 00:08:51.341 04:06:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:51.341 04:06:05 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:51.341 04:06:05 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:51.341 04:06:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:51.341 04:06:05 -- common/autotest_common.sh@10 -- # set +x 00:08:51.341 04:06:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:51.341 04:06:05 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:51.341 04:06:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:51.341 04:06:05 -- common/autotest_common.sh@10 -- # set +x 00:08:51.341 04:06:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:51.341 04:06:05 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:51.341 04:06:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:51.341 04:06:05 -- common/autotest_common.sh@10 -- # set +x 00:08:51.341 [2024-05-14 04:06:05.723813] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:51.341 04:06:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:51.341 04:06:05 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:51.341 04:06:05 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:51.341 04:06:05 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:51.341 04:06:05 -- target/connect_disconnect.sh@34 -- # set +x 00:08:53.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.354 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.452 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.997 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.456 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.038 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.955 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.502 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.046 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.960 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.504 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.053 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.969 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.519 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.077 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.064 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.678 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.137 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.595 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.140 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.057 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.607 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.175 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.662 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.209 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.672 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.583 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.129 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.675 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.590 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.208 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.759 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.676 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.224 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.140 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.685 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.226 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.136 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.682 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.233 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.146 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.691 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.152 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.698 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.246 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.161 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.706 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.248 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.793 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.715 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.264 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.733 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.284 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.799 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.714 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.265 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.814 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.733 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.319 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.866 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.782 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.331 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.945 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.882 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.432 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.893 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.437 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.352 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:54.899 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.446 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.360 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.458 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.922 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.469 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.015 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:15.929 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.476 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.024 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:22.940 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.551 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.468 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.017 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:31.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.481 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.029 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.576 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.042 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.042 04:09:58 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:44.042 04:09:58 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:44.042 04:09:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:44.042 04:09:58 -- nvmf/common.sh@116 -- # sync 00:12:44.042 04:09:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:44.042 04:09:58 -- nvmf/common.sh@119 -- # set +e 00:12:44.042 04:09:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:44.042 04:09:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:44.042 rmmod nvme_tcp 00:12:44.042 rmmod nvme_fabrics 00:12:44.042 rmmod nvme_keyring 00:12:44.042 04:09:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:44.042 04:09:58 -- nvmf/common.sh@123 -- # set -e 00:12:44.042 04:09:58 -- nvmf/common.sh@124 -- # return 0 00:12:44.042 04:09:58 -- nvmf/common.sh@477 -- # '[' -n 3783029 ']' 00:12:44.042 04:09:58 -- nvmf/common.sh@478 -- # killprocess 3783029 00:12:44.042 04:09:58 -- common/autotest_common.sh@926 -- # '[' -z 3783029 ']' 00:12:44.042 04:09:58 -- common/autotest_common.sh@930 -- # kill -0 3783029 00:12:44.042 04:09:58 -- common/autotest_common.sh@931 -- # uname 00:12:44.042 04:09:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:44.042 04:09:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3783029 00:12:44.042 04:09:58 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:44.042 04:09:58 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:44.042 04:09:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3783029' 00:12:44.042 killing process with pid 3783029 00:12:44.042 04:09:58 -- common/autotest_common.sh@945 -- # kill 3783029 00:12:44.042 04:09:58 -- common/autotest_common.sh@950 -- # wait 3783029 00:12:44.304 04:09:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:44.304 04:09:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:44.304 04:09:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:44.304 04:09:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:44.304 04:09:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:44.304 04:09:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:44.304 04:09:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:44.304 04:09:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:46.262 04:10:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:46.262 00:12:46.262 real 4m3.126s 00:12:46.262 user 15m28.851s 00:12:46.262 sys 0m21.552s 00:12:46.262 04:10:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:46.262 04:10:00 -- common/autotest_common.sh@10 -- # set +x 00:12:46.262 ************************************ 00:12:46.262 END TEST nvmf_connect_disconnect 00:12:46.262 ************************************ 00:12:46.262 04:10:00 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:46.262 04:10:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:46.262 04:10:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:46.262 04:10:00 -- common/autotest_common.sh@10 -- # set +x 00:12:46.262 ************************************ 00:12:46.262 START TEST nvmf_multitarget 00:12:46.262 ************************************ 00:12:46.262 04:10:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:46.524 * Looking for test storage... 00:12:46.524 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:46.524 04:10:00 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:46.524 04:10:00 -- nvmf/common.sh@7 -- # uname -s 00:12:46.524 04:10:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:46.524 04:10:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:46.524 04:10:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:46.524 04:10:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:46.524 04:10:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:46.524 04:10:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:46.524 04:10:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:46.524 04:10:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:46.524 04:10:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:46.524 04:10:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:46.524 04:10:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:46.524 04:10:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:46.524 04:10:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:46.524 04:10:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:46.524 04:10:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:46.524 04:10:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:46.524 04:10:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:46.524 04:10:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:46.524 04:10:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:46.524 04:10:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.524 04:10:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.524 04:10:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.524 04:10:00 -- paths/export.sh@5 -- # export PATH 00:12:46.524 04:10:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.524 04:10:00 -- nvmf/common.sh@46 -- # : 0 00:12:46.524 04:10:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:46.524 04:10:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:46.524 04:10:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:46.524 04:10:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:46.524 04:10:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:46.524 04:10:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:46.524 04:10:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:46.524 04:10:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:46.524 04:10:00 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:46.524 04:10:00 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:46.524 04:10:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:46.524 04:10:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:46.524 04:10:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:46.524 04:10:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:46.524 04:10:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:46.524 04:10:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:46.524 04:10:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:46.524 04:10:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:46.524 04:10:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:46.524 04:10:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:46.524 04:10:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:46.524 04:10:00 -- common/autotest_common.sh@10 -- # set +x 00:12:53.127 04:10:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:53.127 04:10:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:53.127 04:10:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:53.127 04:10:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:53.127 04:10:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:53.127 04:10:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:53.127 04:10:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:53.127 04:10:07 -- nvmf/common.sh@294 -- # net_devs=() 00:12:53.127 04:10:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:53.127 04:10:07 -- nvmf/common.sh@295 -- # e810=() 00:12:53.127 04:10:07 -- nvmf/common.sh@295 -- # local -ga e810 00:12:53.127 04:10:07 -- nvmf/common.sh@296 -- # x722=() 00:12:53.127 04:10:07 -- nvmf/common.sh@296 -- # local -ga x722 00:12:53.127 04:10:07 -- nvmf/common.sh@297 -- # mlx=() 00:12:53.127 04:10:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:53.127 04:10:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:53.127 04:10:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:53.127 04:10:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:53.127 04:10:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:53.127 04:10:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:53.127 04:10:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:12:53.127 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:12:53.127 04:10:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:53.127 04:10:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:12:53.127 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:12:53.127 04:10:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:53.127 04:10:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:53.127 04:10:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:53.127 04:10:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:53.127 04:10:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:53.127 04:10:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:12:53.127 Found net devices under 0000:4b:00.0: cvl_0_0 00:12:53.127 04:10:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:53.127 04:10:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:53.127 04:10:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:53.127 04:10:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:53.127 04:10:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:53.127 04:10:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:12:53.127 Found net devices under 0000:4b:00.1: cvl_0_1 00:12:53.127 04:10:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:53.127 04:10:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:53.127 04:10:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:53.127 04:10:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:53.127 04:10:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:53.127 04:10:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:53.127 04:10:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:53.127 04:10:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:53.127 04:10:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:53.127 04:10:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:53.127 04:10:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:53.127 04:10:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:53.127 04:10:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:53.127 04:10:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:53.127 04:10:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:53.127 04:10:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:53.127 04:10:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:53.127 04:10:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:53.388 04:10:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:53.388 04:10:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:53.388 04:10:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:53.388 04:10:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:53.388 04:10:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:53.388 04:10:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:53.388 04:10:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:53.388 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:53.388 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.641 ms 00:12:53.389 00:12:53.389 --- 10.0.0.2 ping statistics --- 00:12:53.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:53.389 rtt min/avg/max/mdev = 0.641/0.641/0.641/0.000 ms 00:12:53.389 04:10:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:53.389 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:53.389 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.272 ms 00:12:53.389 00:12:53.389 --- 10.0.0.1 ping statistics --- 00:12:53.389 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:53.389 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:12:53.389 04:10:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:53.389 04:10:07 -- nvmf/common.sh@410 -- # return 0 00:12:53.389 04:10:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:53.389 04:10:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:53.389 04:10:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:53.389 04:10:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:53.389 04:10:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:53.389 04:10:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:53.389 04:10:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:53.651 04:10:08 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:53.651 04:10:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:53.651 04:10:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:53.651 04:10:08 -- common/autotest_common.sh@10 -- # set +x 00:12:53.651 04:10:08 -- nvmf/common.sh@469 -- # nvmfpid=3835624 00:12:53.651 04:10:08 -- nvmf/common.sh@470 -- # waitforlisten 3835624 00:12:53.651 04:10:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:53.651 04:10:08 -- common/autotest_common.sh@819 -- # '[' -z 3835624 ']' 00:12:53.651 04:10:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:53.651 04:10:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:53.651 04:10:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:53.651 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:53.651 04:10:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:53.651 04:10:08 -- common/autotest_common.sh@10 -- # set +x 00:12:53.651 [2024-05-14 04:10:08.069136] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:12:53.651 [2024-05-14 04:10:08.069186] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:53.651 EAL: No free 2048 kB hugepages reported on node 1 00:12:53.651 [2024-05-14 04:10:08.134322] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:53.651 [2024-05-14 04:10:08.197039] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:53.651 [2024-05-14 04:10:08.197175] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:53.651 [2024-05-14 04:10:08.197185] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:53.651 [2024-05-14 04:10:08.197194] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:53.651 [2024-05-14 04:10:08.197363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:53.651 [2024-05-14 04:10:08.197587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:53.651 [2024-05-14 04:10:08.197743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:53.651 [2024-05-14 04:10:08.197744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:54.595 04:10:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:54.595 04:10:08 -- common/autotest_common.sh@852 -- # return 0 00:12:54.595 04:10:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:54.595 04:10:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:54.595 04:10:08 -- common/autotest_common.sh@10 -- # set +x 00:12:54.595 04:10:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:54.595 04:10:08 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:54.595 04:10:08 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:54.595 04:10:08 -- target/multitarget.sh@21 -- # jq length 00:12:54.595 04:10:08 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:54.595 04:10:08 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:54.595 "nvmf_tgt_1" 00:12:54.595 04:10:09 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:54.595 "nvmf_tgt_2" 00:12:54.595 04:10:09 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:54.595 04:10:09 -- target/multitarget.sh@28 -- # jq length 00:12:54.856 04:10:09 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:54.856 04:10:09 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:54.856 true 00:12:54.856 04:10:09 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:55.117 true 00:12:55.117 04:10:09 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:55.117 04:10:09 -- target/multitarget.sh@35 -- # jq length 00:12:55.117 04:10:09 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:55.117 04:10:09 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:55.117 04:10:09 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:55.117 04:10:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:55.117 04:10:09 -- nvmf/common.sh@116 -- # sync 00:12:55.117 04:10:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:55.117 04:10:09 -- nvmf/common.sh@119 -- # set +e 00:12:55.117 04:10:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:55.117 04:10:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:55.117 rmmod nvme_tcp 00:12:55.117 rmmod nvme_fabrics 00:12:55.117 rmmod nvme_keyring 00:12:55.117 04:10:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:55.118 04:10:09 -- nvmf/common.sh@123 -- # set -e 00:12:55.118 04:10:09 -- nvmf/common.sh@124 -- # return 0 00:12:55.118 04:10:09 -- nvmf/common.sh@477 -- # '[' -n 3835624 ']' 00:12:55.118 04:10:09 -- nvmf/common.sh@478 -- # killprocess 3835624 00:12:55.118 04:10:09 -- common/autotest_common.sh@926 -- # '[' -z 3835624 ']' 00:12:55.118 04:10:09 -- common/autotest_common.sh@930 -- # kill -0 3835624 00:12:55.118 04:10:09 -- common/autotest_common.sh@931 -- # uname 00:12:55.118 04:10:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:55.118 04:10:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3835624 00:12:55.118 04:10:09 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:55.118 04:10:09 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:55.118 04:10:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3835624' 00:12:55.118 killing process with pid 3835624 00:12:55.118 04:10:09 -- common/autotest_common.sh@945 -- # kill 3835624 00:12:55.118 04:10:09 -- common/autotest_common.sh@950 -- # wait 3835624 00:12:55.379 04:10:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:55.379 04:10:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:55.379 04:10:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:55.379 04:10:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:55.379 04:10:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:55.379 04:10:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:55.379 04:10:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:55.379 04:10:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:57.928 04:10:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:57.928 00:12:57.928 real 0m11.115s 00:12:57.928 user 0m9.226s 00:12:57.928 sys 0m5.686s 00:12:57.928 04:10:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:57.928 04:10:11 -- common/autotest_common.sh@10 -- # set +x 00:12:57.928 ************************************ 00:12:57.928 END TEST nvmf_multitarget 00:12:57.928 ************************************ 00:12:57.928 04:10:11 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:57.928 04:10:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:57.928 04:10:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:57.928 04:10:11 -- common/autotest_common.sh@10 -- # set +x 00:12:57.928 ************************************ 00:12:57.928 START TEST nvmf_rpc 00:12:57.928 ************************************ 00:12:57.928 04:10:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:57.928 * Looking for test storage... 00:12:57.928 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:57.928 04:10:12 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:57.928 04:10:12 -- nvmf/common.sh@7 -- # uname -s 00:12:57.928 04:10:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:57.928 04:10:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:57.928 04:10:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:57.928 04:10:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:57.929 04:10:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:57.929 04:10:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:57.929 04:10:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:57.929 04:10:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:57.929 04:10:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:57.929 04:10:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:57.929 04:10:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:57.929 04:10:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:57.929 04:10:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:57.929 04:10:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:57.929 04:10:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:57.929 04:10:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:57.929 04:10:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:57.929 04:10:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:57.929 04:10:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:57.929 04:10:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:57.929 04:10:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:57.929 04:10:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:57.929 04:10:12 -- paths/export.sh@5 -- # export PATH 00:12:57.929 04:10:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:57.929 04:10:12 -- nvmf/common.sh@46 -- # : 0 00:12:57.929 04:10:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:57.929 04:10:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:57.929 04:10:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:57.929 04:10:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:57.929 04:10:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:57.929 04:10:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:57.929 04:10:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:57.929 04:10:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:57.929 04:10:12 -- target/rpc.sh@11 -- # loops=5 00:12:57.929 04:10:12 -- target/rpc.sh@23 -- # nvmftestinit 00:12:57.929 04:10:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:57.929 04:10:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:57.929 04:10:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:57.929 04:10:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:57.929 04:10:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:57.929 04:10:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:57.929 04:10:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:57.929 04:10:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:57.929 04:10:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:57.929 04:10:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:57.929 04:10:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:57.929 04:10:12 -- common/autotest_common.sh@10 -- # set +x 00:13:04.518 04:10:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:04.518 04:10:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:04.518 04:10:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:04.518 04:10:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:04.518 04:10:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:04.518 04:10:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:04.518 04:10:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:04.518 04:10:18 -- nvmf/common.sh@294 -- # net_devs=() 00:13:04.518 04:10:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:04.518 04:10:18 -- nvmf/common.sh@295 -- # e810=() 00:13:04.518 04:10:18 -- nvmf/common.sh@295 -- # local -ga e810 00:13:04.518 04:10:18 -- nvmf/common.sh@296 -- # x722=() 00:13:04.518 04:10:18 -- nvmf/common.sh@296 -- # local -ga x722 00:13:04.518 04:10:18 -- nvmf/common.sh@297 -- # mlx=() 00:13:04.518 04:10:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:04.518 04:10:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:04.518 04:10:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:04.518 04:10:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:04.518 04:10:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:04.518 04:10:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:04.518 04:10:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:13:04.518 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:13:04.518 04:10:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:04.518 04:10:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:13:04.518 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:13:04.518 04:10:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:04.518 04:10:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:04.518 04:10:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:04.518 04:10:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:04.518 04:10:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:04.518 04:10:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:13:04.518 Found net devices under 0000:4b:00.0: cvl_0_0 00:13:04.518 04:10:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:04.518 04:10:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:04.518 04:10:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:04.518 04:10:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:04.518 04:10:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:04.518 04:10:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:13:04.518 Found net devices under 0000:4b:00.1: cvl_0_1 00:13:04.518 04:10:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:04.518 04:10:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:04.518 04:10:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:04.518 04:10:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:04.518 04:10:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:04.518 04:10:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:04.518 04:10:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:04.518 04:10:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:04.518 04:10:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:04.518 04:10:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:04.518 04:10:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:04.518 04:10:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:04.518 04:10:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:04.518 04:10:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:04.518 04:10:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:04.518 04:10:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:04.518 04:10:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:04.518 04:10:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:04.518 04:10:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:04.518 04:10:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:04.518 04:10:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:04.518 04:10:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:04.781 04:10:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:04.781 04:10:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:04.781 04:10:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:04.781 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:04.781 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.674 ms 00:13:04.781 00:13:04.781 --- 10.0.0.2 ping statistics --- 00:13:04.781 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:04.781 rtt min/avg/max/mdev = 0.674/0.674/0.674/0.000 ms 00:13:04.781 04:10:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:04.781 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:04.781 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.402 ms 00:13:04.781 00:13:04.781 --- 10.0.0.1 ping statistics --- 00:13:04.781 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:04.781 rtt min/avg/max/mdev = 0.402/0.402/0.402/0.000 ms 00:13:04.781 04:10:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:04.781 04:10:19 -- nvmf/common.sh@410 -- # return 0 00:13:04.781 04:10:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:04.781 04:10:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:04.781 04:10:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:04.781 04:10:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:04.781 04:10:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:04.781 04:10:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:04.781 04:10:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:04.781 04:10:19 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:04.781 04:10:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:04.781 04:10:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:04.781 04:10:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.781 04:10:19 -- nvmf/common.sh@469 -- # nvmfpid=3840184 00:13:04.781 04:10:19 -- nvmf/common.sh@470 -- # waitforlisten 3840184 00:13:04.781 04:10:19 -- common/autotest_common.sh@819 -- # '[' -z 3840184 ']' 00:13:04.781 04:10:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:04.781 04:10:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:04.781 04:10:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:04.781 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:04.781 04:10:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:04.781 04:10:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.781 04:10:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:04.781 [2024-05-14 04:10:19.315229] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:13:04.781 [2024-05-14 04:10:19.315283] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:04.781 EAL: No free 2048 kB hugepages reported on node 1 00:13:05.042 [2024-05-14 04:10:19.384133] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:05.042 [2024-05-14 04:10:19.455348] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:05.042 [2024-05-14 04:10:19.455486] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:05.042 [2024-05-14 04:10:19.455496] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:05.042 [2024-05-14 04:10:19.455504] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:05.042 [2024-05-14 04:10:19.455573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:05.042 [2024-05-14 04:10:19.455688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:05.042 [2024-05-14 04:10:19.455844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:05.042 [2024-05-14 04:10:19.455845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:05.615 04:10:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:05.615 04:10:20 -- common/autotest_common.sh@852 -- # return 0 00:13:05.615 04:10:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:05.615 04:10:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:05.615 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:05.615 04:10:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:05.615 04:10:20 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:05.615 04:10:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.615 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:05.615 04:10:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.615 04:10:20 -- target/rpc.sh@26 -- # stats='{ 00:13:05.615 "tick_rate": 2400000000, 00:13:05.615 "poll_groups": [ 00:13:05.615 { 00:13:05.615 "name": "nvmf_tgt_poll_group_0", 00:13:05.615 "admin_qpairs": 0, 00:13:05.615 "io_qpairs": 0, 00:13:05.615 "current_admin_qpairs": 0, 00:13:05.615 "current_io_qpairs": 0, 00:13:05.615 "pending_bdev_io": 0, 00:13:05.615 "completed_nvme_io": 0, 00:13:05.615 "transports": [] 00:13:05.615 }, 00:13:05.615 { 00:13:05.615 "name": "nvmf_tgt_poll_group_1", 00:13:05.615 "admin_qpairs": 0, 00:13:05.615 "io_qpairs": 0, 00:13:05.615 "current_admin_qpairs": 0, 00:13:05.615 "current_io_qpairs": 0, 00:13:05.615 "pending_bdev_io": 0, 00:13:05.615 "completed_nvme_io": 0, 00:13:05.615 "transports": [] 00:13:05.615 }, 00:13:05.615 { 00:13:05.615 "name": "nvmf_tgt_poll_group_2", 00:13:05.615 "admin_qpairs": 0, 00:13:05.615 "io_qpairs": 0, 00:13:05.615 "current_admin_qpairs": 0, 00:13:05.615 "current_io_qpairs": 0, 00:13:05.615 "pending_bdev_io": 0, 00:13:05.615 "completed_nvme_io": 0, 00:13:05.615 "transports": [] 00:13:05.615 }, 00:13:05.615 { 00:13:05.615 "name": "nvmf_tgt_poll_group_3", 00:13:05.615 "admin_qpairs": 0, 00:13:05.615 "io_qpairs": 0, 00:13:05.615 "current_admin_qpairs": 0, 00:13:05.615 "current_io_qpairs": 0, 00:13:05.615 "pending_bdev_io": 0, 00:13:05.615 "completed_nvme_io": 0, 00:13:05.615 "transports": [] 00:13:05.615 } 00:13:05.615 ] 00:13:05.615 }' 00:13:05.615 04:10:20 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:05.615 04:10:20 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:05.615 04:10:20 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:05.615 04:10:20 -- target/rpc.sh@15 -- # wc -l 00:13:05.615 04:10:20 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:05.615 04:10:20 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:05.877 04:10:20 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:05.877 04:10:20 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:05.877 04:10:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.877 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:05.877 [2024-05-14 04:10:20.234991] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:05.877 04:10:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.877 04:10:20 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:05.877 04:10:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.877 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:05.877 04:10:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.877 04:10:20 -- target/rpc.sh@33 -- # stats='{ 00:13:05.877 "tick_rate": 2400000000, 00:13:05.877 "poll_groups": [ 00:13:05.877 { 00:13:05.877 "name": "nvmf_tgt_poll_group_0", 00:13:05.877 "admin_qpairs": 0, 00:13:05.877 "io_qpairs": 0, 00:13:05.877 "current_admin_qpairs": 0, 00:13:05.877 "current_io_qpairs": 0, 00:13:05.877 "pending_bdev_io": 0, 00:13:05.877 "completed_nvme_io": 0, 00:13:05.877 "transports": [ 00:13:05.877 { 00:13:05.877 "trtype": "TCP" 00:13:05.877 } 00:13:05.877 ] 00:13:05.877 }, 00:13:05.877 { 00:13:05.877 "name": "nvmf_tgt_poll_group_1", 00:13:05.877 "admin_qpairs": 0, 00:13:05.877 "io_qpairs": 0, 00:13:05.877 "current_admin_qpairs": 0, 00:13:05.877 "current_io_qpairs": 0, 00:13:05.877 "pending_bdev_io": 0, 00:13:05.877 "completed_nvme_io": 0, 00:13:05.877 "transports": [ 00:13:05.877 { 00:13:05.877 "trtype": "TCP" 00:13:05.877 } 00:13:05.877 ] 00:13:05.877 }, 00:13:05.877 { 00:13:05.877 "name": "nvmf_tgt_poll_group_2", 00:13:05.877 "admin_qpairs": 0, 00:13:05.877 "io_qpairs": 0, 00:13:05.877 "current_admin_qpairs": 0, 00:13:05.877 "current_io_qpairs": 0, 00:13:05.877 "pending_bdev_io": 0, 00:13:05.877 "completed_nvme_io": 0, 00:13:05.877 "transports": [ 00:13:05.877 { 00:13:05.877 "trtype": "TCP" 00:13:05.877 } 00:13:05.877 ] 00:13:05.877 }, 00:13:05.877 { 00:13:05.877 "name": "nvmf_tgt_poll_group_3", 00:13:05.877 "admin_qpairs": 0, 00:13:05.877 "io_qpairs": 0, 00:13:05.877 "current_admin_qpairs": 0, 00:13:05.877 "current_io_qpairs": 0, 00:13:05.877 "pending_bdev_io": 0, 00:13:05.877 "completed_nvme_io": 0, 00:13:05.877 "transports": [ 00:13:05.877 { 00:13:05.877 "trtype": "TCP" 00:13:05.877 } 00:13:05.877 ] 00:13:05.877 } 00:13:05.877 ] 00:13:05.877 }' 00:13:05.877 04:10:20 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:05.877 04:10:20 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:05.877 04:10:20 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:05.877 04:10:20 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:05.877 04:10:20 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:05.877 04:10:20 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:05.877 04:10:20 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:05.877 04:10:20 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:05.877 04:10:20 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:05.877 04:10:20 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:05.877 04:10:20 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:05.877 04:10:20 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:05.877 04:10:20 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:05.877 04:10:20 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:05.877 04:10:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.877 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:05.877 Malloc1 00:13:05.877 04:10:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.877 04:10:20 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:05.877 04:10:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.877 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:05.877 04:10:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.877 04:10:20 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:05.877 04:10:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.877 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:05.877 04:10:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.877 04:10:20 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:05.877 04:10:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.877 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:05.877 04:10:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.877 04:10:20 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:05.877 04:10:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.877 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:05.877 [2024-05-14 04:10:20.410617] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:05.877 04:10:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.877 04:10:20 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be -a 10.0.0.2 -s 4420 00:13:05.877 04:10:20 -- common/autotest_common.sh@640 -- # local es=0 00:13:05.877 04:10:20 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be -a 10.0.0.2 -s 4420 00:13:05.877 04:10:20 -- common/autotest_common.sh@628 -- # local arg=nvme 00:13:05.877 04:10:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:05.877 04:10:20 -- common/autotest_common.sh@632 -- # type -t nvme 00:13:05.877 04:10:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:05.877 04:10:20 -- common/autotest_common.sh@634 -- # type -P nvme 00:13:05.877 04:10:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:05.877 04:10:20 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:13:05.877 04:10:20 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:13:05.877 04:10:20 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be -a 10.0.0.2 -s 4420 00:13:05.877 [2024-05-14 04:10:20.445582] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be' 00:13:06.138 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:06.138 could not add new controller: failed to write to nvme-fabrics device 00:13:06.138 04:10:20 -- common/autotest_common.sh@643 -- # es=1 00:13:06.138 04:10:20 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:13:06.138 04:10:20 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:13:06.138 04:10:20 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:13:06.138 04:10:20 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:06.138 04:10:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.138 04:10:20 -- common/autotest_common.sh@10 -- # set +x 00:13:06.138 04:10:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.138 04:10:20 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:07.524 04:10:21 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:07.524 04:10:21 -- common/autotest_common.sh@1177 -- # local i=0 00:13:07.524 04:10:21 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:07.524 04:10:21 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:07.524 04:10:21 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:09.441 04:10:23 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:09.441 04:10:23 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:09.441 04:10:23 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:09.441 04:10:23 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:09.441 04:10:23 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:09.441 04:10:23 -- common/autotest_common.sh@1187 -- # return 0 00:13:09.441 04:10:23 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:09.703 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:09.703 04:10:24 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:09.703 04:10:24 -- common/autotest_common.sh@1198 -- # local i=0 00:13:09.703 04:10:24 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:09.703 04:10:24 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:09.703 04:10:24 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:09.703 04:10:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:09.703 04:10:24 -- common/autotest_common.sh@1210 -- # return 0 00:13:09.703 04:10:24 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:09.703 04:10:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:09.703 04:10:24 -- common/autotest_common.sh@10 -- # set +x 00:13:09.703 04:10:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:09.703 04:10:24 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.703 04:10:24 -- common/autotest_common.sh@640 -- # local es=0 00:13:09.703 04:10:24 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.703 04:10:24 -- common/autotest_common.sh@628 -- # local arg=nvme 00:13:09.703 04:10:24 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:09.703 04:10:24 -- common/autotest_common.sh@632 -- # type -t nvme 00:13:09.703 04:10:24 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:09.703 04:10:24 -- common/autotest_common.sh@634 -- # type -P nvme 00:13:09.703 04:10:24 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:09.703 04:10:24 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:13:09.703 04:10:24 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:13:09.703 04:10:24 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.703 [2024-05-14 04:10:24.132047] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be' 00:13:09.703 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:09.703 could not add new controller: failed to write to nvme-fabrics device 00:13:09.703 04:10:24 -- common/autotest_common.sh@643 -- # es=1 00:13:09.703 04:10:24 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:13:09.703 04:10:24 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:13:09.703 04:10:24 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:13:09.704 04:10:24 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:09.704 04:10:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:09.704 04:10:24 -- common/autotest_common.sh@10 -- # set +x 00:13:09.704 04:10:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:09.704 04:10:24 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:11.118 04:10:25 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:11.118 04:10:25 -- common/autotest_common.sh@1177 -- # local i=0 00:13:11.118 04:10:25 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:11.118 04:10:25 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:11.118 04:10:25 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:13.667 04:10:27 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:13.667 04:10:27 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:13.667 04:10:27 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:13.667 04:10:27 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:13.667 04:10:27 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:13.667 04:10:27 -- common/autotest_common.sh@1187 -- # return 0 00:13:13.667 04:10:27 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:13.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:13.667 04:10:27 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:13.667 04:10:27 -- common/autotest_common.sh@1198 -- # local i=0 00:13:13.667 04:10:27 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:13.667 04:10:27 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:13.667 04:10:27 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:13.667 04:10:27 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:13.667 04:10:27 -- common/autotest_common.sh@1210 -- # return 0 00:13:13.667 04:10:27 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:13.667 04:10:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.667 04:10:27 -- common/autotest_common.sh@10 -- # set +x 00:13:13.667 04:10:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.667 04:10:27 -- target/rpc.sh@81 -- # seq 1 5 00:13:13.667 04:10:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:13.667 04:10:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:13.667 04:10:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.667 04:10:27 -- common/autotest_common.sh@10 -- # set +x 00:13:13.667 04:10:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.667 04:10:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:13.667 04:10:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.667 04:10:27 -- common/autotest_common.sh@10 -- # set +x 00:13:13.667 [2024-05-14 04:10:27.858537] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:13.667 04:10:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.667 04:10:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:13.667 04:10:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.667 04:10:27 -- common/autotest_common.sh@10 -- # set +x 00:13:13.667 04:10:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.667 04:10:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:13.667 04:10:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.667 04:10:27 -- common/autotest_common.sh@10 -- # set +x 00:13:13.667 04:10:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.667 04:10:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:15.052 04:10:29 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:15.052 04:10:29 -- common/autotest_common.sh@1177 -- # local i=0 00:13:15.052 04:10:29 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:15.052 04:10:29 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:15.052 04:10:29 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:16.966 04:10:31 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:16.966 04:10:31 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:16.966 04:10:31 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:16.966 04:10:31 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:16.966 04:10:31 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:16.966 04:10:31 -- common/autotest_common.sh@1187 -- # return 0 00:13:16.966 04:10:31 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:17.227 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:17.227 04:10:31 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:17.227 04:10:31 -- common/autotest_common.sh@1198 -- # local i=0 00:13:17.227 04:10:31 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:17.227 04:10:31 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.227 04:10:31 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:17.227 04:10:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.227 04:10:31 -- common/autotest_common.sh@1210 -- # return 0 00:13:17.227 04:10:31 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:17.227 04:10:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:17.227 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:13:17.227 04:10:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:17.227 04:10:31 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.227 04:10:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:17.227 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:13:17.227 04:10:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:17.227 04:10:31 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:17.227 04:10:31 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:17.227 04:10:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:17.227 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:13:17.227 04:10:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:17.227 04:10:31 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:17.227 04:10:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:17.227 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:13:17.227 [2024-05-14 04:10:31.626263] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:17.227 04:10:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:17.227 04:10:31 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:17.227 04:10:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:17.227 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:13:17.227 04:10:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:17.227 04:10:31 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:17.227 04:10:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:17.227 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:13:17.227 04:10:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:17.227 04:10:31 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:19.145 04:10:33 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:19.145 04:10:33 -- common/autotest_common.sh@1177 -- # local i=0 00:13:19.145 04:10:33 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:19.145 04:10:33 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:19.145 04:10:33 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:21.061 04:10:35 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:21.061 04:10:35 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:21.061 04:10:35 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:21.061 04:10:35 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:21.061 04:10:35 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:21.061 04:10:35 -- common/autotest_common.sh@1187 -- # return 0 00:13:21.061 04:10:35 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:21.061 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:21.061 04:10:35 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:21.061 04:10:35 -- common/autotest_common.sh@1198 -- # local i=0 00:13:21.061 04:10:35 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:21.061 04:10:35 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.061 04:10:35 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:21.061 04:10:35 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.061 04:10:35 -- common/autotest_common.sh@1210 -- # return 0 00:13:21.061 04:10:35 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.061 04:10:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:21.061 04:10:35 -- common/autotest_common.sh@10 -- # set +x 00:13:21.061 04:10:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:21.061 04:10:35 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:21.061 04:10:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:21.061 04:10:35 -- common/autotest_common.sh@10 -- # set +x 00:13:21.061 04:10:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:21.061 04:10:35 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:21.061 04:10:35 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:21.061 04:10:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:21.061 04:10:35 -- common/autotest_common.sh@10 -- # set +x 00:13:21.061 04:10:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:21.061 04:10:35 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:21.061 04:10:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:21.061 04:10:35 -- common/autotest_common.sh@10 -- # set +x 00:13:21.061 [2024-05-14 04:10:35.483232] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:21.061 04:10:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:21.062 04:10:35 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:21.062 04:10:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:21.062 04:10:35 -- common/autotest_common.sh@10 -- # set +x 00:13:21.062 04:10:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:21.062 04:10:35 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:21.062 04:10:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:21.062 04:10:35 -- common/autotest_common.sh@10 -- # set +x 00:13:21.062 04:10:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:21.062 04:10:35 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:22.449 04:10:36 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:22.449 04:10:36 -- common/autotest_common.sh@1177 -- # local i=0 00:13:22.449 04:10:36 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:22.449 04:10:36 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:22.449 04:10:36 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:24.997 04:10:39 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:24.997 04:10:39 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:24.997 04:10:39 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:24.997 04:10:39 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:24.997 04:10:39 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:24.997 04:10:39 -- common/autotest_common.sh@1187 -- # return 0 00:13:24.997 04:10:39 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:24.997 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:24.997 04:10:39 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:24.997 04:10:39 -- common/autotest_common.sh@1198 -- # local i=0 00:13:24.997 04:10:39 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:24.997 04:10:39 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.997 04:10:39 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:24.997 04:10:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.997 04:10:39 -- common/autotest_common.sh@1210 -- # return 0 00:13:24.997 04:10:39 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.997 04:10:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:24.997 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:13:24.997 04:10:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:24.997 04:10:39 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:24.997 04:10:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:24.997 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:13:24.997 04:10:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:24.997 04:10:39 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:24.997 04:10:39 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:24.997 04:10:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:24.997 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:13:24.997 04:10:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:24.997 04:10:39 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:24.997 04:10:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:24.997 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:13:24.997 [2024-05-14 04:10:39.200498] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:24.997 04:10:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:24.997 04:10:39 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:24.997 04:10:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:24.997 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:13:24.997 04:10:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:24.997 04:10:39 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:24.997 04:10:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:24.997 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:13:24.997 04:10:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:24.997 04:10:39 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:26.383 04:10:40 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:26.383 04:10:40 -- common/autotest_common.sh@1177 -- # local i=0 00:13:26.383 04:10:40 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:26.383 04:10:40 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:26.383 04:10:40 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:28.293 04:10:42 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:28.293 04:10:42 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:28.293 04:10:42 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:28.293 04:10:42 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:28.293 04:10:42 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:28.293 04:10:42 -- common/autotest_common.sh@1187 -- # return 0 00:13:28.293 04:10:42 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:28.293 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:28.293 04:10:42 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:28.293 04:10:42 -- common/autotest_common.sh@1198 -- # local i=0 00:13:28.293 04:10:42 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:28.293 04:10:42 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:28.293 04:10:42 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:28.293 04:10:42 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:28.293 04:10:42 -- common/autotest_common.sh@1210 -- # return 0 00:13:28.293 04:10:42 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:28.293 04:10:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.293 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:13:28.293 04:10:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.293 04:10:42 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:28.293 04:10:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.293 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:13:28.293 04:10:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.293 04:10:42 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:28.293 04:10:42 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:28.293 04:10:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.293 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:13:28.553 04:10:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.553 04:10:42 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:28.553 04:10:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.553 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:13:28.554 [2024-05-14 04:10:42.889273] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:28.554 04:10:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.554 04:10:42 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:28.554 04:10:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.554 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:13:28.554 04:10:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.554 04:10:42 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:28.554 04:10:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:28.554 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:13:28.554 04:10:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:28.554 04:10:42 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:29.937 04:10:44 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:29.937 04:10:44 -- common/autotest_common.sh@1177 -- # local i=0 00:13:29.937 04:10:44 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:29.937 04:10:44 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:29.937 04:10:44 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:32.535 04:10:46 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:32.535 04:10:46 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:32.535 04:10:46 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:32.535 04:10:46 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:32.535 04:10:46 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:32.535 04:10:46 -- common/autotest_common.sh@1187 -- # return 0 00:13:32.535 04:10:46 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:32.535 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:32.535 04:10:46 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:32.535 04:10:46 -- common/autotest_common.sh@1198 -- # local i=0 00:13:32.535 04:10:46 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:32.535 04:10:46 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:32.535 04:10:46 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:32.535 04:10:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:32.535 04:10:46 -- common/autotest_common.sh@1210 -- # return 0 00:13:32.535 04:10:46 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@99 -- # seq 1 5 00:13:32.535 04:10:46 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:32.535 04:10:46 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 [2024-05-14 04:10:46.660187] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:32.535 04:10:46 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 [2024-05-14 04:10:46.716287] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:32.535 04:10:46 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 [2024-05-14 04:10:46.776462] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:32.535 04:10:46 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:32.535 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.535 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.535 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.535 04:10:46 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 [2024-05-14 04:10:46.836655] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:32.536 04:10:46 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 [2024-05-14 04:10:46.892844] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:32.536 04:10:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.536 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:13:32.536 04:10:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.536 04:10:46 -- target/rpc.sh@110 -- # stats='{ 00:13:32.536 "tick_rate": 2400000000, 00:13:32.536 "poll_groups": [ 00:13:32.536 { 00:13:32.536 "name": "nvmf_tgt_poll_group_0", 00:13:32.536 "admin_qpairs": 0, 00:13:32.536 "io_qpairs": 224, 00:13:32.536 "current_admin_qpairs": 0, 00:13:32.536 "current_io_qpairs": 0, 00:13:32.536 "pending_bdev_io": 0, 00:13:32.536 "completed_nvme_io": 322, 00:13:32.536 "transports": [ 00:13:32.536 { 00:13:32.536 "trtype": "TCP" 00:13:32.536 } 00:13:32.536 ] 00:13:32.536 }, 00:13:32.536 { 00:13:32.536 "name": "nvmf_tgt_poll_group_1", 00:13:32.536 "admin_qpairs": 1, 00:13:32.536 "io_qpairs": 223, 00:13:32.536 "current_admin_qpairs": 0, 00:13:32.536 "current_io_qpairs": 0, 00:13:32.536 "pending_bdev_io": 0, 00:13:32.536 "completed_nvme_io": 416, 00:13:32.536 "transports": [ 00:13:32.536 { 00:13:32.536 "trtype": "TCP" 00:13:32.536 } 00:13:32.536 ] 00:13:32.536 }, 00:13:32.536 { 00:13:32.536 "name": "nvmf_tgt_poll_group_2", 00:13:32.536 "admin_qpairs": 6, 00:13:32.536 "io_qpairs": 218, 00:13:32.536 "current_admin_qpairs": 0, 00:13:32.536 "current_io_qpairs": 0, 00:13:32.536 "pending_bdev_io": 0, 00:13:32.536 "completed_nvme_io": 277, 00:13:32.536 "transports": [ 00:13:32.536 { 00:13:32.536 "trtype": "TCP" 00:13:32.536 } 00:13:32.536 ] 00:13:32.536 }, 00:13:32.536 { 00:13:32.536 "name": "nvmf_tgt_poll_group_3", 00:13:32.536 "admin_qpairs": 0, 00:13:32.536 "io_qpairs": 224, 00:13:32.536 "current_admin_qpairs": 0, 00:13:32.536 "current_io_qpairs": 0, 00:13:32.536 "pending_bdev_io": 0, 00:13:32.536 "completed_nvme_io": 224, 00:13:32.536 "transports": [ 00:13:32.536 { 00:13:32.536 "trtype": "TCP" 00:13:32.536 } 00:13:32.536 ] 00:13:32.536 } 00:13:32.536 ] 00:13:32.536 }' 00:13:32.536 04:10:46 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:32.536 04:10:46 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:32.536 04:10:46 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:32.536 04:10:46 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:32.536 04:10:47 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:32.536 04:10:47 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:32.536 04:10:47 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:32.536 04:10:47 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:32.536 04:10:47 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:32.536 04:10:47 -- target/rpc.sh@113 -- # (( 889 > 0 )) 00:13:32.536 04:10:47 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:32.536 04:10:47 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:32.536 04:10:47 -- target/rpc.sh@123 -- # nvmftestfini 00:13:32.536 04:10:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:32.536 04:10:47 -- nvmf/common.sh@116 -- # sync 00:13:32.536 04:10:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:32.536 04:10:47 -- nvmf/common.sh@119 -- # set +e 00:13:32.536 04:10:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:32.536 04:10:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:32.536 rmmod nvme_tcp 00:13:32.536 rmmod nvme_fabrics 00:13:32.536 rmmod nvme_keyring 00:13:32.798 04:10:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:32.798 04:10:47 -- nvmf/common.sh@123 -- # set -e 00:13:32.798 04:10:47 -- nvmf/common.sh@124 -- # return 0 00:13:32.798 04:10:47 -- nvmf/common.sh@477 -- # '[' -n 3840184 ']' 00:13:32.798 04:10:47 -- nvmf/common.sh@478 -- # killprocess 3840184 00:13:32.798 04:10:47 -- common/autotest_common.sh@926 -- # '[' -z 3840184 ']' 00:13:32.798 04:10:47 -- common/autotest_common.sh@930 -- # kill -0 3840184 00:13:32.798 04:10:47 -- common/autotest_common.sh@931 -- # uname 00:13:32.798 04:10:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:32.798 04:10:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3840184 00:13:32.798 04:10:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:32.798 04:10:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:32.798 04:10:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3840184' 00:13:32.798 killing process with pid 3840184 00:13:32.798 04:10:47 -- common/autotest_common.sh@945 -- # kill 3840184 00:13:32.798 04:10:47 -- common/autotest_common.sh@950 -- # wait 3840184 00:13:32.799 04:10:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:32.799 04:10:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:32.799 04:10:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:32.799 04:10:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:32.799 04:10:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:32.799 04:10:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:32.799 04:10:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:32.799 04:10:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:35.350 04:10:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:35.350 00:13:35.350 real 0m37.467s 00:13:35.350 user 1m53.377s 00:13:35.350 sys 0m7.217s 00:13:35.350 04:10:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:35.350 04:10:49 -- common/autotest_common.sh@10 -- # set +x 00:13:35.350 ************************************ 00:13:35.350 END TEST nvmf_rpc 00:13:35.350 ************************************ 00:13:35.350 04:10:49 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:35.350 04:10:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:35.350 04:10:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:35.350 04:10:49 -- common/autotest_common.sh@10 -- # set +x 00:13:35.350 ************************************ 00:13:35.350 START TEST nvmf_invalid 00:13:35.350 ************************************ 00:13:35.350 04:10:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:35.350 * Looking for test storage... 00:13:35.350 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:35.350 04:10:49 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:35.350 04:10:49 -- nvmf/common.sh@7 -- # uname -s 00:13:35.350 04:10:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:35.350 04:10:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:35.350 04:10:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:35.350 04:10:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:35.350 04:10:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:35.350 04:10:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:35.350 04:10:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:35.350 04:10:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:35.350 04:10:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:35.350 04:10:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:35.350 04:10:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:35.350 04:10:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:35.350 04:10:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:35.350 04:10:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:35.350 04:10:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:35.350 04:10:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:35.350 04:10:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:35.350 04:10:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:35.350 04:10:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:35.350 04:10:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.350 04:10:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.350 04:10:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.350 04:10:49 -- paths/export.sh@5 -- # export PATH 00:13:35.350 04:10:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.350 04:10:49 -- nvmf/common.sh@46 -- # : 0 00:13:35.350 04:10:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:35.350 04:10:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:35.350 04:10:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:35.350 04:10:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:35.350 04:10:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:35.350 04:10:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:35.350 04:10:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:35.350 04:10:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:35.350 04:10:49 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:35.350 04:10:49 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:35.350 04:10:49 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:35.350 04:10:49 -- target/invalid.sh@14 -- # target=foobar 00:13:35.350 04:10:49 -- target/invalid.sh@16 -- # RANDOM=0 00:13:35.350 04:10:49 -- target/invalid.sh@34 -- # nvmftestinit 00:13:35.350 04:10:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:35.350 04:10:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:35.350 04:10:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:35.350 04:10:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:35.350 04:10:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:35.350 04:10:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:35.350 04:10:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:35.350 04:10:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:35.350 04:10:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:35.350 04:10:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:35.350 04:10:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:35.350 04:10:49 -- common/autotest_common.sh@10 -- # set +x 00:13:41.946 04:10:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:41.946 04:10:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:41.946 04:10:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:41.946 04:10:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:41.946 04:10:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:41.946 04:10:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:41.946 04:10:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:41.946 04:10:56 -- nvmf/common.sh@294 -- # net_devs=() 00:13:41.946 04:10:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:41.946 04:10:56 -- nvmf/common.sh@295 -- # e810=() 00:13:41.946 04:10:56 -- nvmf/common.sh@295 -- # local -ga e810 00:13:41.946 04:10:56 -- nvmf/common.sh@296 -- # x722=() 00:13:41.946 04:10:56 -- nvmf/common.sh@296 -- # local -ga x722 00:13:41.946 04:10:56 -- nvmf/common.sh@297 -- # mlx=() 00:13:41.946 04:10:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:41.946 04:10:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:41.946 04:10:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:41.946 04:10:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:41.946 04:10:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:41.946 04:10:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:41.946 04:10:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:13:41.946 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:13:41.946 04:10:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:41.946 04:10:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:13:41.946 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:13:41.946 04:10:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:41.946 04:10:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:41.946 04:10:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:41.946 04:10:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:41.946 04:10:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:41.946 04:10:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:13:41.946 Found net devices under 0000:4b:00.0: cvl_0_0 00:13:41.946 04:10:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:41.946 04:10:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:41.946 04:10:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:41.946 04:10:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:41.946 04:10:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:41.946 04:10:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:13:41.946 Found net devices under 0000:4b:00.1: cvl_0_1 00:13:41.946 04:10:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:41.946 04:10:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:41.946 04:10:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:41.946 04:10:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:41.946 04:10:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:41.946 04:10:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:41.946 04:10:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:41.946 04:10:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:41.946 04:10:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:41.946 04:10:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:41.946 04:10:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:41.946 04:10:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:41.946 04:10:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:41.946 04:10:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:41.946 04:10:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:41.946 04:10:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:41.946 04:10:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:41.946 04:10:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:42.208 04:10:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:42.208 04:10:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:42.208 04:10:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:42.208 04:10:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:42.208 04:10:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:42.208 04:10:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:42.208 04:10:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:42.208 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:42.208 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.663 ms 00:13:42.208 00:13:42.208 --- 10.0.0.2 ping statistics --- 00:13:42.208 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.208 rtt min/avg/max/mdev = 0.663/0.663/0.663/0.000 ms 00:13:42.208 04:10:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:42.208 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:42.208 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.388 ms 00:13:42.208 00:13:42.208 --- 10.0.0.1 ping statistics --- 00:13:42.208 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.208 rtt min/avg/max/mdev = 0.388/0.388/0.388/0.000 ms 00:13:42.208 04:10:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:42.208 04:10:56 -- nvmf/common.sh@410 -- # return 0 00:13:42.208 04:10:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:42.208 04:10:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:42.208 04:10:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:42.208 04:10:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:42.208 04:10:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:42.208 04:10:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:42.208 04:10:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:42.208 04:10:56 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:42.208 04:10:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:42.208 04:10:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:42.208 04:10:56 -- common/autotest_common.sh@10 -- # set +x 00:13:42.470 04:10:56 -- nvmf/common.sh@469 -- # nvmfpid=3849950 00:13:42.470 04:10:56 -- nvmf/common.sh@470 -- # waitforlisten 3849950 00:13:42.470 04:10:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:42.470 04:10:56 -- common/autotest_common.sh@819 -- # '[' -z 3849950 ']' 00:13:42.470 04:10:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:42.470 04:10:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:42.470 04:10:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:42.470 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:42.470 04:10:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:42.470 04:10:56 -- common/autotest_common.sh@10 -- # set +x 00:13:42.470 [2024-05-14 04:10:56.848123] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:13:42.470 [2024-05-14 04:10:56.848187] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:42.470 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.470 [2024-05-14 04:10:56.920028] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:42.470 [2024-05-14 04:10:56.992619] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:42.470 [2024-05-14 04:10:56.992753] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:42.470 [2024-05-14 04:10:56.992763] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:42.470 [2024-05-14 04:10:56.992772] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:42.470 [2024-05-14 04:10:56.992933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:42.470 [2024-05-14 04:10:56.993048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:42.470 [2024-05-14 04:10:56.993207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:42.470 [2024-05-14 04:10:56.993207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:43.043 04:10:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:43.043 04:10:57 -- common/autotest_common.sh@852 -- # return 0 00:13:43.043 04:10:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:43.043 04:10:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:43.043 04:10:57 -- common/autotest_common.sh@10 -- # set +x 00:13:43.305 04:10:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:43.305 04:10:57 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:43.305 04:10:57 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode16396 00:13:43.305 [2024-05-14 04:10:57.809869] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:43.305 04:10:57 -- target/invalid.sh@40 -- # out='request: 00:13:43.305 { 00:13:43.305 "nqn": "nqn.2016-06.io.spdk:cnode16396", 00:13:43.305 "tgt_name": "foobar", 00:13:43.305 "method": "nvmf_create_subsystem", 00:13:43.305 "req_id": 1 00:13:43.305 } 00:13:43.305 Got JSON-RPC error response 00:13:43.305 response: 00:13:43.305 { 00:13:43.305 "code": -32603, 00:13:43.305 "message": "Unable to find target foobar" 00:13:43.305 }' 00:13:43.305 04:10:57 -- target/invalid.sh@41 -- # [[ request: 00:13:43.305 { 00:13:43.305 "nqn": "nqn.2016-06.io.spdk:cnode16396", 00:13:43.305 "tgt_name": "foobar", 00:13:43.305 "method": "nvmf_create_subsystem", 00:13:43.305 "req_id": 1 00:13:43.305 } 00:13:43.305 Got JSON-RPC error response 00:13:43.305 response: 00:13:43.305 { 00:13:43.305 "code": -32603, 00:13:43.305 "message": "Unable to find target foobar" 00:13:43.305 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:43.305 04:10:57 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:43.305 04:10:57 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode15550 00:13:43.566 [2024-05-14 04:10:57.986454] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15550: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:43.566 04:10:58 -- target/invalid.sh@45 -- # out='request: 00:13:43.566 { 00:13:43.566 "nqn": "nqn.2016-06.io.spdk:cnode15550", 00:13:43.566 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:43.566 "method": "nvmf_create_subsystem", 00:13:43.566 "req_id": 1 00:13:43.566 } 00:13:43.566 Got JSON-RPC error response 00:13:43.566 response: 00:13:43.566 { 00:13:43.566 "code": -32602, 00:13:43.566 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:43.566 }' 00:13:43.566 04:10:58 -- target/invalid.sh@46 -- # [[ request: 00:13:43.566 { 00:13:43.566 "nqn": "nqn.2016-06.io.spdk:cnode15550", 00:13:43.566 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:43.566 "method": "nvmf_create_subsystem", 00:13:43.566 "req_id": 1 00:13:43.566 } 00:13:43.566 Got JSON-RPC error response 00:13:43.566 response: 00:13:43.566 { 00:13:43.566 "code": -32602, 00:13:43.566 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:43.566 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:43.566 04:10:58 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:43.566 04:10:58 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode31628 00:13:43.828 [2024-05-14 04:10:58.159033] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31628: invalid model number 'SPDK_Controller' 00:13:43.828 04:10:58 -- target/invalid.sh@50 -- # out='request: 00:13:43.828 { 00:13:43.828 "nqn": "nqn.2016-06.io.spdk:cnode31628", 00:13:43.828 "model_number": "SPDK_Controller\u001f", 00:13:43.828 "method": "nvmf_create_subsystem", 00:13:43.828 "req_id": 1 00:13:43.828 } 00:13:43.828 Got JSON-RPC error response 00:13:43.828 response: 00:13:43.828 { 00:13:43.828 "code": -32602, 00:13:43.828 "message": "Invalid MN SPDK_Controller\u001f" 00:13:43.828 }' 00:13:43.828 04:10:58 -- target/invalid.sh@51 -- # [[ request: 00:13:43.828 { 00:13:43.828 "nqn": "nqn.2016-06.io.spdk:cnode31628", 00:13:43.828 "model_number": "SPDK_Controller\u001f", 00:13:43.828 "method": "nvmf_create_subsystem", 00:13:43.828 "req_id": 1 00:13:43.828 } 00:13:43.828 Got JSON-RPC error response 00:13:43.828 response: 00:13:43.828 { 00:13:43.828 "code": -32602, 00:13:43.828 "message": "Invalid MN SPDK_Controller\u001f" 00:13:43.828 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:43.828 04:10:58 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:43.828 04:10:58 -- target/invalid.sh@19 -- # local length=21 ll 00:13:43.828 04:10:58 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:43.828 04:10:58 -- target/invalid.sh@21 -- # local chars 00:13:43.828 04:10:58 -- target/invalid.sh@22 -- # local string 00:13:43.828 04:10:58 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:43.828 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.828 04:10:58 -- target/invalid.sh@25 -- # printf %x 126 00:13:43.828 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:13:43.828 04:10:58 -- target/invalid.sh@25 -- # string+='~' 00:13:43.828 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.828 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 115 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=s 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 91 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+='[' 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 55 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=7 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 121 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=y 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 68 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=D 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 104 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=h 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 107 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=k 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 124 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+='|' 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 111 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=o 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 60 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+='<' 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 59 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=';' 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 111 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=o 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 110 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=n 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 117 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=u 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 65 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=A 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 45 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=- 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 57 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x39' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=9 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 33 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+='!' 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 65 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=A 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # printf %x 117 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:43.829 04:10:58 -- target/invalid.sh@25 -- # string+=u 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:43.829 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:43.829 04:10:58 -- target/invalid.sh@28 -- # [[ ~ == \- ]] 00:13:43.829 04:10:58 -- target/invalid.sh@31 -- # echo '~s[7yDhk|o<;onuA-9!Au' 00:13:43.829 04:10:58 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '~s[7yDhk|o<;onuA-9!Au' nqn.2016-06.io.spdk:cnode10020 00:13:44.091 [2024-05-14 04:10:58.488023] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10020: invalid serial number '~s[7yDhk|o<;onuA-9!Au' 00:13:44.091 04:10:58 -- target/invalid.sh@54 -- # out='request: 00:13:44.091 { 00:13:44.091 "nqn": "nqn.2016-06.io.spdk:cnode10020", 00:13:44.091 "serial_number": "~s[7yDhk|o<;onuA-9!Au", 00:13:44.091 "method": "nvmf_create_subsystem", 00:13:44.091 "req_id": 1 00:13:44.091 } 00:13:44.091 Got JSON-RPC error response 00:13:44.091 response: 00:13:44.091 { 00:13:44.091 "code": -32602, 00:13:44.091 "message": "Invalid SN ~s[7yDhk|o<;onuA-9!Au" 00:13:44.091 }' 00:13:44.091 04:10:58 -- target/invalid.sh@55 -- # [[ request: 00:13:44.091 { 00:13:44.091 "nqn": "nqn.2016-06.io.spdk:cnode10020", 00:13:44.091 "serial_number": "~s[7yDhk|o<;onuA-9!Au", 00:13:44.091 "method": "nvmf_create_subsystem", 00:13:44.091 "req_id": 1 00:13:44.091 } 00:13:44.091 Got JSON-RPC error response 00:13:44.091 response: 00:13:44.091 { 00:13:44.091 "code": -32602, 00:13:44.091 "message": "Invalid SN ~s[7yDhk|o<;onuA-9!Au" 00:13:44.091 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:44.091 04:10:58 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:44.091 04:10:58 -- target/invalid.sh@19 -- # local length=41 ll 00:13:44.091 04:10:58 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:44.091 04:10:58 -- target/invalid.sh@21 -- # local chars 00:13:44.091 04:10:58 -- target/invalid.sh@22 -- # local string 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 76 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=L 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 55 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=7 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 108 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=l 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 98 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=b 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 74 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=J 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 77 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=M 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 35 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+='#' 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 88 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=X 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 45 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=- 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 82 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=R 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 71 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=G 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 54 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+=6 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # printf %x 34 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:44.091 04:10:58 -- target/invalid.sh@25 -- # string+='"' 00:13:44.091 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # printf %x 65 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # string+=A 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # printf %x 125 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # string+='}' 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # printf %x 97 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # string+=a 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # printf %x 110 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # string+=n 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # printf %x 119 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # string+=w 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # printf %x 73 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # string+=I 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # printf %x 96 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # string+='`' 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # printf %x 70 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:44.092 04:10:58 -- target/invalid.sh@25 -- # string+=F 00:13:44.092 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 122 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # string+=z 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 108 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # string+=l 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 70 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # string+=F 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 40 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # string+='(' 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 121 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # string+=y 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 77 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # string+=M 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 33 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # string+='!' 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 105 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # string+=i 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 124 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # string+='|' 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.353 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # printf %x 108 00:13:44.353 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+=l 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 71 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+=G 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 117 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+=u 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 92 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+='\' 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 73 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+=I 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 63 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+='?' 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 67 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+=C 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 43 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+=+ 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 59 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+=';' 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 80 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+=P 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # printf %x 93 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:44.354 04:10:58 -- target/invalid.sh@25 -- # string+=']' 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:44.354 04:10:58 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:44.354 04:10:58 -- target/invalid.sh@28 -- # [[ L == \- ]] 00:13:44.354 04:10:58 -- target/invalid.sh@31 -- # echo 'L7lbJM#X-RG6"A}anwI`FzlF(yM!i|lGu\I?C+;P]' 00:13:44.354 04:10:58 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'L7lbJM#X-RG6"A}anwI`FzlF(yM!i|lGu\I?C+;P]' nqn.2016-06.io.spdk:cnode7555 00:13:44.615 [2024-05-14 04:10:58.965504] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7555: invalid model number 'L7lbJM#X-RG6"A}anwI`FzlF(yM!i|lGu\I?C+;P]' 00:13:44.615 04:10:58 -- target/invalid.sh@58 -- # out='request: 00:13:44.615 { 00:13:44.615 "nqn": "nqn.2016-06.io.spdk:cnode7555", 00:13:44.615 "model_number": "L7lbJM#X-RG6\"A}anwI`FzlF(yM!i|lGu\\I?C+;P]", 00:13:44.615 "method": "nvmf_create_subsystem", 00:13:44.615 "req_id": 1 00:13:44.615 } 00:13:44.615 Got JSON-RPC error response 00:13:44.615 response: 00:13:44.615 { 00:13:44.615 "code": -32602, 00:13:44.615 "message": "Invalid MN L7lbJM#X-RG6\"A}anwI`FzlF(yM!i|lGu\\I?C+;P]" 00:13:44.615 }' 00:13:44.615 04:10:58 -- target/invalid.sh@59 -- # [[ request: 00:13:44.615 { 00:13:44.615 "nqn": "nqn.2016-06.io.spdk:cnode7555", 00:13:44.615 "model_number": "L7lbJM#X-RG6\"A}anwI`FzlF(yM!i|lGu\\I?C+;P]", 00:13:44.615 "method": "nvmf_create_subsystem", 00:13:44.615 "req_id": 1 00:13:44.615 } 00:13:44.615 Got JSON-RPC error response 00:13:44.615 response: 00:13:44.615 { 00:13:44.615 "code": -32602, 00:13:44.615 "message": "Invalid MN L7lbJM#X-RG6\"A}anwI`FzlF(yM!i|lGu\\I?C+;P]" 00:13:44.615 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:44.615 04:10:58 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:44.615 [2024-05-14 04:10:59.134142] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:44.615 04:10:59 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:44.876 04:10:59 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:44.876 04:10:59 -- target/invalid.sh@67 -- # echo '' 00:13:44.876 04:10:59 -- target/invalid.sh@67 -- # head -n 1 00:13:44.876 04:10:59 -- target/invalid.sh@67 -- # IP= 00:13:44.876 04:10:59 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:45.137 [2024-05-14 04:10:59.479261] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:45.137 04:10:59 -- target/invalid.sh@69 -- # out='request: 00:13:45.137 { 00:13:45.137 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:45.137 "listen_address": { 00:13:45.137 "trtype": "tcp", 00:13:45.137 "traddr": "", 00:13:45.137 "trsvcid": "4421" 00:13:45.137 }, 00:13:45.137 "method": "nvmf_subsystem_remove_listener", 00:13:45.137 "req_id": 1 00:13:45.137 } 00:13:45.137 Got JSON-RPC error response 00:13:45.137 response: 00:13:45.137 { 00:13:45.137 "code": -32602, 00:13:45.137 "message": "Invalid parameters" 00:13:45.137 }' 00:13:45.137 04:10:59 -- target/invalid.sh@70 -- # [[ request: 00:13:45.137 { 00:13:45.137 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:45.137 "listen_address": { 00:13:45.137 "trtype": "tcp", 00:13:45.137 "traddr": "", 00:13:45.137 "trsvcid": "4421" 00:13:45.137 }, 00:13:45.137 "method": "nvmf_subsystem_remove_listener", 00:13:45.137 "req_id": 1 00:13:45.137 } 00:13:45.137 Got JSON-RPC error response 00:13:45.137 response: 00:13:45.137 { 00:13:45.137 "code": -32602, 00:13:45.137 "message": "Invalid parameters" 00:13:45.137 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:45.137 04:10:59 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7383 -i 0 00:13:45.137 [2024-05-14 04:10:59.647755] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7383: invalid cntlid range [0-65519] 00:13:45.137 04:10:59 -- target/invalid.sh@73 -- # out='request: 00:13:45.137 { 00:13:45.137 "nqn": "nqn.2016-06.io.spdk:cnode7383", 00:13:45.137 "min_cntlid": 0, 00:13:45.137 "method": "nvmf_create_subsystem", 00:13:45.137 "req_id": 1 00:13:45.137 } 00:13:45.137 Got JSON-RPC error response 00:13:45.137 response: 00:13:45.137 { 00:13:45.137 "code": -32602, 00:13:45.137 "message": "Invalid cntlid range [0-65519]" 00:13:45.137 }' 00:13:45.137 04:10:59 -- target/invalid.sh@74 -- # [[ request: 00:13:45.137 { 00:13:45.137 "nqn": "nqn.2016-06.io.spdk:cnode7383", 00:13:45.137 "min_cntlid": 0, 00:13:45.137 "method": "nvmf_create_subsystem", 00:13:45.137 "req_id": 1 00:13:45.137 } 00:13:45.137 Got JSON-RPC error response 00:13:45.137 response: 00:13:45.137 { 00:13:45.137 "code": -32602, 00:13:45.137 "message": "Invalid cntlid range [0-65519]" 00:13:45.137 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:45.137 04:10:59 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode17673 -i 65520 00:13:45.399 [2024-05-14 04:10:59.816284] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17673: invalid cntlid range [65520-65519] 00:13:45.399 04:10:59 -- target/invalid.sh@75 -- # out='request: 00:13:45.399 { 00:13:45.399 "nqn": "nqn.2016-06.io.spdk:cnode17673", 00:13:45.399 "min_cntlid": 65520, 00:13:45.399 "method": "nvmf_create_subsystem", 00:13:45.399 "req_id": 1 00:13:45.399 } 00:13:45.399 Got JSON-RPC error response 00:13:45.399 response: 00:13:45.399 { 00:13:45.399 "code": -32602, 00:13:45.399 "message": "Invalid cntlid range [65520-65519]" 00:13:45.399 }' 00:13:45.399 04:10:59 -- target/invalid.sh@76 -- # [[ request: 00:13:45.399 { 00:13:45.399 "nqn": "nqn.2016-06.io.spdk:cnode17673", 00:13:45.399 "min_cntlid": 65520, 00:13:45.399 "method": "nvmf_create_subsystem", 00:13:45.399 "req_id": 1 00:13:45.399 } 00:13:45.399 Got JSON-RPC error response 00:13:45.399 response: 00:13:45.399 { 00:13:45.399 "code": -32602, 00:13:45.399 "message": "Invalid cntlid range [65520-65519]" 00:13:45.399 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:45.399 04:10:59 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9335 -I 0 00:13:45.661 [2024-05-14 04:10:59.988851] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9335: invalid cntlid range [1-0] 00:13:45.661 04:11:00 -- target/invalid.sh@77 -- # out='request: 00:13:45.661 { 00:13:45.661 "nqn": "nqn.2016-06.io.spdk:cnode9335", 00:13:45.661 "max_cntlid": 0, 00:13:45.661 "method": "nvmf_create_subsystem", 00:13:45.661 "req_id": 1 00:13:45.661 } 00:13:45.661 Got JSON-RPC error response 00:13:45.661 response: 00:13:45.661 { 00:13:45.661 "code": -32602, 00:13:45.662 "message": "Invalid cntlid range [1-0]" 00:13:45.662 }' 00:13:45.662 04:11:00 -- target/invalid.sh@78 -- # [[ request: 00:13:45.662 { 00:13:45.662 "nqn": "nqn.2016-06.io.spdk:cnode9335", 00:13:45.662 "max_cntlid": 0, 00:13:45.662 "method": "nvmf_create_subsystem", 00:13:45.662 "req_id": 1 00:13:45.662 } 00:13:45.662 Got JSON-RPC error response 00:13:45.662 response: 00:13:45.662 { 00:13:45.662 "code": -32602, 00:13:45.662 "message": "Invalid cntlid range [1-0]" 00:13:45.662 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:45.662 04:11:00 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode22404 -I 65520 00:13:45.662 [2024-05-14 04:11:00.161473] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22404: invalid cntlid range [1-65520] 00:13:45.662 04:11:00 -- target/invalid.sh@79 -- # out='request: 00:13:45.662 { 00:13:45.662 "nqn": "nqn.2016-06.io.spdk:cnode22404", 00:13:45.662 "max_cntlid": 65520, 00:13:45.662 "method": "nvmf_create_subsystem", 00:13:45.662 "req_id": 1 00:13:45.662 } 00:13:45.662 Got JSON-RPC error response 00:13:45.662 response: 00:13:45.662 { 00:13:45.662 "code": -32602, 00:13:45.662 "message": "Invalid cntlid range [1-65520]" 00:13:45.662 }' 00:13:45.662 04:11:00 -- target/invalid.sh@80 -- # [[ request: 00:13:45.662 { 00:13:45.662 "nqn": "nqn.2016-06.io.spdk:cnode22404", 00:13:45.662 "max_cntlid": 65520, 00:13:45.662 "method": "nvmf_create_subsystem", 00:13:45.662 "req_id": 1 00:13:45.662 } 00:13:45.662 Got JSON-RPC error response 00:13:45.662 response: 00:13:45.662 { 00:13:45.662 "code": -32602, 00:13:45.662 "message": "Invalid cntlid range [1-65520]" 00:13:45.662 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:45.662 04:11:00 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24932 -i 6 -I 5 00:13:45.923 [2024-05-14 04:11:00.334009] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24932: invalid cntlid range [6-5] 00:13:45.923 04:11:00 -- target/invalid.sh@83 -- # out='request: 00:13:45.923 { 00:13:45.923 "nqn": "nqn.2016-06.io.spdk:cnode24932", 00:13:45.923 "min_cntlid": 6, 00:13:45.923 "max_cntlid": 5, 00:13:45.923 "method": "nvmf_create_subsystem", 00:13:45.923 "req_id": 1 00:13:45.923 } 00:13:45.923 Got JSON-RPC error response 00:13:45.923 response: 00:13:45.923 { 00:13:45.923 "code": -32602, 00:13:45.923 "message": "Invalid cntlid range [6-5]" 00:13:45.923 }' 00:13:45.923 04:11:00 -- target/invalid.sh@84 -- # [[ request: 00:13:45.923 { 00:13:45.923 "nqn": "nqn.2016-06.io.spdk:cnode24932", 00:13:45.923 "min_cntlid": 6, 00:13:45.923 "max_cntlid": 5, 00:13:45.923 "method": "nvmf_create_subsystem", 00:13:45.923 "req_id": 1 00:13:45.923 } 00:13:45.923 Got JSON-RPC error response 00:13:45.923 response: 00:13:45.923 { 00:13:45.923 "code": -32602, 00:13:45.923 "message": "Invalid cntlid range [6-5]" 00:13:45.923 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:45.923 04:11:00 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:45.923 04:11:00 -- target/invalid.sh@87 -- # out='request: 00:13:45.923 { 00:13:45.923 "name": "foobar", 00:13:45.923 "method": "nvmf_delete_target", 00:13:45.923 "req_id": 1 00:13:45.923 } 00:13:45.923 Got JSON-RPC error response 00:13:45.923 response: 00:13:45.923 { 00:13:45.923 "code": -32602, 00:13:45.923 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:45.923 }' 00:13:45.923 04:11:00 -- target/invalid.sh@88 -- # [[ request: 00:13:45.923 { 00:13:45.923 "name": "foobar", 00:13:45.923 "method": "nvmf_delete_target", 00:13:45.923 "req_id": 1 00:13:45.923 } 00:13:45.923 Got JSON-RPC error response 00:13:45.923 response: 00:13:45.923 { 00:13:45.923 "code": -32602, 00:13:45.923 "message": "The specified target doesn't exist, cannot delete it." 00:13:45.923 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:45.923 04:11:00 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:45.923 04:11:00 -- target/invalid.sh@91 -- # nvmftestfini 00:13:45.923 04:11:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:45.923 04:11:00 -- nvmf/common.sh@116 -- # sync 00:13:45.923 04:11:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:45.923 04:11:00 -- nvmf/common.sh@119 -- # set +e 00:13:45.923 04:11:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:45.923 04:11:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:45.923 rmmod nvme_tcp 00:13:45.923 rmmod nvme_fabrics 00:13:46.185 rmmod nvme_keyring 00:13:46.185 04:11:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:46.185 04:11:00 -- nvmf/common.sh@123 -- # set -e 00:13:46.185 04:11:00 -- nvmf/common.sh@124 -- # return 0 00:13:46.185 04:11:00 -- nvmf/common.sh@477 -- # '[' -n 3849950 ']' 00:13:46.185 04:11:00 -- nvmf/common.sh@478 -- # killprocess 3849950 00:13:46.185 04:11:00 -- common/autotest_common.sh@926 -- # '[' -z 3849950 ']' 00:13:46.185 04:11:00 -- common/autotest_common.sh@930 -- # kill -0 3849950 00:13:46.185 04:11:00 -- common/autotest_common.sh@931 -- # uname 00:13:46.185 04:11:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:46.185 04:11:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3849950 00:13:46.185 04:11:00 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:46.185 04:11:00 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:46.185 04:11:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3849950' 00:13:46.185 killing process with pid 3849950 00:13:46.185 04:11:00 -- common/autotest_common.sh@945 -- # kill 3849950 00:13:46.185 04:11:00 -- common/autotest_common.sh@950 -- # wait 3849950 00:13:46.185 04:11:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:46.185 04:11:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:46.185 04:11:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:46.185 04:11:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:46.185 04:11:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:46.185 04:11:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:46.185 04:11:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:46.185 04:11:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:48.733 04:11:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:48.733 00:13:48.733 real 0m13.356s 00:13:48.733 user 0m19.097s 00:13:48.733 sys 0m6.301s 00:13:48.733 04:11:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:48.733 04:11:02 -- common/autotest_common.sh@10 -- # set +x 00:13:48.733 ************************************ 00:13:48.733 END TEST nvmf_invalid 00:13:48.733 ************************************ 00:13:48.733 04:11:02 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:48.733 04:11:02 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:48.733 04:11:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:48.733 04:11:02 -- common/autotest_common.sh@10 -- # set +x 00:13:48.733 ************************************ 00:13:48.733 START TEST nvmf_abort 00:13:48.733 ************************************ 00:13:48.733 04:11:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:48.733 * Looking for test storage... 00:13:48.733 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:48.733 04:11:02 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:48.733 04:11:02 -- nvmf/common.sh@7 -- # uname -s 00:13:48.733 04:11:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:48.733 04:11:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:48.733 04:11:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:48.733 04:11:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:48.733 04:11:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:48.733 04:11:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:48.733 04:11:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:48.733 04:11:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:48.733 04:11:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:48.733 04:11:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:48.733 04:11:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:48.733 04:11:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:48.733 04:11:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:48.733 04:11:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:48.733 04:11:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:48.733 04:11:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:48.733 04:11:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:48.733 04:11:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:48.733 04:11:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:48.733 04:11:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.733 04:11:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.733 04:11:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.733 04:11:02 -- paths/export.sh@5 -- # export PATH 00:13:48.733 04:11:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.733 04:11:02 -- nvmf/common.sh@46 -- # : 0 00:13:48.733 04:11:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:48.733 04:11:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:48.733 04:11:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:48.733 04:11:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:48.733 04:11:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:48.733 04:11:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:48.733 04:11:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:48.733 04:11:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:48.733 04:11:02 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:48.733 04:11:02 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:48.733 04:11:02 -- target/abort.sh@14 -- # nvmftestinit 00:13:48.733 04:11:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:48.733 04:11:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:48.733 04:11:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:48.733 04:11:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:48.733 04:11:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:48.733 04:11:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:48.733 04:11:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:48.733 04:11:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:48.733 04:11:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:48.733 04:11:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:48.733 04:11:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:48.733 04:11:03 -- common/autotest_common.sh@10 -- # set +x 00:13:55.329 04:11:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:55.329 04:11:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:55.329 04:11:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:55.329 04:11:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:55.329 04:11:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:55.329 04:11:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:55.329 04:11:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:55.329 04:11:09 -- nvmf/common.sh@294 -- # net_devs=() 00:13:55.329 04:11:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:55.329 04:11:09 -- nvmf/common.sh@295 -- # e810=() 00:13:55.329 04:11:09 -- nvmf/common.sh@295 -- # local -ga e810 00:13:55.329 04:11:09 -- nvmf/common.sh@296 -- # x722=() 00:13:55.329 04:11:09 -- nvmf/common.sh@296 -- # local -ga x722 00:13:55.329 04:11:09 -- nvmf/common.sh@297 -- # mlx=() 00:13:55.329 04:11:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:55.329 04:11:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:55.329 04:11:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:55.329 04:11:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:55.329 04:11:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:55.329 04:11:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.329 04:11:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:13:55.329 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:13:55.329 04:11:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.329 04:11:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:13:55.329 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:13:55.329 04:11:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:55.329 04:11:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.329 04:11:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.329 04:11:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.329 04:11:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.329 04:11:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:13:55.329 Found net devices under 0000:4b:00.0: cvl_0_0 00:13:55.329 04:11:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.329 04:11:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.329 04:11:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.329 04:11:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.329 04:11:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.329 04:11:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:13:55.329 Found net devices under 0000:4b:00.1: cvl_0_1 00:13:55.329 04:11:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.329 04:11:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:55.329 04:11:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:55.329 04:11:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:55.329 04:11:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:55.329 04:11:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:55.329 04:11:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:55.329 04:11:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:55.329 04:11:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:55.329 04:11:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:55.329 04:11:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:55.329 04:11:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:55.329 04:11:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:55.329 04:11:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:55.329 04:11:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:55.329 04:11:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:55.329 04:11:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:55.329 04:11:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:55.591 04:11:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:55.591 04:11:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:55.591 04:11:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:55.591 04:11:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:55.591 04:11:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:55.591 04:11:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:55.591 04:11:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:55.591 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:55.591 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.502 ms 00:13:55.591 00:13:55.591 --- 10.0.0.2 ping statistics --- 00:13:55.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.591 rtt min/avg/max/mdev = 0.502/0.502/0.502/0.000 ms 00:13:55.591 04:11:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:55.853 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:55.853 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.455 ms 00:13:55.853 00:13:55.853 --- 10.0.0.1 ping statistics --- 00:13:55.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.853 rtt min/avg/max/mdev = 0.455/0.455/0.455/0.000 ms 00:13:55.853 04:11:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:55.853 04:11:10 -- nvmf/common.sh@410 -- # return 0 00:13:55.853 04:11:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:55.853 04:11:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:55.853 04:11:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:55.853 04:11:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:55.853 04:11:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:55.853 04:11:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:55.853 04:11:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:55.853 04:11:10 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:55.853 04:11:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:55.853 04:11:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:55.853 04:11:10 -- common/autotest_common.sh@10 -- # set +x 00:13:55.853 04:11:10 -- nvmf/common.sh@469 -- # nvmfpid=3855105 00:13:55.853 04:11:10 -- nvmf/common.sh@470 -- # waitforlisten 3855105 00:13:55.853 04:11:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:55.853 04:11:10 -- common/autotest_common.sh@819 -- # '[' -z 3855105 ']' 00:13:55.853 04:11:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:55.853 04:11:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:55.853 04:11:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:55.853 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:55.853 04:11:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:55.853 04:11:10 -- common/autotest_common.sh@10 -- # set +x 00:13:55.853 [2024-05-14 04:11:10.285626] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:13:55.853 [2024-05-14 04:11:10.285689] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:55.853 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.853 [2024-05-14 04:11:10.373415] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:56.113 [2024-05-14 04:11:10.466436] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:56.113 [2024-05-14 04:11:10.466616] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:56.113 [2024-05-14 04:11:10.466628] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:56.113 [2024-05-14 04:11:10.466637] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:56.113 [2024-05-14 04:11:10.466770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:56.113 [2024-05-14 04:11:10.466936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:56.113 [2024-05-14 04:11:10.466938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:56.685 04:11:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:56.685 04:11:11 -- common/autotest_common.sh@852 -- # return 0 00:13:56.685 04:11:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:56.685 04:11:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:56.685 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:13:56.685 04:11:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:56.685 04:11:11 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:56.685 04:11:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.685 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:13:56.685 [2024-05-14 04:11:11.108534] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:56.685 04:11:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.685 04:11:11 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:56.685 04:11:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.685 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:13:56.685 Malloc0 00:13:56.685 04:11:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.685 04:11:11 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:56.685 04:11:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.685 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:13:56.685 Delay0 00:13:56.685 04:11:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.685 04:11:11 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:56.685 04:11:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.685 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:13:56.685 04:11:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.685 04:11:11 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:56.685 04:11:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.685 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:13:56.685 04:11:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.685 04:11:11 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:56.685 04:11:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.685 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:13:56.685 [2024-05-14 04:11:11.191209] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.685 04:11:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.685 04:11:11 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:56.685 04:11:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.685 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:13:56.685 04:11:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.685 04:11:11 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:56.685 EAL: No free 2048 kB hugepages reported on node 1 00:13:56.685 [2024-05-14 04:11:11.270657] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:59.234 Initializing NVMe Controllers 00:13:59.234 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:59.234 controller IO queue size 128 less than required 00:13:59.234 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:59.234 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:59.234 Initialization complete. Launching workers. 00:13:59.234 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 27037 00:13:59.234 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 27102, failed to submit 62 00:13:59.234 success 27037, unsuccess 65, failed 0 00:13:59.234 04:11:13 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:59.234 04:11:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:59.234 04:11:13 -- common/autotest_common.sh@10 -- # set +x 00:13:59.234 04:11:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:59.234 04:11:13 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:59.234 04:11:13 -- target/abort.sh@38 -- # nvmftestfini 00:13:59.234 04:11:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:59.234 04:11:13 -- nvmf/common.sh@116 -- # sync 00:13:59.234 04:11:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:59.234 04:11:13 -- nvmf/common.sh@119 -- # set +e 00:13:59.234 04:11:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:59.234 04:11:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:59.234 rmmod nvme_tcp 00:13:59.234 rmmod nvme_fabrics 00:13:59.234 rmmod nvme_keyring 00:13:59.234 04:11:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:59.234 04:11:13 -- nvmf/common.sh@123 -- # set -e 00:13:59.234 04:11:13 -- nvmf/common.sh@124 -- # return 0 00:13:59.234 04:11:13 -- nvmf/common.sh@477 -- # '[' -n 3855105 ']' 00:13:59.234 04:11:13 -- nvmf/common.sh@478 -- # killprocess 3855105 00:13:59.234 04:11:13 -- common/autotest_common.sh@926 -- # '[' -z 3855105 ']' 00:13:59.234 04:11:13 -- common/autotest_common.sh@930 -- # kill -0 3855105 00:13:59.234 04:11:13 -- common/autotest_common.sh@931 -- # uname 00:13:59.234 04:11:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:59.234 04:11:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3855105 00:13:59.234 04:11:13 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:59.234 04:11:13 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:59.234 04:11:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3855105' 00:13:59.234 killing process with pid 3855105 00:13:59.234 04:11:13 -- common/autotest_common.sh@945 -- # kill 3855105 00:13:59.234 04:11:13 -- common/autotest_common.sh@950 -- # wait 3855105 00:13:59.234 04:11:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:59.234 04:11:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:59.234 04:11:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:59.234 04:11:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:59.234 04:11:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:59.234 04:11:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:59.234 04:11:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:59.234 04:11:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.780 04:11:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:01.780 00:14:01.780 real 0m12.882s 00:14:01.780 user 0m13.278s 00:14:01.780 sys 0m6.338s 00:14:01.780 04:11:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:01.780 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:14:01.780 ************************************ 00:14:01.780 END TEST nvmf_abort 00:14:01.780 ************************************ 00:14:01.780 04:11:15 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:01.780 04:11:15 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:01.780 04:11:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:01.780 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:14:01.780 ************************************ 00:14:01.780 START TEST nvmf_ns_hotplug_stress 00:14:01.780 ************************************ 00:14:01.780 04:11:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:01.780 * Looking for test storage... 00:14:01.780 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:01.780 04:11:15 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:01.780 04:11:15 -- nvmf/common.sh@7 -- # uname -s 00:14:01.780 04:11:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:01.780 04:11:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:01.780 04:11:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:01.780 04:11:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:01.780 04:11:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:01.780 04:11:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:01.780 04:11:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:01.780 04:11:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:01.780 04:11:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:01.780 04:11:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:01.780 04:11:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:01.780 04:11:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:01.780 04:11:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:01.780 04:11:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:01.780 04:11:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:01.780 04:11:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:01.780 04:11:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:01.780 04:11:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:01.780 04:11:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:01.780 04:11:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.780 04:11:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.781 04:11:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.781 04:11:15 -- paths/export.sh@5 -- # export PATH 00:14:01.781 04:11:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.781 04:11:15 -- nvmf/common.sh@46 -- # : 0 00:14:01.781 04:11:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:01.781 04:11:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:01.781 04:11:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:01.781 04:11:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:01.781 04:11:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:01.781 04:11:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:01.781 04:11:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:01.781 04:11:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:01.781 04:11:15 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:01.781 04:11:15 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:14:01.781 04:11:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:01.781 04:11:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:01.781 04:11:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:01.781 04:11:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:01.781 04:11:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:01.781 04:11:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:01.781 04:11:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:01.781 04:11:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.781 04:11:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:01.781 04:11:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:01.781 04:11:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:01.781 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:14:08.374 04:11:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:08.374 04:11:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:08.374 04:11:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:08.374 04:11:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:08.374 04:11:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:08.374 04:11:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:08.374 04:11:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:08.374 04:11:22 -- nvmf/common.sh@294 -- # net_devs=() 00:14:08.374 04:11:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:08.374 04:11:22 -- nvmf/common.sh@295 -- # e810=() 00:14:08.374 04:11:22 -- nvmf/common.sh@295 -- # local -ga e810 00:14:08.374 04:11:22 -- nvmf/common.sh@296 -- # x722=() 00:14:08.374 04:11:22 -- nvmf/common.sh@296 -- # local -ga x722 00:14:08.374 04:11:22 -- nvmf/common.sh@297 -- # mlx=() 00:14:08.374 04:11:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:08.374 04:11:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:08.374 04:11:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:08.374 04:11:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:08.374 04:11:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:08.374 04:11:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:08.374 04:11:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:14:08.374 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:14:08.374 04:11:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:08.374 04:11:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:14:08.374 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:14:08.374 04:11:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:08.374 04:11:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:08.374 04:11:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:08.375 04:11:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:08.375 04:11:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:08.375 04:11:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:08.375 04:11:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:08.375 04:11:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:14:08.375 Found net devices under 0000:4b:00.0: cvl_0_0 00:14:08.375 04:11:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:08.375 04:11:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:08.375 04:11:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:08.375 04:11:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:08.375 04:11:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:08.375 04:11:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:14:08.375 Found net devices under 0000:4b:00.1: cvl_0_1 00:14:08.375 04:11:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:08.375 04:11:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:08.375 04:11:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:08.375 04:11:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:08.375 04:11:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:08.375 04:11:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:08.375 04:11:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:08.375 04:11:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:08.375 04:11:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:08.375 04:11:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:08.375 04:11:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:08.375 04:11:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:08.375 04:11:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:08.375 04:11:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:08.375 04:11:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:08.375 04:11:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:08.375 04:11:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:08.375 04:11:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:08.375 04:11:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:08.375 04:11:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:08.375 04:11:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:08.375 04:11:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:08.375 04:11:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:08.636 04:11:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:08.636 04:11:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:08.636 04:11:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:08.636 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:08.636 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.645 ms 00:14:08.636 00:14:08.636 --- 10.0.0.2 ping statistics --- 00:14:08.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:08.636 rtt min/avg/max/mdev = 0.645/0.645/0.645/0.000 ms 00:14:08.637 04:11:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:08.637 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:08.637 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.453 ms 00:14:08.637 00:14:08.637 --- 10.0.0.1 ping statistics --- 00:14:08.637 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:08.637 rtt min/avg/max/mdev = 0.453/0.453/0.453/0.000 ms 00:14:08.637 04:11:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:08.637 04:11:23 -- nvmf/common.sh@410 -- # return 0 00:14:08.637 04:11:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:08.637 04:11:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:08.637 04:11:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:08.637 04:11:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:08.637 04:11:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:08.637 04:11:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:08.637 04:11:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:08.637 04:11:23 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:14:08.637 04:11:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:08.637 04:11:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:08.637 04:11:23 -- common/autotest_common.sh@10 -- # set +x 00:14:08.637 04:11:23 -- nvmf/common.sh@469 -- # nvmfpid=3859863 00:14:08.637 04:11:23 -- nvmf/common.sh@470 -- # waitforlisten 3859863 00:14:08.637 04:11:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:08.637 04:11:23 -- common/autotest_common.sh@819 -- # '[' -z 3859863 ']' 00:14:08.637 04:11:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:08.637 04:11:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:08.637 04:11:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:08.637 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:08.637 04:11:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:08.637 04:11:23 -- common/autotest_common.sh@10 -- # set +x 00:14:08.637 [2024-05-14 04:11:23.126799] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:14:08.637 [2024-05-14 04:11:23.126862] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:08.637 EAL: No free 2048 kB hugepages reported on node 1 00:14:08.637 [2024-05-14 04:11:23.215032] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:08.898 [2024-05-14 04:11:23.306120] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:08.898 [2024-05-14 04:11:23.306307] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:08.898 [2024-05-14 04:11:23.306318] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:08.898 [2024-05-14 04:11:23.306327] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:08.898 [2024-05-14 04:11:23.306515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:08.898 [2024-05-14 04:11:23.306754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:08.898 [2024-05-14 04:11:23.306754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:09.470 04:11:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:09.470 04:11:23 -- common/autotest_common.sh@852 -- # return 0 00:14:09.470 04:11:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:09.470 04:11:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:09.470 04:11:23 -- common/autotest_common.sh@10 -- # set +x 00:14:09.470 04:11:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:09.470 04:11:23 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:14:09.470 04:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:09.731 [2024-05-14 04:11:24.084767] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:09.731 04:11:24 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:09.731 04:11:24 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:09.993 [2024-05-14 04:11:24.422274] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:09.993 04:11:24 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:10.255 04:11:24 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:14:10.255 Malloc0 00:14:10.255 04:11:24 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:10.516 Delay0 00:14:10.516 04:11:24 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.778 04:11:25 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:10.778 NULL1 00:14:10.778 04:11:25 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:11.039 04:11:25 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=3860268 00:14:11.039 04:11:25 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:11.039 04:11:25 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:11.039 04:11:25 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.039 EAL: No free 2048 kB hugepages reported on node 1 00:14:11.983 Read completed with error (sct=0, sc=11) 00:14:12.244 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.244 04:11:26 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.244 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.244 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.244 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.244 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.244 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.244 04:11:26 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:14:12.244 04:11:26 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:12.505 true 00:14:12.505 04:11:26 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:12.506 04:11:26 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.449 04:11:27 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.449 04:11:27 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:14:13.449 04:11:27 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:13.709 true 00:14:13.709 04:11:28 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:13.709 04:11:28 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.709 04:11:28 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.969 04:11:28 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:14:13.969 04:11:28 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:14.229 true 00:14:14.229 04:11:28 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:14.229 04:11:28 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.229 04:11:28 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.489 04:11:28 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:14:14.489 04:11:28 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:14.489 true 00:14:14.489 04:11:29 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:14.489 04:11:29 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.750 04:11:29 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.011 04:11:29 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:14:15.012 04:11:29 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:15.012 true 00:14:15.012 04:11:29 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:15.012 04:11:29 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.276 04:11:29 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.614 04:11:29 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:14:15.614 04:11:29 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:15.614 true 00:14:15.614 04:11:30 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:15.614 04:11:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.874 04:11:30 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.874 04:11:30 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:14:15.874 04:11:30 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:16.135 true 00:14:16.135 04:11:30 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:16.136 04:11:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.136 04:11:30 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.396 04:11:30 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:14:16.396 04:11:30 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:16.657 true 00:14:16.657 04:11:31 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:16.657 04:11:31 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.600 04:11:31 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.600 04:11:32 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:14:17.600 04:11:32 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:17.861 true 00:14:17.861 04:11:32 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:17.861 04:11:32 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.861 04:11:32 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.122 04:11:32 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:14:18.122 04:11:32 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:18.122 true 00:14:18.383 04:11:32 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:18.383 04:11:32 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.383 04:11:32 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.642 04:11:33 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:14:18.642 04:11:33 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:18.642 true 00:14:18.642 04:11:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:18.642 04:11:33 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.902 04:11:33 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.161 04:11:33 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:14:19.161 04:11:33 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:19.161 true 00:14:19.161 04:11:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:19.161 04:11:33 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.420 04:11:33 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.420 04:11:34 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:14:19.420 04:11:34 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:19.681 true 00:14:19.681 04:11:34 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:19.681 04:11:34 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.619 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.619 04:11:35 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.879 04:11:35 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:14:20.879 04:11:35 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:20.879 true 00:14:20.879 04:11:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:20.879 04:11:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.140 04:11:35 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.401 04:11:35 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:14:21.401 04:11:35 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:21.401 true 00:14:21.401 04:11:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:21.401 04:11:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.662 04:11:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.662 04:11:36 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:14:21.662 04:11:36 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:21.922 true 00:14:21.922 04:11:36 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:21.922 04:11:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.183 04:11:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.183 04:11:36 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:14:22.183 04:11:36 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:22.442 true 00:14:22.443 04:11:36 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:22.443 04:11:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.443 04:11:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.702 04:11:37 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:14:22.702 04:11:37 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:22.702 true 00:14:22.962 04:11:37 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:22.962 04:11:37 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.902 04:11:38 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.902 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.902 04:11:38 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:14:23.902 04:11:38 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:24.163 true 00:14:24.163 04:11:38 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:24.163 04:11:38 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.423 04:11:38 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.423 04:11:38 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:14:24.423 04:11:38 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:24.683 true 00:14:24.683 04:11:39 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:24.683 04:11:39 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.943 04:11:39 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.943 04:11:39 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:14:24.943 04:11:39 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:25.203 true 00:14:25.203 04:11:39 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:25.203 04:11:39 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.203 04:11:39 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.463 04:11:39 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:14:25.463 04:11:39 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:25.724 true 00:14:25.724 04:11:40 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:25.724 04:11:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.724 04:11:40 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.985 04:11:40 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:14:25.985 04:11:40 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:26.245 true 00:14:26.245 04:11:40 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:26.245 04:11:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.245 04:11:40 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.507 04:11:40 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:14:26.507 04:11:40 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:26.768 true 00:14:26.768 04:11:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:26.768 04:11:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.768 04:11:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:27.029 04:11:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:14:27.029 04:11:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:27.029 true 00:14:27.289 04:11:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:27.289 04:11:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.289 04:11:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:27.551 04:11:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:14:27.551 04:11:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:27.551 true 00:14:27.551 04:11:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:27.551 04:11:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.812 04:11:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.073 04:11:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:14:28.073 04:11:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:28.073 true 00:14:28.073 04:11:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:28.073 04:11:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.333 04:11:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.594 04:11:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:14:28.594 04:11:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:28.594 true 00:14:28.594 04:11:43 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:28.594 04:11:43 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.855 04:11:43 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.115 04:11:43 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:14:29.115 04:11:43 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:29.115 true 00:14:29.115 04:11:43 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:29.115 04:11:43 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.091 04:11:44 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.091 04:11:44 -- target/ns_hotplug_stress.sh@40 -- # null_size=1030 00:14:30.091 04:11:44 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:14:30.352 true 00:14:30.352 04:11:44 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:30.352 04:11:44 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.613 04:11:44 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.613 04:11:45 -- target/ns_hotplug_stress.sh@40 -- # null_size=1031 00:14:30.613 04:11:45 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1031 00:14:30.874 true 00:14:30.874 04:11:45 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:30.874 04:11:45 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.135 04:11:45 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:31.135 04:11:45 -- target/ns_hotplug_stress.sh@40 -- # null_size=1032 00:14:31.135 04:11:45 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1032 00:14:31.396 true 00:14:31.396 04:11:45 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:31.396 04:11:45 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.657 04:11:45 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:31.657 04:11:46 -- target/ns_hotplug_stress.sh@40 -- # null_size=1033 00:14:31.657 04:11:46 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1033 00:14:31.919 true 00:14:31.919 04:11:46 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:31.919 04:11:46 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.919 04:11:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:32.180 04:11:46 -- target/ns_hotplug_stress.sh@40 -- # null_size=1034 00:14:32.180 04:11:46 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1034 00:14:32.441 true 00:14:32.441 04:11:46 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:32.441 04:11:46 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.441 04:11:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:32.702 04:11:47 -- target/ns_hotplug_stress.sh@40 -- # null_size=1035 00:14:32.702 04:11:47 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1035 00:14:32.702 true 00:14:32.963 04:11:47 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:32.963 04:11:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.963 04:11:47 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:33.224 04:11:47 -- target/ns_hotplug_stress.sh@40 -- # null_size=1036 00:14:33.224 04:11:47 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1036 00:14:33.224 true 00:14:33.224 04:11:47 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:33.224 04:11:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.486 04:11:47 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:33.747 04:11:48 -- target/ns_hotplug_stress.sh@40 -- # null_size=1037 00:14:33.747 04:11:48 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1037 00:14:33.747 true 00:14:33.747 04:11:48 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:33.747 04:11:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.008 04:11:48 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:34.269 04:11:48 -- target/ns_hotplug_stress.sh@40 -- # null_size=1038 00:14:34.269 04:11:48 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1038 00:14:34.269 true 00:14:34.269 04:11:48 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:34.269 04:11:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:35.215 04:11:49 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:35.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:35.476 04:11:49 -- target/ns_hotplug_stress.sh@40 -- # null_size=1039 00:14:35.476 04:11:49 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1039 00:14:35.476 true 00:14:35.476 04:11:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:35.476 04:11:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.737 04:11:50 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:35.998 04:11:50 -- target/ns_hotplug_stress.sh@40 -- # null_size=1040 00:14:35.998 04:11:50 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1040 00:14:35.998 true 00:14:35.998 04:11:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:35.998 04:11:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.258 04:11:50 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:36.519 04:11:50 -- target/ns_hotplug_stress.sh@40 -- # null_size=1041 00:14:36.519 04:11:50 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1041 00:14:36.519 true 00:14:36.519 04:11:51 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:36.519 04:11:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.781 04:11:51 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:36.781 04:11:51 -- target/ns_hotplug_stress.sh@40 -- # null_size=1042 00:14:36.781 04:11:51 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1042 00:14:37.042 true 00:14:37.042 04:11:51 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:37.042 04:11:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.304 04:11:51 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:37.304 04:11:51 -- target/ns_hotplug_stress.sh@40 -- # null_size=1043 00:14:37.304 04:11:51 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1043 00:14:37.565 true 00:14:37.565 04:11:52 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:37.565 04:11:52 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.826 04:11:52 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:37.826 04:11:52 -- target/ns_hotplug_stress.sh@40 -- # null_size=1044 00:14:37.826 04:11:52 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1044 00:14:38.087 true 00:14:38.087 04:11:52 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:38.087 04:11:52 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.347 04:11:52 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:38.347 04:11:52 -- target/ns_hotplug_stress.sh@40 -- # null_size=1045 00:14:38.347 04:11:52 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1045 00:14:38.607 true 00:14:38.607 04:11:53 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:38.607 04:11:53 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.607 04:11:53 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:38.879 04:11:53 -- target/ns_hotplug_stress.sh@40 -- # null_size=1046 00:14:38.879 04:11:53 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1046 00:14:39.163 true 00:14:39.163 04:11:53 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:39.163 04:11:53 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:39.163 04:11:53 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:39.423 04:11:53 -- target/ns_hotplug_stress.sh@40 -- # null_size=1047 00:14:39.423 04:11:53 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1047 00:14:39.423 true 00:14:39.682 04:11:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:39.682 04:11:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:39.682 04:11:54 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:39.942 04:11:54 -- target/ns_hotplug_stress.sh@40 -- # null_size=1048 00:14:39.942 04:11:54 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1048 00:14:39.942 true 00:14:39.942 04:11:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:39.942 04:11:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:40.202 04:11:54 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:40.463 04:11:54 -- target/ns_hotplug_stress.sh@40 -- # null_size=1049 00:14:40.463 04:11:54 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1049 00:14:40.463 true 00:14:40.463 04:11:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:40.463 04:11:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:40.724 04:11:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:40.986 04:11:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1050 00:14:40.986 04:11:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1050 00:14:40.986 true 00:14:40.986 04:11:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:40.986 04:11:55 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:41.247 04:11:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:41.247 Initializing NVMe Controllers 00:14:41.247 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:41.247 Controller IO queue size 128, less than required. 00:14:41.247 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:41.247 Controller IO queue size 128, less than required. 00:14:41.247 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:41.247 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:41.247 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:41.247 Initialization complete. Launching workers. 00:14:41.247 ======================================================== 00:14:41.247 Latency(us) 00:14:41.247 Device Information : IOPS MiB/s Average min max 00:14:41.247 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 392.40 0.19 84312.74 2260.03 1130823.23 00:14:41.247 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 8499.15 4.15 15060.18 2326.21 398724.78 00:14:41.247 ======================================================== 00:14:41.247 Total : 8891.56 4.34 18116.45 2260.03 1130823.23 00:14:41.247 00:14:41.247 04:11:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1051 00:14:41.247 04:11:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1051 00:14:41.508 true 00:14:41.508 04:11:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3860268 00:14:41.508 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (3860268) - No such process 00:14:41.508 04:11:55 -- target/ns_hotplug_stress.sh@44 -- # wait 3860268 00:14:41.508 04:11:55 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:14:41.508 04:11:55 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:14:41.508 04:11:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:41.508 04:11:55 -- nvmf/common.sh@116 -- # sync 00:14:41.508 04:11:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:41.508 04:11:55 -- nvmf/common.sh@119 -- # set +e 00:14:41.508 04:11:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:41.508 04:11:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:41.508 rmmod nvme_tcp 00:14:41.508 rmmod nvme_fabrics 00:14:41.508 rmmod nvme_keyring 00:14:41.508 04:11:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:41.508 04:11:56 -- nvmf/common.sh@123 -- # set -e 00:14:41.508 04:11:56 -- nvmf/common.sh@124 -- # return 0 00:14:41.508 04:11:56 -- nvmf/common.sh@477 -- # '[' -n 3859863 ']' 00:14:41.508 04:11:56 -- nvmf/common.sh@478 -- # killprocess 3859863 00:14:41.508 04:11:56 -- common/autotest_common.sh@926 -- # '[' -z 3859863 ']' 00:14:41.508 04:11:56 -- common/autotest_common.sh@930 -- # kill -0 3859863 00:14:41.508 04:11:56 -- common/autotest_common.sh@931 -- # uname 00:14:41.508 04:11:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:41.508 04:11:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3859863 00:14:41.769 04:11:56 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:41.769 04:11:56 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:41.769 04:11:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3859863' 00:14:41.769 killing process with pid 3859863 00:14:41.769 04:11:56 -- common/autotest_common.sh@945 -- # kill 3859863 00:14:41.769 04:11:56 -- common/autotest_common.sh@950 -- # wait 3859863 00:14:41.769 04:11:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:41.769 04:11:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:41.769 04:11:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:41.769 04:11:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:41.769 04:11:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:41.769 04:11:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.769 04:11:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:41.769 04:11:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:44.314 04:11:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:44.314 00:14:44.314 real 0m42.503s 00:14:44.314 user 2m31.876s 00:14:44.314 sys 0m11.059s 00:14:44.314 04:11:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:44.314 04:11:58 -- common/autotest_common.sh@10 -- # set +x 00:14:44.314 ************************************ 00:14:44.314 END TEST nvmf_ns_hotplug_stress 00:14:44.314 ************************************ 00:14:44.314 04:11:58 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:44.314 04:11:58 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:44.314 04:11:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:44.314 04:11:58 -- common/autotest_common.sh@10 -- # set +x 00:14:44.314 ************************************ 00:14:44.314 START TEST nvmf_connect_stress 00:14:44.314 ************************************ 00:14:44.314 04:11:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:44.314 * Looking for test storage... 00:14:44.314 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:44.314 04:11:58 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:44.314 04:11:58 -- nvmf/common.sh@7 -- # uname -s 00:14:44.314 04:11:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:44.314 04:11:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:44.314 04:11:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:44.314 04:11:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:44.314 04:11:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:44.314 04:11:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:44.314 04:11:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:44.314 04:11:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:44.314 04:11:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:44.314 04:11:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:44.314 04:11:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:44.314 04:11:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:44.314 04:11:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:44.314 04:11:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:44.314 04:11:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:44.314 04:11:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:44.314 04:11:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:44.314 04:11:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:44.314 04:11:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:44.314 04:11:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.314 04:11:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.315 04:11:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.315 04:11:58 -- paths/export.sh@5 -- # export PATH 00:14:44.315 04:11:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.315 04:11:58 -- nvmf/common.sh@46 -- # : 0 00:14:44.315 04:11:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:44.315 04:11:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:44.315 04:11:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:44.315 04:11:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:44.315 04:11:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:44.315 04:11:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:44.315 04:11:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:44.315 04:11:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:44.315 04:11:58 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:44.315 04:11:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:44.315 04:11:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:44.315 04:11:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:44.315 04:11:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:44.315 04:11:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:44.315 04:11:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.315 04:11:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.315 04:11:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:44.315 04:11:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:44.315 04:11:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:44.315 04:11:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:44.315 04:11:58 -- common/autotest_common.sh@10 -- # set +x 00:14:50.942 04:12:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:50.942 04:12:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:50.942 04:12:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:50.942 04:12:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:50.942 04:12:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:50.942 04:12:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:50.942 04:12:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:50.942 04:12:05 -- nvmf/common.sh@294 -- # net_devs=() 00:14:50.942 04:12:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:50.942 04:12:05 -- nvmf/common.sh@295 -- # e810=() 00:14:50.942 04:12:05 -- nvmf/common.sh@295 -- # local -ga e810 00:14:50.942 04:12:05 -- nvmf/common.sh@296 -- # x722=() 00:14:50.942 04:12:05 -- nvmf/common.sh@296 -- # local -ga x722 00:14:50.942 04:12:05 -- nvmf/common.sh@297 -- # mlx=() 00:14:50.943 04:12:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:50.943 04:12:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:50.943 04:12:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:50.943 04:12:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:50.943 04:12:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:50.943 04:12:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:50.943 04:12:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:14:50.943 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:14:50.943 04:12:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:50.943 04:12:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:14:50.943 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:14:50.943 04:12:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:50.943 04:12:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:50.943 04:12:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:50.943 04:12:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:50.943 04:12:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:50.943 04:12:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:14:50.943 Found net devices under 0000:4b:00.0: cvl_0_0 00:14:50.943 04:12:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:50.943 04:12:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:50.943 04:12:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:50.943 04:12:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:50.943 04:12:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:50.943 04:12:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:14:50.943 Found net devices under 0000:4b:00.1: cvl_0_1 00:14:50.943 04:12:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:50.943 04:12:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:50.943 04:12:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:50.943 04:12:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:50.943 04:12:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:50.943 04:12:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:50.943 04:12:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:50.943 04:12:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:50.943 04:12:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:50.943 04:12:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:50.943 04:12:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:50.943 04:12:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:50.943 04:12:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:50.943 04:12:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:50.943 04:12:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:50.943 04:12:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:50.943 04:12:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:50.943 04:12:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:50.943 04:12:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:50.943 04:12:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:50.943 04:12:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:50.943 04:12:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:51.204 04:12:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:51.204 04:12:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:51.204 04:12:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:51.204 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:51.204 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.408 ms 00:14:51.204 00:14:51.204 --- 10.0.0.2 ping statistics --- 00:14:51.204 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:51.204 rtt min/avg/max/mdev = 0.408/0.408/0.408/0.000 ms 00:14:51.204 04:12:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:51.204 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:51.204 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.491 ms 00:14:51.204 00:14:51.204 --- 10.0.0.1 ping statistics --- 00:14:51.204 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:51.204 rtt min/avg/max/mdev = 0.491/0.491/0.491/0.000 ms 00:14:51.204 04:12:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:51.204 04:12:05 -- nvmf/common.sh@410 -- # return 0 00:14:51.204 04:12:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:51.204 04:12:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:51.204 04:12:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:51.204 04:12:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:51.204 04:12:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:51.204 04:12:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:51.204 04:12:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:51.204 04:12:05 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:51.204 04:12:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:51.205 04:12:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:51.205 04:12:05 -- common/autotest_common.sh@10 -- # set +x 00:14:51.205 04:12:05 -- nvmf/common.sh@469 -- # nvmfpid=3870910 00:14:51.205 04:12:05 -- nvmf/common.sh@470 -- # waitforlisten 3870910 00:14:51.205 04:12:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:51.205 04:12:05 -- common/autotest_common.sh@819 -- # '[' -z 3870910 ']' 00:14:51.205 04:12:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:51.205 04:12:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:51.205 04:12:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:51.205 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:51.205 04:12:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:51.205 04:12:05 -- common/autotest_common.sh@10 -- # set +x 00:14:51.205 [2024-05-14 04:12:05.736050] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:14:51.205 [2024-05-14 04:12:05.736106] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:51.205 EAL: No free 2048 kB hugepages reported on node 1 00:14:51.466 [2024-05-14 04:12:05.801692] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:51.466 [2024-05-14 04:12:05.886244] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:51.466 [2024-05-14 04:12:05.886422] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:51.466 [2024-05-14 04:12:05.886436] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:51.466 [2024-05-14 04:12:05.886445] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:51.466 [2024-05-14 04:12:05.886575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:51.466 [2024-05-14 04:12:05.886741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:51.466 [2024-05-14 04:12:05.886742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:52.038 04:12:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:52.038 04:12:06 -- common/autotest_common.sh@852 -- # return 0 00:14:52.038 04:12:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:52.038 04:12:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:52.038 04:12:06 -- common/autotest_common.sh@10 -- # set +x 00:14:52.038 04:12:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:52.038 04:12:06 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:52.038 04:12:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:52.038 04:12:06 -- common/autotest_common.sh@10 -- # set +x 00:14:52.038 [2024-05-14 04:12:06.548265] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:52.038 04:12:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:52.038 04:12:06 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:52.038 04:12:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:52.038 04:12:06 -- common/autotest_common.sh@10 -- # set +x 00:14:52.038 04:12:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:52.038 04:12:06 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:52.038 04:12:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:52.038 04:12:06 -- common/autotest_common.sh@10 -- # set +x 00:14:52.038 [2024-05-14 04:12:06.580453] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:52.038 04:12:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:52.039 04:12:06 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:52.039 04:12:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:52.039 04:12:06 -- common/autotest_common.sh@10 -- # set +x 00:14:52.039 NULL1 00:14:52.039 04:12:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:52.039 04:12:06 -- target/connect_stress.sh@21 -- # PERF_PID=3870943 00:14:52.039 04:12:06 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:52.039 04:12:06 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:52.039 04:12:06 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:52.039 04:12:06 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:52.039 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.039 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.039 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.039 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.039 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.039 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.039 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.039 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 EAL: No free 2048 kB hugepages reported on node 1 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.301 04:12:06 -- target/connect_stress.sh@28 -- # cat 00:14:52.301 04:12:06 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:52.301 04:12:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.301 04:12:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:52.301 04:12:06 -- common/autotest_common.sh@10 -- # set +x 00:14:52.562 04:12:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:52.562 04:12:07 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:52.562 04:12:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.562 04:12:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:52.562 04:12:07 -- common/autotest_common.sh@10 -- # set +x 00:14:52.823 04:12:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:52.823 04:12:07 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:52.823 04:12:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.823 04:12:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:52.823 04:12:07 -- common/autotest_common.sh@10 -- # set +x 00:14:53.394 04:12:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:53.394 04:12:07 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:53.394 04:12:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.394 04:12:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:53.394 04:12:07 -- common/autotest_common.sh@10 -- # set +x 00:14:53.655 04:12:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:53.655 04:12:08 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:53.655 04:12:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.655 04:12:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:53.655 04:12:08 -- common/autotest_common.sh@10 -- # set +x 00:14:53.916 04:12:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:53.916 04:12:08 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:53.916 04:12:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.916 04:12:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:53.916 04:12:08 -- common/autotest_common.sh@10 -- # set +x 00:14:54.177 04:12:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:54.177 04:12:08 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:54.177 04:12:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.177 04:12:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:54.177 04:12:08 -- common/autotest_common.sh@10 -- # set +x 00:14:54.439 04:12:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:54.439 04:12:08 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:54.439 04:12:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.439 04:12:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:54.439 04:12:08 -- common/autotest_common.sh@10 -- # set +x 00:14:55.011 04:12:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:55.011 04:12:09 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:55.011 04:12:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.011 04:12:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:55.011 04:12:09 -- common/autotest_common.sh@10 -- # set +x 00:14:55.272 04:12:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:55.272 04:12:09 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:55.272 04:12:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.272 04:12:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:55.272 04:12:09 -- common/autotest_common.sh@10 -- # set +x 00:14:55.533 04:12:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:55.533 04:12:09 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:55.533 04:12:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.534 04:12:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:55.534 04:12:09 -- common/autotest_common.sh@10 -- # set +x 00:14:55.795 04:12:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:55.795 04:12:10 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:55.795 04:12:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.795 04:12:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:55.795 04:12:10 -- common/autotest_common.sh@10 -- # set +x 00:14:56.057 04:12:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:56.057 04:12:10 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:56.057 04:12:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.057 04:12:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:56.057 04:12:10 -- common/autotest_common.sh@10 -- # set +x 00:14:56.627 04:12:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:56.627 04:12:10 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:56.627 04:12:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.627 04:12:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:56.627 04:12:10 -- common/autotest_common.sh@10 -- # set +x 00:14:56.887 04:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:56.887 04:12:11 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:56.887 04:12:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.887 04:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:56.887 04:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:57.148 04:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:57.148 04:12:11 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:57.148 04:12:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.148 04:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:57.148 04:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:57.409 04:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:57.409 04:12:11 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:57.409 04:12:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.409 04:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:57.409 04:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:57.670 04:12:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:57.671 04:12:12 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:57.671 04:12:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.671 04:12:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:57.671 04:12:12 -- common/autotest_common.sh@10 -- # set +x 00:14:58.242 04:12:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:58.242 04:12:12 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:58.242 04:12:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.242 04:12:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:58.242 04:12:12 -- common/autotest_common.sh@10 -- # set +x 00:14:58.503 04:12:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:58.503 04:12:12 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:58.503 04:12:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.503 04:12:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:58.503 04:12:12 -- common/autotest_common.sh@10 -- # set +x 00:14:58.764 04:12:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:58.764 04:12:13 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:58.764 04:12:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.764 04:12:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:58.764 04:12:13 -- common/autotest_common.sh@10 -- # set +x 00:14:59.025 04:12:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:59.025 04:12:13 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:59.025 04:12:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.025 04:12:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:59.025 04:12:13 -- common/autotest_common.sh@10 -- # set +x 00:14:59.285 04:12:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:59.285 04:12:13 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:59.285 04:12:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.285 04:12:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:59.285 04:12:13 -- common/autotest_common.sh@10 -- # set +x 00:14:59.856 04:12:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:59.856 04:12:14 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:14:59.856 04:12:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.856 04:12:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:59.856 04:12:14 -- common/autotest_common.sh@10 -- # set +x 00:15:00.117 04:12:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:00.117 04:12:14 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:15:00.117 04:12:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.117 04:12:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:00.117 04:12:14 -- common/autotest_common.sh@10 -- # set +x 00:15:00.378 04:12:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:00.378 04:12:14 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:15:00.378 04:12:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.378 04:12:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:00.378 04:12:14 -- common/autotest_common.sh@10 -- # set +x 00:15:00.639 04:12:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:00.639 04:12:15 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:15:00.639 04:12:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.639 04:12:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:00.639 04:12:15 -- common/autotest_common.sh@10 -- # set +x 00:15:01.212 04:12:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:01.212 04:12:15 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:15:01.212 04:12:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.212 04:12:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:01.212 04:12:15 -- common/autotest_common.sh@10 -- # set +x 00:15:01.473 04:12:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:01.473 04:12:15 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:15:01.473 04:12:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.473 04:12:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:01.473 04:12:15 -- common/autotest_common.sh@10 -- # set +x 00:15:01.734 04:12:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:01.734 04:12:16 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:15:01.734 04:12:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.734 04:12:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:01.734 04:12:16 -- common/autotest_common.sh@10 -- # set +x 00:15:01.995 04:12:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:01.995 04:12:16 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:15:01.995 04:12:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.995 04:12:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:01.996 04:12:16 -- common/autotest_common.sh@10 -- # set +x 00:15:02.257 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:02.257 04:12:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.257 04:12:16 -- target/connect_stress.sh@34 -- # kill -0 3870943 00:15:02.257 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3870943) - No such process 00:15:02.257 04:12:16 -- target/connect_stress.sh@38 -- # wait 3870943 00:15:02.257 04:12:16 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:02.257 04:12:16 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:02.257 04:12:16 -- target/connect_stress.sh@43 -- # nvmftestfini 00:15:02.257 04:12:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:02.257 04:12:16 -- nvmf/common.sh@116 -- # sync 00:15:02.257 04:12:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:02.257 04:12:16 -- nvmf/common.sh@119 -- # set +e 00:15:02.257 04:12:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:02.257 04:12:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:02.257 rmmod nvme_tcp 00:15:02.257 rmmod nvme_fabrics 00:15:02.257 rmmod nvme_keyring 00:15:02.532 04:12:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:02.532 04:12:16 -- nvmf/common.sh@123 -- # set -e 00:15:02.532 04:12:16 -- nvmf/common.sh@124 -- # return 0 00:15:02.532 04:12:16 -- nvmf/common.sh@477 -- # '[' -n 3870910 ']' 00:15:02.532 04:12:16 -- nvmf/common.sh@478 -- # killprocess 3870910 00:15:02.532 04:12:16 -- common/autotest_common.sh@926 -- # '[' -z 3870910 ']' 00:15:02.532 04:12:16 -- common/autotest_common.sh@930 -- # kill -0 3870910 00:15:02.532 04:12:16 -- common/autotest_common.sh@931 -- # uname 00:15:02.532 04:12:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:02.532 04:12:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3870910 00:15:02.532 04:12:16 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:02.532 04:12:16 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:02.532 04:12:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3870910' 00:15:02.532 killing process with pid 3870910 00:15:02.532 04:12:16 -- common/autotest_common.sh@945 -- # kill 3870910 00:15:02.532 04:12:16 -- common/autotest_common.sh@950 -- # wait 3870910 00:15:02.532 04:12:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:02.532 04:12:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:02.532 04:12:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:02.532 04:12:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:02.532 04:12:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:02.532 04:12:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:02.532 04:12:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:02.532 04:12:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:05.097 04:12:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:05.097 00:15:05.097 real 0m20.768s 00:15:05.097 user 0m41.635s 00:15:05.097 sys 0m8.806s 00:15:05.097 04:12:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:05.097 04:12:19 -- common/autotest_common.sh@10 -- # set +x 00:15:05.097 ************************************ 00:15:05.097 END TEST nvmf_connect_stress 00:15:05.097 ************************************ 00:15:05.097 04:12:19 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:05.097 04:12:19 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:05.097 04:12:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:05.097 04:12:19 -- common/autotest_common.sh@10 -- # set +x 00:15:05.097 ************************************ 00:15:05.097 START TEST nvmf_fused_ordering 00:15:05.097 ************************************ 00:15:05.097 04:12:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:05.097 * Looking for test storage... 00:15:05.097 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:05.097 04:12:19 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:05.097 04:12:19 -- nvmf/common.sh@7 -- # uname -s 00:15:05.097 04:12:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:05.097 04:12:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:05.097 04:12:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:05.097 04:12:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:05.097 04:12:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:05.097 04:12:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:05.097 04:12:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:05.097 04:12:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:05.097 04:12:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:05.097 04:12:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:05.097 04:12:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:05.097 04:12:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:05.097 04:12:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:05.097 04:12:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:05.097 04:12:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:05.097 04:12:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:05.097 04:12:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:05.097 04:12:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:05.097 04:12:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:05.097 04:12:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.097 04:12:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.097 04:12:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.097 04:12:19 -- paths/export.sh@5 -- # export PATH 00:15:05.097 04:12:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.097 04:12:19 -- nvmf/common.sh@46 -- # : 0 00:15:05.097 04:12:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:05.097 04:12:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:05.097 04:12:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:05.097 04:12:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:05.097 04:12:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:05.097 04:12:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:05.097 04:12:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:05.098 04:12:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:05.098 04:12:19 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:15:05.098 04:12:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:05.098 04:12:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:05.098 04:12:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:05.098 04:12:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:05.098 04:12:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:05.098 04:12:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:05.098 04:12:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:05.098 04:12:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:05.098 04:12:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:05.098 04:12:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:05.098 04:12:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:05.098 04:12:19 -- common/autotest_common.sh@10 -- # set +x 00:15:11.705 04:12:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:11.705 04:12:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:11.705 04:12:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:11.705 04:12:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:11.705 04:12:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:11.705 04:12:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:11.705 04:12:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:11.705 04:12:25 -- nvmf/common.sh@294 -- # net_devs=() 00:15:11.705 04:12:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:11.705 04:12:25 -- nvmf/common.sh@295 -- # e810=() 00:15:11.705 04:12:25 -- nvmf/common.sh@295 -- # local -ga e810 00:15:11.705 04:12:25 -- nvmf/common.sh@296 -- # x722=() 00:15:11.705 04:12:25 -- nvmf/common.sh@296 -- # local -ga x722 00:15:11.705 04:12:25 -- nvmf/common.sh@297 -- # mlx=() 00:15:11.705 04:12:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:11.705 04:12:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:11.705 04:12:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:11.705 04:12:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:11.705 04:12:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:11.705 04:12:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:11.705 04:12:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:15:11.705 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:15:11.705 04:12:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:11.705 04:12:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:15:11.705 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:15:11.705 04:12:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:11.705 04:12:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:11.706 04:12:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:11.706 04:12:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:11.706 04:12:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:11.706 04:12:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:11.706 04:12:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:11.706 04:12:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:11.706 04:12:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:15:11.706 Found net devices under 0000:4b:00.0: cvl_0_0 00:15:11.706 04:12:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:11.706 04:12:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:11.706 04:12:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:11.706 04:12:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:11.706 04:12:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:11.706 04:12:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:15:11.706 Found net devices under 0000:4b:00.1: cvl_0_1 00:15:11.706 04:12:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:11.706 04:12:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:11.706 04:12:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:11.706 04:12:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:11.706 04:12:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:11.706 04:12:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:11.706 04:12:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:11.706 04:12:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:11.706 04:12:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:11.706 04:12:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:11.706 04:12:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:11.706 04:12:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:11.706 04:12:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:11.706 04:12:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:11.706 04:12:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:11.706 04:12:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:11.706 04:12:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:11.706 04:12:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:11.706 04:12:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:11.706 04:12:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:11.706 04:12:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:11.706 04:12:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:11.706 04:12:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:11.706 04:12:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:11.706 04:12:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:11.706 04:12:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:11.706 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:11.706 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.698 ms 00:15:11.706 00:15:11.706 --- 10.0.0.2 ping statistics --- 00:15:11.706 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:11.706 rtt min/avg/max/mdev = 0.698/0.698/0.698/0.000 ms 00:15:11.706 04:12:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:11.706 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:11.706 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.511 ms 00:15:11.706 00:15:11.706 --- 10.0.0.1 ping statistics --- 00:15:11.706 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:11.706 rtt min/avg/max/mdev = 0.511/0.511/0.511/0.000 ms 00:15:11.706 04:12:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:11.706 04:12:26 -- nvmf/common.sh@410 -- # return 0 00:15:11.706 04:12:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:11.706 04:12:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:11.706 04:12:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:11.706 04:12:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:11.706 04:12:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:11.706 04:12:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:11.706 04:12:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:11.706 04:12:26 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:11.706 04:12:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:11.706 04:12:26 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:11.706 04:12:26 -- common/autotest_common.sh@10 -- # set +x 00:15:11.706 04:12:26 -- nvmf/common.sh@469 -- # nvmfpid=3877683 00:15:11.706 04:12:26 -- nvmf/common.sh@470 -- # waitforlisten 3877683 00:15:11.706 04:12:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:11.706 04:12:26 -- common/autotest_common.sh@819 -- # '[' -z 3877683 ']' 00:15:11.706 04:12:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:11.706 04:12:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:11.706 04:12:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:11.706 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:11.706 04:12:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:11.706 04:12:26 -- common/autotest_common.sh@10 -- # set +x 00:15:11.966 [2024-05-14 04:12:26.335746] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:11.966 [2024-05-14 04:12:26.335808] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:11.966 EAL: No free 2048 kB hugepages reported on node 1 00:15:11.966 [2024-05-14 04:12:26.422678] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:11.966 [2024-05-14 04:12:26.513727] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:11.966 [2024-05-14 04:12:26.513896] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:11.966 [2024-05-14 04:12:26.513906] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:11.966 [2024-05-14 04:12:26.513914] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:11.966 [2024-05-14 04:12:26.513946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:12.537 04:12:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:12.537 04:12:27 -- common/autotest_common.sh@852 -- # return 0 00:15:12.537 04:12:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:12.537 04:12:27 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:12.537 04:12:27 -- common/autotest_common.sh@10 -- # set +x 00:15:12.798 04:12:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:12.798 04:12:27 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:12.798 04:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.798 04:12:27 -- common/autotest_common.sh@10 -- # set +x 00:15:12.798 [2024-05-14 04:12:27.170120] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:12.798 04:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.798 04:12:27 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:12.798 04:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.798 04:12:27 -- common/autotest_common.sh@10 -- # set +x 00:15:12.798 04:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.798 04:12:27 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:12.798 04:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.798 04:12:27 -- common/autotest_common.sh@10 -- # set +x 00:15:12.798 [2024-05-14 04:12:27.186371] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:12.798 04:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.798 04:12:27 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:12.798 04:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.798 04:12:27 -- common/autotest_common.sh@10 -- # set +x 00:15:12.798 NULL1 00:15:12.798 04:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.798 04:12:27 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:12.798 04:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.798 04:12:27 -- common/autotest_common.sh@10 -- # set +x 00:15:12.798 04:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.798 04:12:27 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:12.798 04:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:12.798 04:12:27 -- common/autotest_common.sh@10 -- # set +x 00:15:12.798 04:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:12.798 04:12:27 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:12.798 [2024-05-14 04:12:27.243452] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:12.798 [2024-05-14 04:12:27.243521] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3877819 ] 00:15:12.798 EAL: No free 2048 kB hugepages reported on node 1 00:15:13.742 Attached to nqn.2016-06.io.spdk:cnode1 00:15:13.742 Namespace ID: 1 size: 1GB 00:15:13.742 fused_ordering(0) 00:15:13.742 fused_ordering(1) 00:15:13.742 fused_ordering(2) 00:15:13.742 fused_ordering(3) 00:15:13.742 fused_ordering(4) 00:15:13.742 fused_ordering(5) 00:15:13.742 fused_ordering(6) 00:15:13.742 fused_ordering(7) 00:15:13.742 fused_ordering(8) 00:15:13.742 fused_ordering(9) 00:15:13.742 fused_ordering(10) 00:15:13.742 fused_ordering(11) 00:15:13.742 fused_ordering(12) 00:15:13.742 fused_ordering(13) 00:15:13.742 fused_ordering(14) 00:15:13.742 fused_ordering(15) 00:15:13.742 fused_ordering(16) 00:15:13.742 fused_ordering(17) 00:15:13.742 fused_ordering(18) 00:15:13.742 fused_ordering(19) 00:15:13.742 fused_ordering(20) 00:15:13.742 fused_ordering(21) 00:15:13.742 fused_ordering(22) 00:15:13.742 fused_ordering(23) 00:15:13.742 fused_ordering(24) 00:15:13.742 fused_ordering(25) 00:15:13.742 fused_ordering(26) 00:15:13.742 fused_ordering(27) 00:15:13.742 fused_ordering(28) 00:15:13.742 fused_ordering(29) 00:15:13.742 fused_ordering(30) 00:15:13.742 fused_ordering(31) 00:15:13.742 fused_ordering(32) 00:15:13.742 fused_ordering(33) 00:15:13.742 fused_ordering(34) 00:15:13.742 fused_ordering(35) 00:15:13.742 fused_ordering(36) 00:15:13.742 fused_ordering(37) 00:15:13.742 fused_ordering(38) 00:15:13.742 fused_ordering(39) 00:15:13.742 fused_ordering(40) 00:15:13.742 fused_ordering(41) 00:15:13.742 fused_ordering(42) 00:15:13.742 fused_ordering(43) 00:15:13.742 fused_ordering(44) 00:15:13.742 fused_ordering(45) 00:15:13.742 fused_ordering(46) 00:15:13.742 fused_ordering(47) 00:15:13.742 fused_ordering(48) 00:15:13.742 fused_ordering(49) 00:15:13.742 fused_ordering(50) 00:15:13.742 fused_ordering(51) 00:15:13.742 fused_ordering(52) 00:15:13.742 fused_ordering(53) 00:15:13.742 fused_ordering(54) 00:15:13.742 fused_ordering(55) 00:15:13.742 fused_ordering(56) 00:15:13.742 fused_ordering(57) 00:15:13.742 fused_ordering(58) 00:15:13.742 fused_ordering(59) 00:15:13.742 fused_ordering(60) 00:15:13.742 fused_ordering(61) 00:15:13.742 fused_ordering(62) 00:15:13.742 fused_ordering(63) 00:15:13.742 fused_ordering(64) 00:15:13.742 fused_ordering(65) 00:15:13.742 fused_ordering(66) 00:15:13.742 fused_ordering(67) 00:15:13.742 fused_ordering(68) 00:15:13.742 fused_ordering(69) 00:15:13.742 fused_ordering(70) 00:15:13.742 fused_ordering(71) 00:15:13.742 fused_ordering(72) 00:15:13.742 fused_ordering(73) 00:15:13.742 fused_ordering(74) 00:15:13.742 fused_ordering(75) 00:15:13.742 fused_ordering(76) 00:15:13.742 fused_ordering(77) 00:15:13.742 fused_ordering(78) 00:15:13.742 fused_ordering(79) 00:15:13.742 fused_ordering(80) 00:15:13.742 fused_ordering(81) 00:15:13.742 fused_ordering(82) 00:15:13.742 fused_ordering(83) 00:15:13.742 fused_ordering(84) 00:15:13.742 fused_ordering(85) 00:15:13.742 fused_ordering(86) 00:15:13.742 fused_ordering(87) 00:15:13.742 fused_ordering(88) 00:15:13.742 fused_ordering(89) 00:15:13.742 fused_ordering(90) 00:15:13.742 fused_ordering(91) 00:15:13.742 fused_ordering(92) 00:15:13.742 fused_ordering(93) 00:15:13.742 fused_ordering(94) 00:15:13.742 fused_ordering(95) 00:15:13.742 fused_ordering(96) 00:15:13.742 fused_ordering(97) 00:15:13.742 fused_ordering(98) 00:15:13.742 fused_ordering(99) 00:15:13.742 fused_ordering(100) 00:15:13.742 fused_ordering(101) 00:15:13.742 fused_ordering(102) 00:15:13.742 fused_ordering(103) 00:15:13.742 fused_ordering(104) 00:15:13.742 fused_ordering(105) 00:15:13.742 fused_ordering(106) 00:15:13.742 fused_ordering(107) 00:15:13.742 fused_ordering(108) 00:15:13.742 fused_ordering(109) 00:15:13.742 fused_ordering(110) 00:15:13.742 fused_ordering(111) 00:15:13.742 fused_ordering(112) 00:15:13.742 fused_ordering(113) 00:15:13.742 fused_ordering(114) 00:15:13.742 fused_ordering(115) 00:15:13.742 fused_ordering(116) 00:15:13.742 fused_ordering(117) 00:15:13.742 fused_ordering(118) 00:15:13.742 fused_ordering(119) 00:15:13.742 fused_ordering(120) 00:15:13.742 fused_ordering(121) 00:15:13.742 fused_ordering(122) 00:15:13.742 fused_ordering(123) 00:15:13.742 fused_ordering(124) 00:15:13.742 fused_ordering(125) 00:15:13.742 fused_ordering(126) 00:15:13.742 fused_ordering(127) 00:15:13.742 fused_ordering(128) 00:15:13.742 fused_ordering(129) 00:15:13.742 fused_ordering(130) 00:15:13.742 fused_ordering(131) 00:15:13.742 fused_ordering(132) 00:15:13.742 fused_ordering(133) 00:15:13.742 fused_ordering(134) 00:15:13.742 fused_ordering(135) 00:15:13.742 fused_ordering(136) 00:15:13.742 fused_ordering(137) 00:15:13.742 fused_ordering(138) 00:15:13.742 fused_ordering(139) 00:15:13.742 fused_ordering(140) 00:15:13.742 fused_ordering(141) 00:15:13.742 fused_ordering(142) 00:15:13.742 fused_ordering(143) 00:15:13.742 fused_ordering(144) 00:15:13.742 fused_ordering(145) 00:15:13.742 fused_ordering(146) 00:15:13.742 fused_ordering(147) 00:15:13.742 fused_ordering(148) 00:15:13.742 fused_ordering(149) 00:15:13.742 fused_ordering(150) 00:15:13.742 fused_ordering(151) 00:15:13.742 fused_ordering(152) 00:15:13.742 fused_ordering(153) 00:15:13.742 fused_ordering(154) 00:15:13.742 fused_ordering(155) 00:15:13.742 fused_ordering(156) 00:15:13.742 fused_ordering(157) 00:15:13.742 fused_ordering(158) 00:15:13.742 fused_ordering(159) 00:15:13.742 fused_ordering(160) 00:15:13.742 fused_ordering(161) 00:15:13.742 fused_ordering(162) 00:15:13.742 fused_ordering(163) 00:15:13.742 fused_ordering(164) 00:15:13.742 fused_ordering(165) 00:15:13.742 fused_ordering(166) 00:15:13.742 fused_ordering(167) 00:15:13.742 fused_ordering(168) 00:15:13.742 fused_ordering(169) 00:15:13.742 fused_ordering(170) 00:15:13.742 fused_ordering(171) 00:15:13.742 fused_ordering(172) 00:15:13.742 fused_ordering(173) 00:15:13.742 fused_ordering(174) 00:15:13.742 fused_ordering(175) 00:15:13.742 fused_ordering(176) 00:15:13.742 fused_ordering(177) 00:15:13.742 fused_ordering(178) 00:15:13.742 fused_ordering(179) 00:15:13.742 fused_ordering(180) 00:15:13.742 fused_ordering(181) 00:15:13.742 fused_ordering(182) 00:15:13.742 fused_ordering(183) 00:15:13.742 fused_ordering(184) 00:15:13.742 fused_ordering(185) 00:15:13.742 fused_ordering(186) 00:15:13.742 fused_ordering(187) 00:15:13.742 fused_ordering(188) 00:15:13.742 fused_ordering(189) 00:15:13.742 fused_ordering(190) 00:15:13.742 fused_ordering(191) 00:15:13.742 fused_ordering(192) 00:15:13.742 fused_ordering(193) 00:15:13.742 fused_ordering(194) 00:15:13.742 fused_ordering(195) 00:15:13.742 fused_ordering(196) 00:15:13.742 fused_ordering(197) 00:15:13.742 fused_ordering(198) 00:15:13.742 fused_ordering(199) 00:15:13.742 fused_ordering(200) 00:15:13.742 fused_ordering(201) 00:15:13.742 fused_ordering(202) 00:15:13.742 fused_ordering(203) 00:15:13.742 fused_ordering(204) 00:15:13.742 fused_ordering(205) 00:15:14.315 fused_ordering(206) 00:15:14.315 fused_ordering(207) 00:15:14.315 fused_ordering(208) 00:15:14.315 fused_ordering(209) 00:15:14.315 fused_ordering(210) 00:15:14.315 fused_ordering(211) 00:15:14.315 fused_ordering(212) 00:15:14.315 fused_ordering(213) 00:15:14.315 fused_ordering(214) 00:15:14.315 fused_ordering(215) 00:15:14.315 fused_ordering(216) 00:15:14.315 fused_ordering(217) 00:15:14.315 fused_ordering(218) 00:15:14.315 fused_ordering(219) 00:15:14.315 fused_ordering(220) 00:15:14.315 fused_ordering(221) 00:15:14.315 fused_ordering(222) 00:15:14.315 fused_ordering(223) 00:15:14.315 fused_ordering(224) 00:15:14.315 fused_ordering(225) 00:15:14.315 fused_ordering(226) 00:15:14.315 fused_ordering(227) 00:15:14.315 fused_ordering(228) 00:15:14.315 fused_ordering(229) 00:15:14.315 fused_ordering(230) 00:15:14.315 fused_ordering(231) 00:15:14.315 fused_ordering(232) 00:15:14.315 fused_ordering(233) 00:15:14.315 fused_ordering(234) 00:15:14.315 fused_ordering(235) 00:15:14.315 fused_ordering(236) 00:15:14.315 fused_ordering(237) 00:15:14.315 fused_ordering(238) 00:15:14.315 fused_ordering(239) 00:15:14.315 fused_ordering(240) 00:15:14.315 fused_ordering(241) 00:15:14.315 fused_ordering(242) 00:15:14.315 fused_ordering(243) 00:15:14.315 fused_ordering(244) 00:15:14.315 fused_ordering(245) 00:15:14.315 fused_ordering(246) 00:15:14.315 fused_ordering(247) 00:15:14.315 fused_ordering(248) 00:15:14.315 fused_ordering(249) 00:15:14.315 fused_ordering(250) 00:15:14.315 fused_ordering(251) 00:15:14.315 fused_ordering(252) 00:15:14.315 fused_ordering(253) 00:15:14.315 fused_ordering(254) 00:15:14.315 fused_ordering(255) 00:15:14.315 fused_ordering(256) 00:15:14.315 fused_ordering(257) 00:15:14.315 fused_ordering(258) 00:15:14.315 fused_ordering(259) 00:15:14.315 fused_ordering(260) 00:15:14.315 fused_ordering(261) 00:15:14.315 fused_ordering(262) 00:15:14.315 fused_ordering(263) 00:15:14.315 fused_ordering(264) 00:15:14.315 fused_ordering(265) 00:15:14.315 fused_ordering(266) 00:15:14.315 fused_ordering(267) 00:15:14.315 fused_ordering(268) 00:15:14.315 fused_ordering(269) 00:15:14.315 fused_ordering(270) 00:15:14.315 fused_ordering(271) 00:15:14.315 fused_ordering(272) 00:15:14.315 fused_ordering(273) 00:15:14.315 fused_ordering(274) 00:15:14.315 fused_ordering(275) 00:15:14.315 fused_ordering(276) 00:15:14.315 fused_ordering(277) 00:15:14.315 fused_ordering(278) 00:15:14.315 fused_ordering(279) 00:15:14.315 fused_ordering(280) 00:15:14.315 fused_ordering(281) 00:15:14.315 fused_ordering(282) 00:15:14.315 fused_ordering(283) 00:15:14.315 fused_ordering(284) 00:15:14.315 fused_ordering(285) 00:15:14.315 fused_ordering(286) 00:15:14.315 fused_ordering(287) 00:15:14.315 fused_ordering(288) 00:15:14.315 fused_ordering(289) 00:15:14.315 fused_ordering(290) 00:15:14.315 fused_ordering(291) 00:15:14.315 fused_ordering(292) 00:15:14.315 fused_ordering(293) 00:15:14.315 fused_ordering(294) 00:15:14.315 fused_ordering(295) 00:15:14.315 fused_ordering(296) 00:15:14.315 fused_ordering(297) 00:15:14.315 fused_ordering(298) 00:15:14.315 fused_ordering(299) 00:15:14.315 fused_ordering(300) 00:15:14.315 fused_ordering(301) 00:15:14.315 fused_ordering(302) 00:15:14.315 fused_ordering(303) 00:15:14.315 fused_ordering(304) 00:15:14.315 fused_ordering(305) 00:15:14.315 fused_ordering(306) 00:15:14.315 fused_ordering(307) 00:15:14.315 fused_ordering(308) 00:15:14.315 fused_ordering(309) 00:15:14.315 fused_ordering(310) 00:15:14.315 fused_ordering(311) 00:15:14.315 fused_ordering(312) 00:15:14.315 fused_ordering(313) 00:15:14.315 fused_ordering(314) 00:15:14.315 fused_ordering(315) 00:15:14.315 fused_ordering(316) 00:15:14.315 fused_ordering(317) 00:15:14.315 fused_ordering(318) 00:15:14.315 fused_ordering(319) 00:15:14.315 fused_ordering(320) 00:15:14.315 fused_ordering(321) 00:15:14.315 fused_ordering(322) 00:15:14.315 fused_ordering(323) 00:15:14.315 fused_ordering(324) 00:15:14.315 fused_ordering(325) 00:15:14.315 fused_ordering(326) 00:15:14.315 fused_ordering(327) 00:15:14.315 fused_ordering(328) 00:15:14.315 fused_ordering(329) 00:15:14.315 fused_ordering(330) 00:15:14.315 fused_ordering(331) 00:15:14.315 fused_ordering(332) 00:15:14.315 fused_ordering(333) 00:15:14.315 fused_ordering(334) 00:15:14.315 fused_ordering(335) 00:15:14.315 fused_ordering(336) 00:15:14.315 fused_ordering(337) 00:15:14.315 fused_ordering(338) 00:15:14.315 fused_ordering(339) 00:15:14.315 fused_ordering(340) 00:15:14.315 fused_ordering(341) 00:15:14.315 fused_ordering(342) 00:15:14.315 fused_ordering(343) 00:15:14.315 fused_ordering(344) 00:15:14.315 fused_ordering(345) 00:15:14.315 fused_ordering(346) 00:15:14.316 fused_ordering(347) 00:15:14.316 fused_ordering(348) 00:15:14.316 fused_ordering(349) 00:15:14.316 fused_ordering(350) 00:15:14.316 fused_ordering(351) 00:15:14.316 fused_ordering(352) 00:15:14.316 fused_ordering(353) 00:15:14.316 fused_ordering(354) 00:15:14.316 fused_ordering(355) 00:15:14.316 fused_ordering(356) 00:15:14.316 fused_ordering(357) 00:15:14.316 fused_ordering(358) 00:15:14.316 fused_ordering(359) 00:15:14.316 fused_ordering(360) 00:15:14.316 fused_ordering(361) 00:15:14.316 fused_ordering(362) 00:15:14.316 fused_ordering(363) 00:15:14.316 fused_ordering(364) 00:15:14.316 fused_ordering(365) 00:15:14.316 fused_ordering(366) 00:15:14.316 fused_ordering(367) 00:15:14.316 fused_ordering(368) 00:15:14.316 fused_ordering(369) 00:15:14.316 fused_ordering(370) 00:15:14.316 fused_ordering(371) 00:15:14.316 fused_ordering(372) 00:15:14.316 fused_ordering(373) 00:15:14.316 fused_ordering(374) 00:15:14.316 fused_ordering(375) 00:15:14.316 fused_ordering(376) 00:15:14.316 fused_ordering(377) 00:15:14.316 fused_ordering(378) 00:15:14.316 fused_ordering(379) 00:15:14.316 fused_ordering(380) 00:15:14.316 fused_ordering(381) 00:15:14.316 fused_ordering(382) 00:15:14.316 fused_ordering(383) 00:15:14.316 fused_ordering(384) 00:15:14.316 fused_ordering(385) 00:15:14.316 fused_ordering(386) 00:15:14.316 fused_ordering(387) 00:15:14.316 fused_ordering(388) 00:15:14.316 fused_ordering(389) 00:15:14.316 fused_ordering(390) 00:15:14.316 fused_ordering(391) 00:15:14.316 fused_ordering(392) 00:15:14.316 fused_ordering(393) 00:15:14.316 fused_ordering(394) 00:15:14.316 fused_ordering(395) 00:15:14.316 fused_ordering(396) 00:15:14.316 fused_ordering(397) 00:15:14.316 fused_ordering(398) 00:15:14.316 fused_ordering(399) 00:15:14.316 fused_ordering(400) 00:15:14.316 fused_ordering(401) 00:15:14.316 fused_ordering(402) 00:15:14.316 fused_ordering(403) 00:15:14.316 fused_ordering(404) 00:15:14.316 fused_ordering(405) 00:15:14.316 fused_ordering(406) 00:15:14.316 fused_ordering(407) 00:15:14.316 fused_ordering(408) 00:15:14.316 fused_ordering(409) 00:15:14.316 fused_ordering(410) 00:15:14.887 fused_ordering(411) 00:15:14.887 fused_ordering(412) 00:15:14.887 fused_ordering(413) 00:15:14.887 fused_ordering(414) 00:15:14.887 fused_ordering(415) 00:15:14.887 fused_ordering(416) 00:15:14.887 fused_ordering(417) 00:15:14.887 fused_ordering(418) 00:15:14.887 fused_ordering(419) 00:15:14.887 fused_ordering(420) 00:15:14.887 fused_ordering(421) 00:15:14.887 fused_ordering(422) 00:15:14.887 fused_ordering(423) 00:15:14.887 fused_ordering(424) 00:15:14.887 fused_ordering(425) 00:15:14.887 fused_ordering(426) 00:15:14.887 fused_ordering(427) 00:15:14.887 fused_ordering(428) 00:15:14.887 fused_ordering(429) 00:15:14.887 fused_ordering(430) 00:15:14.887 fused_ordering(431) 00:15:14.887 fused_ordering(432) 00:15:14.887 fused_ordering(433) 00:15:14.887 fused_ordering(434) 00:15:14.887 fused_ordering(435) 00:15:14.887 fused_ordering(436) 00:15:14.887 fused_ordering(437) 00:15:14.887 fused_ordering(438) 00:15:14.887 fused_ordering(439) 00:15:14.887 fused_ordering(440) 00:15:14.887 fused_ordering(441) 00:15:14.887 fused_ordering(442) 00:15:14.887 fused_ordering(443) 00:15:14.887 fused_ordering(444) 00:15:14.887 fused_ordering(445) 00:15:14.887 fused_ordering(446) 00:15:14.887 fused_ordering(447) 00:15:14.887 fused_ordering(448) 00:15:14.887 fused_ordering(449) 00:15:14.887 fused_ordering(450) 00:15:14.887 fused_ordering(451) 00:15:14.887 fused_ordering(452) 00:15:14.887 fused_ordering(453) 00:15:14.887 fused_ordering(454) 00:15:14.887 fused_ordering(455) 00:15:14.888 fused_ordering(456) 00:15:14.888 fused_ordering(457) 00:15:14.888 fused_ordering(458) 00:15:14.888 fused_ordering(459) 00:15:14.888 fused_ordering(460) 00:15:14.888 fused_ordering(461) 00:15:14.888 fused_ordering(462) 00:15:14.888 fused_ordering(463) 00:15:14.888 fused_ordering(464) 00:15:14.888 fused_ordering(465) 00:15:14.888 fused_ordering(466) 00:15:14.888 fused_ordering(467) 00:15:14.888 fused_ordering(468) 00:15:14.888 fused_ordering(469) 00:15:14.888 fused_ordering(470) 00:15:14.888 fused_ordering(471) 00:15:14.888 fused_ordering(472) 00:15:14.888 fused_ordering(473) 00:15:14.888 fused_ordering(474) 00:15:14.888 fused_ordering(475) 00:15:14.888 fused_ordering(476) 00:15:14.888 fused_ordering(477) 00:15:14.888 fused_ordering(478) 00:15:14.888 fused_ordering(479) 00:15:14.888 fused_ordering(480) 00:15:14.888 fused_ordering(481) 00:15:14.888 fused_ordering(482) 00:15:14.888 fused_ordering(483) 00:15:14.888 fused_ordering(484) 00:15:14.888 fused_ordering(485) 00:15:14.888 fused_ordering(486) 00:15:14.888 fused_ordering(487) 00:15:14.888 fused_ordering(488) 00:15:14.888 fused_ordering(489) 00:15:14.888 fused_ordering(490) 00:15:14.888 fused_ordering(491) 00:15:14.888 fused_ordering(492) 00:15:14.888 fused_ordering(493) 00:15:14.888 fused_ordering(494) 00:15:14.888 fused_ordering(495) 00:15:14.888 fused_ordering(496) 00:15:14.888 fused_ordering(497) 00:15:14.888 fused_ordering(498) 00:15:14.888 fused_ordering(499) 00:15:14.888 fused_ordering(500) 00:15:14.888 fused_ordering(501) 00:15:14.888 fused_ordering(502) 00:15:14.888 fused_ordering(503) 00:15:14.888 fused_ordering(504) 00:15:14.888 fused_ordering(505) 00:15:14.888 fused_ordering(506) 00:15:14.888 fused_ordering(507) 00:15:14.888 fused_ordering(508) 00:15:14.888 fused_ordering(509) 00:15:14.888 fused_ordering(510) 00:15:14.888 fused_ordering(511) 00:15:14.888 fused_ordering(512) 00:15:14.888 fused_ordering(513) 00:15:14.888 fused_ordering(514) 00:15:14.888 fused_ordering(515) 00:15:14.888 fused_ordering(516) 00:15:14.888 fused_ordering(517) 00:15:14.888 fused_ordering(518) 00:15:14.888 fused_ordering(519) 00:15:14.888 fused_ordering(520) 00:15:14.888 fused_ordering(521) 00:15:14.888 fused_ordering(522) 00:15:14.888 fused_ordering(523) 00:15:14.888 fused_ordering(524) 00:15:14.888 fused_ordering(525) 00:15:14.888 fused_ordering(526) 00:15:14.888 fused_ordering(527) 00:15:14.888 fused_ordering(528) 00:15:14.888 fused_ordering(529) 00:15:14.888 fused_ordering(530) 00:15:14.888 fused_ordering(531) 00:15:14.888 fused_ordering(532) 00:15:14.888 fused_ordering(533) 00:15:14.888 fused_ordering(534) 00:15:14.888 fused_ordering(535) 00:15:14.888 fused_ordering(536) 00:15:14.888 fused_ordering(537) 00:15:14.888 fused_ordering(538) 00:15:14.888 fused_ordering(539) 00:15:14.888 fused_ordering(540) 00:15:14.888 fused_ordering(541) 00:15:14.888 fused_ordering(542) 00:15:14.888 fused_ordering(543) 00:15:14.888 fused_ordering(544) 00:15:14.888 fused_ordering(545) 00:15:14.888 fused_ordering(546) 00:15:14.888 fused_ordering(547) 00:15:14.888 fused_ordering(548) 00:15:14.888 fused_ordering(549) 00:15:14.888 fused_ordering(550) 00:15:14.888 fused_ordering(551) 00:15:14.888 fused_ordering(552) 00:15:14.888 fused_ordering(553) 00:15:14.888 fused_ordering(554) 00:15:14.888 fused_ordering(555) 00:15:14.888 fused_ordering(556) 00:15:14.888 fused_ordering(557) 00:15:14.888 fused_ordering(558) 00:15:14.888 fused_ordering(559) 00:15:14.888 fused_ordering(560) 00:15:14.888 fused_ordering(561) 00:15:14.888 fused_ordering(562) 00:15:14.888 fused_ordering(563) 00:15:14.888 fused_ordering(564) 00:15:14.888 fused_ordering(565) 00:15:14.888 fused_ordering(566) 00:15:14.888 fused_ordering(567) 00:15:14.888 fused_ordering(568) 00:15:14.888 fused_ordering(569) 00:15:14.888 fused_ordering(570) 00:15:14.888 fused_ordering(571) 00:15:14.888 fused_ordering(572) 00:15:14.888 fused_ordering(573) 00:15:14.888 fused_ordering(574) 00:15:14.888 fused_ordering(575) 00:15:14.888 fused_ordering(576) 00:15:14.888 fused_ordering(577) 00:15:14.888 fused_ordering(578) 00:15:14.888 fused_ordering(579) 00:15:14.888 fused_ordering(580) 00:15:14.888 fused_ordering(581) 00:15:14.888 fused_ordering(582) 00:15:14.888 fused_ordering(583) 00:15:14.888 fused_ordering(584) 00:15:14.888 fused_ordering(585) 00:15:14.888 fused_ordering(586) 00:15:14.888 fused_ordering(587) 00:15:14.888 fused_ordering(588) 00:15:14.888 fused_ordering(589) 00:15:14.888 fused_ordering(590) 00:15:14.888 fused_ordering(591) 00:15:14.888 fused_ordering(592) 00:15:14.888 fused_ordering(593) 00:15:14.888 fused_ordering(594) 00:15:14.888 fused_ordering(595) 00:15:14.888 fused_ordering(596) 00:15:14.888 fused_ordering(597) 00:15:14.888 fused_ordering(598) 00:15:14.888 fused_ordering(599) 00:15:14.888 fused_ordering(600) 00:15:14.888 fused_ordering(601) 00:15:14.888 fused_ordering(602) 00:15:14.888 fused_ordering(603) 00:15:14.888 fused_ordering(604) 00:15:14.888 fused_ordering(605) 00:15:14.888 fused_ordering(606) 00:15:14.888 fused_ordering(607) 00:15:14.888 fused_ordering(608) 00:15:14.888 fused_ordering(609) 00:15:14.888 fused_ordering(610) 00:15:14.888 fused_ordering(611) 00:15:14.888 fused_ordering(612) 00:15:14.888 fused_ordering(613) 00:15:14.888 fused_ordering(614) 00:15:14.888 fused_ordering(615) 00:15:15.832 fused_ordering(616) 00:15:15.832 fused_ordering(617) 00:15:15.832 fused_ordering(618) 00:15:15.832 fused_ordering(619) 00:15:15.832 fused_ordering(620) 00:15:15.832 fused_ordering(621) 00:15:15.832 fused_ordering(622) 00:15:15.832 fused_ordering(623) 00:15:15.832 fused_ordering(624) 00:15:15.832 fused_ordering(625) 00:15:15.832 fused_ordering(626) 00:15:15.832 fused_ordering(627) 00:15:15.832 fused_ordering(628) 00:15:15.832 fused_ordering(629) 00:15:15.832 fused_ordering(630) 00:15:15.832 fused_ordering(631) 00:15:15.832 fused_ordering(632) 00:15:15.832 fused_ordering(633) 00:15:15.832 fused_ordering(634) 00:15:15.832 fused_ordering(635) 00:15:15.832 fused_ordering(636) 00:15:15.832 fused_ordering(637) 00:15:15.832 fused_ordering(638) 00:15:15.832 fused_ordering(639) 00:15:15.832 fused_ordering(640) 00:15:15.832 fused_ordering(641) 00:15:15.832 fused_ordering(642) 00:15:15.832 fused_ordering(643) 00:15:15.832 fused_ordering(644) 00:15:15.832 fused_ordering(645) 00:15:15.832 fused_ordering(646) 00:15:15.832 fused_ordering(647) 00:15:15.832 fused_ordering(648) 00:15:15.832 fused_ordering(649) 00:15:15.832 fused_ordering(650) 00:15:15.832 fused_ordering(651) 00:15:15.832 fused_ordering(652) 00:15:15.832 fused_ordering(653) 00:15:15.832 fused_ordering(654) 00:15:15.832 fused_ordering(655) 00:15:15.832 fused_ordering(656) 00:15:15.832 fused_ordering(657) 00:15:15.832 fused_ordering(658) 00:15:15.832 fused_ordering(659) 00:15:15.832 fused_ordering(660) 00:15:15.832 fused_ordering(661) 00:15:15.832 fused_ordering(662) 00:15:15.832 fused_ordering(663) 00:15:15.832 fused_ordering(664) 00:15:15.832 fused_ordering(665) 00:15:15.832 fused_ordering(666) 00:15:15.832 fused_ordering(667) 00:15:15.832 fused_ordering(668) 00:15:15.832 fused_ordering(669) 00:15:15.832 fused_ordering(670) 00:15:15.832 fused_ordering(671) 00:15:15.832 fused_ordering(672) 00:15:15.832 fused_ordering(673) 00:15:15.832 fused_ordering(674) 00:15:15.832 fused_ordering(675) 00:15:15.832 fused_ordering(676) 00:15:15.832 fused_ordering(677) 00:15:15.832 fused_ordering(678) 00:15:15.832 fused_ordering(679) 00:15:15.832 fused_ordering(680) 00:15:15.832 fused_ordering(681) 00:15:15.832 fused_ordering(682) 00:15:15.832 fused_ordering(683) 00:15:15.832 fused_ordering(684) 00:15:15.832 fused_ordering(685) 00:15:15.832 fused_ordering(686) 00:15:15.832 fused_ordering(687) 00:15:15.832 fused_ordering(688) 00:15:15.832 fused_ordering(689) 00:15:15.832 fused_ordering(690) 00:15:15.832 fused_ordering(691) 00:15:15.832 fused_ordering(692) 00:15:15.832 fused_ordering(693) 00:15:15.832 fused_ordering(694) 00:15:15.832 fused_ordering(695) 00:15:15.832 fused_ordering(696) 00:15:15.832 fused_ordering(697) 00:15:15.832 fused_ordering(698) 00:15:15.832 fused_ordering(699) 00:15:15.832 fused_ordering(700) 00:15:15.832 fused_ordering(701) 00:15:15.832 fused_ordering(702) 00:15:15.832 fused_ordering(703) 00:15:15.832 fused_ordering(704) 00:15:15.832 fused_ordering(705) 00:15:15.832 fused_ordering(706) 00:15:15.832 fused_ordering(707) 00:15:15.832 fused_ordering(708) 00:15:15.832 fused_ordering(709) 00:15:15.832 fused_ordering(710) 00:15:15.832 fused_ordering(711) 00:15:15.832 fused_ordering(712) 00:15:15.832 fused_ordering(713) 00:15:15.832 fused_ordering(714) 00:15:15.832 fused_ordering(715) 00:15:15.832 fused_ordering(716) 00:15:15.832 fused_ordering(717) 00:15:15.832 fused_ordering(718) 00:15:15.832 fused_ordering(719) 00:15:15.832 fused_ordering(720) 00:15:15.832 fused_ordering(721) 00:15:15.832 fused_ordering(722) 00:15:15.832 fused_ordering(723) 00:15:15.832 fused_ordering(724) 00:15:15.832 fused_ordering(725) 00:15:15.832 fused_ordering(726) 00:15:15.832 fused_ordering(727) 00:15:15.832 fused_ordering(728) 00:15:15.832 fused_ordering(729) 00:15:15.832 fused_ordering(730) 00:15:15.832 fused_ordering(731) 00:15:15.832 fused_ordering(732) 00:15:15.832 fused_ordering(733) 00:15:15.832 fused_ordering(734) 00:15:15.832 fused_ordering(735) 00:15:15.832 fused_ordering(736) 00:15:15.832 fused_ordering(737) 00:15:15.832 fused_ordering(738) 00:15:15.832 fused_ordering(739) 00:15:15.832 fused_ordering(740) 00:15:15.832 fused_ordering(741) 00:15:15.832 fused_ordering(742) 00:15:15.832 fused_ordering(743) 00:15:15.832 fused_ordering(744) 00:15:15.832 fused_ordering(745) 00:15:15.832 fused_ordering(746) 00:15:15.832 fused_ordering(747) 00:15:15.832 fused_ordering(748) 00:15:15.832 fused_ordering(749) 00:15:15.832 fused_ordering(750) 00:15:15.832 fused_ordering(751) 00:15:15.832 fused_ordering(752) 00:15:15.832 fused_ordering(753) 00:15:15.832 fused_ordering(754) 00:15:15.832 fused_ordering(755) 00:15:15.832 fused_ordering(756) 00:15:15.832 fused_ordering(757) 00:15:15.832 fused_ordering(758) 00:15:15.832 fused_ordering(759) 00:15:15.832 fused_ordering(760) 00:15:15.832 fused_ordering(761) 00:15:15.832 fused_ordering(762) 00:15:15.833 fused_ordering(763) 00:15:15.833 fused_ordering(764) 00:15:15.833 fused_ordering(765) 00:15:15.833 fused_ordering(766) 00:15:15.833 fused_ordering(767) 00:15:15.833 fused_ordering(768) 00:15:15.833 fused_ordering(769) 00:15:15.833 fused_ordering(770) 00:15:15.833 fused_ordering(771) 00:15:15.833 fused_ordering(772) 00:15:15.833 fused_ordering(773) 00:15:15.833 fused_ordering(774) 00:15:15.833 fused_ordering(775) 00:15:15.833 fused_ordering(776) 00:15:15.833 fused_ordering(777) 00:15:15.833 fused_ordering(778) 00:15:15.833 fused_ordering(779) 00:15:15.833 fused_ordering(780) 00:15:15.833 fused_ordering(781) 00:15:15.833 fused_ordering(782) 00:15:15.833 fused_ordering(783) 00:15:15.833 fused_ordering(784) 00:15:15.833 fused_ordering(785) 00:15:15.833 fused_ordering(786) 00:15:15.833 fused_ordering(787) 00:15:15.833 fused_ordering(788) 00:15:15.833 fused_ordering(789) 00:15:15.833 fused_ordering(790) 00:15:15.833 fused_ordering(791) 00:15:15.833 fused_ordering(792) 00:15:15.833 fused_ordering(793) 00:15:15.833 fused_ordering(794) 00:15:15.833 fused_ordering(795) 00:15:15.833 fused_ordering(796) 00:15:15.833 fused_ordering(797) 00:15:15.833 fused_ordering(798) 00:15:15.833 fused_ordering(799) 00:15:15.833 fused_ordering(800) 00:15:15.833 fused_ordering(801) 00:15:15.833 fused_ordering(802) 00:15:15.833 fused_ordering(803) 00:15:15.833 fused_ordering(804) 00:15:15.833 fused_ordering(805) 00:15:15.833 fused_ordering(806) 00:15:15.833 fused_ordering(807) 00:15:15.833 fused_ordering(808) 00:15:15.833 fused_ordering(809) 00:15:15.833 fused_ordering(810) 00:15:15.833 fused_ordering(811) 00:15:15.833 fused_ordering(812) 00:15:15.833 fused_ordering(813) 00:15:15.833 fused_ordering(814) 00:15:15.833 fused_ordering(815) 00:15:15.833 fused_ordering(816) 00:15:15.833 fused_ordering(817) 00:15:15.833 fused_ordering(818) 00:15:15.833 fused_ordering(819) 00:15:15.833 fused_ordering(820) 00:15:16.405 fused_ordering(821) 00:15:16.405 fused_ordering(822) 00:15:16.405 fused_ordering(823) 00:15:16.405 fused_ordering(824) 00:15:16.405 fused_ordering(825) 00:15:16.405 fused_ordering(826) 00:15:16.405 fused_ordering(827) 00:15:16.405 fused_ordering(828) 00:15:16.405 fused_ordering(829) 00:15:16.405 fused_ordering(830) 00:15:16.405 fused_ordering(831) 00:15:16.405 fused_ordering(832) 00:15:16.405 fused_ordering(833) 00:15:16.405 fused_ordering(834) 00:15:16.405 fused_ordering(835) 00:15:16.405 fused_ordering(836) 00:15:16.405 fused_ordering(837) 00:15:16.405 fused_ordering(838) 00:15:16.405 fused_ordering(839) 00:15:16.405 fused_ordering(840) 00:15:16.405 fused_ordering(841) 00:15:16.405 fused_ordering(842) 00:15:16.405 fused_ordering(843) 00:15:16.405 fused_ordering(844) 00:15:16.405 fused_ordering(845) 00:15:16.405 fused_ordering(846) 00:15:16.405 fused_ordering(847) 00:15:16.405 fused_ordering(848) 00:15:16.405 fused_ordering(849) 00:15:16.405 fused_ordering(850) 00:15:16.405 fused_ordering(851) 00:15:16.405 fused_ordering(852) 00:15:16.405 fused_ordering(853) 00:15:16.405 fused_ordering(854) 00:15:16.405 fused_ordering(855) 00:15:16.405 fused_ordering(856) 00:15:16.405 fused_ordering(857) 00:15:16.405 fused_ordering(858) 00:15:16.405 fused_ordering(859) 00:15:16.405 fused_ordering(860) 00:15:16.405 fused_ordering(861) 00:15:16.405 fused_ordering(862) 00:15:16.405 fused_ordering(863) 00:15:16.405 fused_ordering(864) 00:15:16.405 fused_ordering(865) 00:15:16.405 fused_ordering(866) 00:15:16.405 fused_ordering(867) 00:15:16.405 fused_ordering(868) 00:15:16.405 fused_ordering(869) 00:15:16.405 fused_ordering(870) 00:15:16.405 fused_ordering(871) 00:15:16.405 fused_ordering(872) 00:15:16.405 fused_ordering(873) 00:15:16.405 fused_ordering(874) 00:15:16.405 fused_ordering(875) 00:15:16.405 fused_ordering(876) 00:15:16.405 fused_ordering(877) 00:15:16.405 fused_ordering(878) 00:15:16.405 fused_ordering(879) 00:15:16.405 fused_ordering(880) 00:15:16.405 fused_ordering(881) 00:15:16.405 fused_ordering(882) 00:15:16.405 fused_ordering(883) 00:15:16.405 fused_ordering(884) 00:15:16.405 fused_ordering(885) 00:15:16.405 fused_ordering(886) 00:15:16.405 fused_ordering(887) 00:15:16.405 fused_ordering(888) 00:15:16.405 fused_ordering(889) 00:15:16.405 fused_ordering(890) 00:15:16.405 fused_ordering(891) 00:15:16.405 fused_ordering(892) 00:15:16.405 fused_ordering(893) 00:15:16.405 fused_ordering(894) 00:15:16.405 fused_ordering(895) 00:15:16.405 fused_ordering(896) 00:15:16.405 fused_ordering(897) 00:15:16.405 fused_ordering(898) 00:15:16.405 fused_ordering(899) 00:15:16.405 fused_ordering(900) 00:15:16.405 fused_ordering(901) 00:15:16.405 fused_ordering(902) 00:15:16.405 fused_ordering(903) 00:15:16.405 fused_ordering(904) 00:15:16.405 fused_ordering(905) 00:15:16.405 fused_ordering(906) 00:15:16.405 fused_ordering(907) 00:15:16.405 fused_ordering(908) 00:15:16.405 fused_ordering(909) 00:15:16.405 fused_ordering(910) 00:15:16.405 fused_ordering(911) 00:15:16.405 fused_ordering(912) 00:15:16.405 fused_ordering(913) 00:15:16.405 fused_ordering(914) 00:15:16.405 fused_ordering(915) 00:15:16.405 fused_ordering(916) 00:15:16.405 fused_ordering(917) 00:15:16.405 fused_ordering(918) 00:15:16.405 fused_ordering(919) 00:15:16.405 fused_ordering(920) 00:15:16.405 fused_ordering(921) 00:15:16.405 fused_ordering(922) 00:15:16.405 fused_ordering(923) 00:15:16.405 fused_ordering(924) 00:15:16.405 fused_ordering(925) 00:15:16.405 fused_ordering(926) 00:15:16.405 fused_ordering(927) 00:15:16.405 fused_ordering(928) 00:15:16.405 fused_ordering(929) 00:15:16.405 fused_ordering(930) 00:15:16.405 fused_ordering(931) 00:15:16.405 fused_ordering(932) 00:15:16.405 fused_ordering(933) 00:15:16.405 fused_ordering(934) 00:15:16.405 fused_ordering(935) 00:15:16.405 fused_ordering(936) 00:15:16.405 fused_ordering(937) 00:15:16.405 fused_ordering(938) 00:15:16.405 fused_ordering(939) 00:15:16.405 fused_ordering(940) 00:15:16.405 fused_ordering(941) 00:15:16.405 fused_ordering(942) 00:15:16.405 fused_ordering(943) 00:15:16.405 fused_ordering(944) 00:15:16.405 fused_ordering(945) 00:15:16.405 fused_ordering(946) 00:15:16.405 fused_ordering(947) 00:15:16.405 fused_ordering(948) 00:15:16.405 fused_ordering(949) 00:15:16.405 fused_ordering(950) 00:15:16.405 fused_ordering(951) 00:15:16.405 fused_ordering(952) 00:15:16.405 fused_ordering(953) 00:15:16.405 fused_ordering(954) 00:15:16.405 fused_ordering(955) 00:15:16.405 fused_ordering(956) 00:15:16.405 fused_ordering(957) 00:15:16.405 fused_ordering(958) 00:15:16.405 fused_ordering(959) 00:15:16.405 fused_ordering(960) 00:15:16.405 fused_ordering(961) 00:15:16.405 fused_ordering(962) 00:15:16.405 fused_ordering(963) 00:15:16.405 fused_ordering(964) 00:15:16.405 fused_ordering(965) 00:15:16.405 fused_ordering(966) 00:15:16.405 fused_ordering(967) 00:15:16.405 fused_ordering(968) 00:15:16.405 fused_ordering(969) 00:15:16.405 fused_ordering(970) 00:15:16.405 fused_ordering(971) 00:15:16.405 fused_ordering(972) 00:15:16.405 fused_ordering(973) 00:15:16.405 fused_ordering(974) 00:15:16.405 fused_ordering(975) 00:15:16.405 fused_ordering(976) 00:15:16.405 fused_ordering(977) 00:15:16.405 fused_ordering(978) 00:15:16.405 fused_ordering(979) 00:15:16.405 fused_ordering(980) 00:15:16.405 fused_ordering(981) 00:15:16.405 fused_ordering(982) 00:15:16.405 fused_ordering(983) 00:15:16.405 fused_ordering(984) 00:15:16.405 fused_ordering(985) 00:15:16.405 fused_ordering(986) 00:15:16.405 fused_ordering(987) 00:15:16.405 fused_ordering(988) 00:15:16.406 fused_ordering(989) 00:15:16.406 fused_ordering(990) 00:15:16.406 fused_ordering(991) 00:15:16.406 fused_ordering(992) 00:15:16.406 fused_ordering(993) 00:15:16.406 fused_ordering(994) 00:15:16.406 fused_ordering(995) 00:15:16.406 fused_ordering(996) 00:15:16.406 fused_ordering(997) 00:15:16.406 fused_ordering(998) 00:15:16.406 fused_ordering(999) 00:15:16.406 fused_ordering(1000) 00:15:16.406 fused_ordering(1001) 00:15:16.406 fused_ordering(1002) 00:15:16.406 fused_ordering(1003) 00:15:16.406 fused_ordering(1004) 00:15:16.406 fused_ordering(1005) 00:15:16.406 fused_ordering(1006) 00:15:16.406 fused_ordering(1007) 00:15:16.406 fused_ordering(1008) 00:15:16.406 fused_ordering(1009) 00:15:16.406 fused_ordering(1010) 00:15:16.406 fused_ordering(1011) 00:15:16.406 fused_ordering(1012) 00:15:16.406 fused_ordering(1013) 00:15:16.406 fused_ordering(1014) 00:15:16.406 fused_ordering(1015) 00:15:16.406 fused_ordering(1016) 00:15:16.406 fused_ordering(1017) 00:15:16.406 fused_ordering(1018) 00:15:16.406 fused_ordering(1019) 00:15:16.406 fused_ordering(1020) 00:15:16.406 fused_ordering(1021) 00:15:16.406 fused_ordering(1022) 00:15:16.406 fused_ordering(1023) 00:15:16.406 04:12:30 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:16.406 04:12:30 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:16.406 04:12:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:16.406 04:12:30 -- nvmf/common.sh@116 -- # sync 00:15:16.406 04:12:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:16.406 04:12:30 -- nvmf/common.sh@119 -- # set +e 00:15:16.406 04:12:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:16.406 04:12:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:16.406 rmmod nvme_tcp 00:15:16.406 rmmod nvme_fabrics 00:15:16.406 rmmod nvme_keyring 00:15:16.406 04:12:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:16.406 04:12:30 -- nvmf/common.sh@123 -- # set -e 00:15:16.406 04:12:30 -- nvmf/common.sh@124 -- # return 0 00:15:16.406 04:12:30 -- nvmf/common.sh@477 -- # '[' -n 3877683 ']' 00:15:16.406 04:12:30 -- nvmf/common.sh@478 -- # killprocess 3877683 00:15:16.406 04:12:30 -- common/autotest_common.sh@926 -- # '[' -z 3877683 ']' 00:15:16.406 04:12:30 -- common/autotest_common.sh@930 -- # kill -0 3877683 00:15:16.406 04:12:30 -- common/autotest_common.sh@931 -- # uname 00:15:16.406 04:12:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:16.406 04:12:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3877683 00:15:16.667 04:12:31 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:16.667 04:12:31 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:16.667 04:12:31 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3877683' 00:15:16.667 killing process with pid 3877683 00:15:16.667 04:12:31 -- common/autotest_common.sh@945 -- # kill 3877683 00:15:16.667 04:12:31 -- common/autotest_common.sh@950 -- # wait 3877683 00:15:16.667 04:12:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:16.667 04:12:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:16.667 04:12:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:16.667 04:12:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:16.667 04:12:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:16.667 04:12:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:16.667 04:12:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:16.667 04:12:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.213 04:12:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:19.213 00:15:19.213 real 0m14.064s 00:15:19.213 user 0m8.739s 00:15:19.213 sys 0m7.322s 00:15:19.213 04:12:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:19.213 04:12:33 -- common/autotest_common.sh@10 -- # set +x 00:15:19.213 ************************************ 00:15:19.213 END TEST nvmf_fused_ordering 00:15:19.213 ************************************ 00:15:19.213 04:12:33 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:19.213 04:12:33 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:19.213 04:12:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:19.213 04:12:33 -- common/autotest_common.sh@10 -- # set +x 00:15:19.213 ************************************ 00:15:19.213 START TEST nvmf_delete_subsystem 00:15:19.213 ************************************ 00:15:19.213 04:12:33 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:19.213 * Looking for test storage... 00:15:19.213 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:19.213 04:12:33 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:19.213 04:12:33 -- nvmf/common.sh@7 -- # uname -s 00:15:19.213 04:12:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:19.213 04:12:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:19.213 04:12:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:19.213 04:12:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:19.213 04:12:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:19.213 04:12:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:19.213 04:12:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:19.213 04:12:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:19.213 04:12:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:19.213 04:12:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:19.213 04:12:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:19.213 04:12:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:19.213 04:12:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:19.213 04:12:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:19.213 04:12:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:19.213 04:12:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:19.213 04:12:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:19.213 04:12:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:19.213 04:12:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:19.213 04:12:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.213 04:12:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.213 04:12:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.213 04:12:33 -- paths/export.sh@5 -- # export PATH 00:15:19.213 04:12:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.213 04:12:33 -- nvmf/common.sh@46 -- # : 0 00:15:19.213 04:12:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:19.213 04:12:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:19.213 04:12:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:19.213 04:12:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:19.213 04:12:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:19.213 04:12:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:19.213 04:12:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:19.213 04:12:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:19.213 04:12:33 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:19.213 04:12:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:19.213 04:12:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:19.213 04:12:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:19.213 04:12:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:19.213 04:12:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:19.213 04:12:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:19.213 04:12:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:19.213 04:12:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.213 04:12:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:19.213 04:12:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:19.213 04:12:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:19.213 04:12:33 -- common/autotest_common.sh@10 -- # set +x 00:15:25.806 04:12:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:25.806 04:12:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:25.806 04:12:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:25.806 04:12:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:25.806 04:12:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:25.806 04:12:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:25.806 04:12:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:25.806 04:12:40 -- nvmf/common.sh@294 -- # net_devs=() 00:15:25.806 04:12:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:25.806 04:12:40 -- nvmf/common.sh@295 -- # e810=() 00:15:25.806 04:12:40 -- nvmf/common.sh@295 -- # local -ga e810 00:15:25.806 04:12:40 -- nvmf/common.sh@296 -- # x722=() 00:15:25.806 04:12:40 -- nvmf/common.sh@296 -- # local -ga x722 00:15:25.806 04:12:40 -- nvmf/common.sh@297 -- # mlx=() 00:15:25.806 04:12:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:25.806 04:12:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:25.806 04:12:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:25.806 04:12:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:25.806 04:12:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:25.806 04:12:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:25.806 04:12:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:25.806 04:12:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:25.806 04:12:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:25.807 04:12:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:25.807 04:12:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:25.807 04:12:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:25.807 04:12:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:25.807 04:12:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:25.807 04:12:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:25.807 04:12:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:25.807 04:12:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:15:25.807 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:15:25.807 04:12:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:25.807 04:12:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:15:25.807 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:15:25.807 04:12:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:25.807 04:12:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:25.807 04:12:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:25.807 04:12:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:25.807 04:12:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:25.807 04:12:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:15:25.807 Found net devices under 0000:4b:00.0: cvl_0_0 00:15:25.807 04:12:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:25.807 04:12:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:25.807 04:12:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:25.807 04:12:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:25.807 04:12:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:25.807 04:12:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:15:25.807 Found net devices under 0000:4b:00.1: cvl_0_1 00:15:25.807 04:12:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:25.807 04:12:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:25.807 04:12:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:25.807 04:12:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:25.807 04:12:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:25.807 04:12:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:25.807 04:12:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:25.807 04:12:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:25.807 04:12:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:25.807 04:12:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:25.807 04:12:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:25.807 04:12:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:25.807 04:12:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:25.807 04:12:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:25.807 04:12:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:25.807 04:12:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:25.807 04:12:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:25.807 04:12:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:26.068 04:12:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:26.068 04:12:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:26.068 04:12:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:26.068 04:12:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:26.330 04:12:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:26.330 04:12:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:26.330 04:12:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:26.330 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:26.330 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.674 ms 00:15:26.330 00:15:26.330 --- 10.0.0.2 ping statistics --- 00:15:26.330 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:26.330 rtt min/avg/max/mdev = 0.674/0.674/0.674/0.000 ms 00:15:26.330 04:12:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:26.330 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:26.330 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.335 ms 00:15:26.330 00:15:26.330 --- 10.0.0.1 ping statistics --- 00:15:26.330 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:26.330 rtt min/avg/max/mdev = 0.335/0.335/0.335/0.000 ms 00:15:26.330 04:12:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:26.330 04:12:40 -- nvmf/common.sh@410 -- # return 0 00:15:26.330 04:12:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:26.330 04:12:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:26.330 04:12:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:26.330 04:12:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:26.330 04:12:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:26.331 04:12:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:26.331 04:12:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:26.331 04:12:40 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:26.331 04:12:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:26.331 04:12:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:26.331 04:12:40 -- common/autotest_common.sh@10 -- # set +x 00:15:26.331 04:12:40 -- nvmf/common.sh@469 -- # nvmfpid=3882840 00:15:26.331 04:12:40 -- nvmf/common.sh@470 -- # waitforlisten 3882840 00:15:26.331 04:12:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:26.331 04:12:40 -- common/autotest_common.sh@819 -- # '[' -z 3882840 ']' 00:15:26.331 04:12:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:26.331 04:12:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:26.331 04:12:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:26.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:26.331 04:12:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:26.331 04:12:40 -- common/autotest_common.sh@10 -- # set +x 00:15:26.331 [2024-05-14 04:12:40.821096] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:26.331 [2024-05-14 04:12:40.821164] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:26.331 EAL: No free 2048 kB hugepages reported on node 1 00:15:26.331 [2024-05-14 04:12:40.892063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:26.592 [2024-05-14 04:12:40.964413] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:26.592 [2024-05-14 04:12:40.964537] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:26.592 [2024-05-14 04:12:40.964545] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:26.592 [2024-05-14 04:12:40.964552] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:26.592 [2024-05-14 04:12:40.964695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:26.592 [2024-05-14 04:12:40.964697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:27.225 04:12:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:27.225 04:12:41 -- common/autotest_common.sh@852 -- # return 0 00:15:27.225 04:12:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:27.225 04:12:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:27.225 04:12:41 -- common/autotest_common.sh@10 -- # set +x 00:15:27.225 04:12:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:27.225 04:12:41 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:27.225 04:12:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:27.225 04:12:41 -- common/autotest_common.sh@10 -- # set +x 00:15:27.225 [2024-05-14 04:12:41.644552] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:27.225 04:12:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:27.225 04:12:41 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:27.225 04:12:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:27.225 04:12:41 -- common/autotest_common.sh@10 -- # set +x 00:15:27.225 04:12:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:27.225 04:12:41 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:27.225 04:12:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:27.225 04:12:41 -- common/autotest_common.sh@10 -- # set +x 00:15:27.225 [2024-05-14 04:12:41.668741] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:27.225 04:12:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:27.225 04:12:41 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:27.225 04:12:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:27.225 04:12:41 -- common/autotest_common.sh@10 -- # set +x 00:15:27.225 NULL1 00:15:27.225 04:12:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:27.225 04:12:41 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:27.225 04:12:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:27.225 04:12:41 -- common/autotest_common.sh@10 -- # set +x 00:15:27.225 Delay0 00:15:27.225 04:12:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:27.225 04:12:41 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:27.225 04:12:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:27.225 04:12:41 -- common/autotest_common.sh@10 -- # set +x 00:15:27.225 04:12:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:27.225 04:12:41 -- target/delete_subsystem.sh@28 -- # perf_pid=3882879 00:15:27.225 04:12:41 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:27.225 04:12:41 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:27.225 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.225 [2024-05-14 04:12:41.765407] subsystem.c:1304:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:29.163 04:12:43 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:29.163 04:12:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:29.163 04:12:43 -- common/autotest_common.sh@10 -- # set +x 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 [2024-05-14 04:12:43.851368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x695e40 is same with the state(5) to be set 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 starting I/O failed: -6 00:15:29.424 [2024-05-14 04:12:43.855615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f69e400c350 is same with the state(5) to be set 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Read completed with error (sct=0, sc=8) 00:15:29.424 Write completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Write completed with error (sct=0, sc=8) 00:15:29.425 Read completed with error (sct=0, sc=8) 00:15:30.366 [2024-05-14 04:12:44.823769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x684910 is same with the state(5) to be set 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 [2024-05-14 04:12:44.854837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68d640 is same with the state(5) to be set 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 [2024-05-14 04:12:44.855254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68dba0 is same with the state(5) to be set 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 [2024-05-14 04:12:44.857568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f69e400bf20 is same with the state(5) to be set 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Read completed with error (sct=0, sc=8) 00:15:30.366 Write completed with error (sct=0, sc=8) 00:15:30.366 [2024-05-14 04:12:44.857631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f69e400c600 is same with the state(5) to be set 00:15:30.366 [2024-05-14 04:12:44.858077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x684910 (9): Bad file descriptor 00:15:30.366 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:30.366 04:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:30.366 04:12:44 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:30.366 04:12:44 -- target/delete_subsystem.sh@35 -- # kill -0 3882879 00:15:30.366 04:12:44 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:30.366 Initializing NVMe Controllers 00:15:30.366 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:30.366 Controller IO queue size 128, less than required. 00:15:30.366 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:30.366 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:30.366 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:30.366 Initialization complete. Launching workers. 00:15:30.366 ======================================================== 00:15:30.366 Latency(us) 00:15:30.366 Device Information : IOPS MiB/s Average min max 00:15:30.367 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 169.75 0.08 895439.02 240.41 1043568.15 00:15:30.367 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 153.82 0.08 949971.63 184.26 2002109.36 00:15:30.367 ======================================================== 00:15:30.367 Total : 323.58 0.16 921362.98 184.26 2002109.36 00:15:30.367 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@35 -- # kill -0 3882879 00:15:30.939 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3882879) - No such process 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@45 -- # NOT wait 3882879 00:15:30.939 04:12:45 -- common/autotest_common.sh@640 -- # local es=0 00:15:30.939 04:12:45 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 3882879 00:15:30.939 04:12:45 -- common/autotest_common.sh@628 -- # local arg=wait 00:15:30.939 04:12:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:30.939 04:12:45 -- common/autotest_common.sh@632 -- # type -t wait 00:15:30.939 04:12:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:30.939 04:12:45 -- common/autotest_common.sh@643 -- # wait 3882879 00:15:30.939 04:12:45 -- common/autotest_common.sh@643 -- # es=1 00:15:30.939 04:12:45 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:15:30.939 04:12:45 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:15:30.939 04:12:45 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:30.939 04:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:30.939 04:12:45 -- common/autotest_common.sh@10 -- # set +x 00:15:30.939 04:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:30.939 04:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:30.939 04:12:45 -- common/autotest_common.sh@10 -- # set +x 00:15:30.939 [2024-05-14 04:12:45.387760] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:30.939 04:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:30.939 04:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:30.939 04:12:45 -- common/autotest_common.sh@10 -- # set +x 00:15:30.939 04:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@54 -- # perf_pid=3883663 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@57 -- # kill -0 3883663 00:15:30.939 04:12:45 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:30.939 EAL: No free 2048 kB hugepages reported on node 1 00:15:30.939 [2024-05-14 04:12:45.466568] subsystem.c:1304:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:31.512 04:12:45 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:31.512 04:12:45 -- target/delete_subsystem.sh@57 -- # kill -0 3883663 00:15:31.512 04:12:45 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:32.084 04:12:46 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:32.084 04:12:46 -- target/delete_subsystem.sh@57 -- # kill -0 3883663 00:15:32.084 04:12:46 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:32.345 04:12:46 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:32.345 04:12:46 -- target/delete_subsystem.sh@57 -- # kill -0 3883663 00:15:32.345 04:12:46 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:32.916 04:12:47 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:32.916 04:12:47 -- target/delete_subsystem.sh@57 -- # kill -0 3883663 00:15:32.916 04:12:47 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:33.488 04:12:47 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:33.488 04:12:47 -- target/delete_subsystem.sh@57 -- # kill -0 3883663 00:15:33.488 04:12:47 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:34.059 04:12:48 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:34.059 04:12:48 -- target/delete_subsystem.sh@57 -- # kill -0 3883663 00:15:34.059 04:12:48 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:34.059 Initializing NVMe Controllers 00:15:34.059 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:34.059 Controller IO queue size 128, less than required. 00:15:34.059 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:34.059 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:34.059 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:34.059 Initialization complete. Launching workers. 00:15:34.059 ======================================================== 00:15:34.059 Latency(us) 00:15:34.059 Device Information : IOPS MiB/s Average min max 00:15:34.059 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1002454.50 1000310.37 1006324.56 00:15:34.059 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1003360.29 1000532.58 1010601.55 00:15:34.059 ======================================================== 00:15:34.059 Total : 256.00 0.12 1002907.39 1000310.37 1010601.55 00:15:34.059 00:15:34.631 04:12:48 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:34.631 04:12:48 -- target/delete_subsystem.sh@57 -- # kill -0 3883663 00:15:34.631 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3883663) - No such process 00:15:34.631 04:12:48 -- target/delete_subsystem.sh@67 -- # wait 3883663 00:15:34.631 04:12:48 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:34.631 04:12:48 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:34.631 04:12:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:34.631 04:12:48 -- nvmf/common.sh@116 -- # sync 00:15:34.631 04:12:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:34.631 04:12:48 -- nvmf/common.sh@119 -- # set +e 00:15:34.631 04:12:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:34.631 04:12:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:34.631 rmmod nvme_tcp 00:15:34.631 rmmod nvme_fabrics 00:15:34.631 rmmod nvme_keyring 00:15:34.631 04:12:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:34.631 04:12:49 -- nvmf/common.sh@123 -- # set -e 00:15:34.631 04:12:49 -- nvmf/common.sh@124 -- # return 0 00:15:34.631 04:12:49 -- nvmf/common.sh@477 -- # '[' -n 3882840 ']' 00:15:34.631 04:12:49 -- nvmf/common.sh@478 -- # killprocess 3882840 00:15:34.631 04:12:49 -- common/autotest_common.sh@926 -- # '[' -z 3882840 ']' 00:15:34.631 04:12:49 -- common/autotest_common.sh@930 -- # kill -0 3882840 00:15:34.631 04:12:49 -- common/autotest_common.sh@931 -- # uname 00:15:34.631 04:12:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:34.631 04:12:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3882840 00:15:34.631 04:12:49 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:34.631 04:12:49 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:34.631 04:12:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3882840' 00:15:34.631 killing process with pid 3882840 00:15:34.631 04:12:49 -- common/autotest_common.sh@945 -- # kill 3882840 00:15:34.631 04:12:49 -- common/autotest_common.sh@950 -- # wait 3882840 00:15:34.631 04:12:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:34.631 04:12:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:34.631 04:12:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:34.631 04:12:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:34.631 04:12:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:34.631 04:12:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:34.631 04:12:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:34.631 04:12:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:37.198 04:12:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:37.198 00:15:37.198 real 0m18.014s 00:15:37.198 user 0m30.631s 00:15:37.198 sys 0m6.231s 00:15:37.198 04:12:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:37.198 04:12:51 -- common/autotest_common.sh@10 -- # set +x 00:15:37.198 ************************************ 00:15:37.198 END TEST nvmf_delete_subsystem 00:15:37.198 ************************************ 00:15:37.198 04:12:51 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:37.198 04:12:51 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:37.198 04:12:51 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:37.198 04:12:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:37.198 04:12:51 -- common/autotest_common.sh@10 -- # set +x 00:15:37.198 ************************************ 00:15:37.198 START TEST nvmf_nvme_cli 00:15:37.198 ************************************ 00:15:37.198 04:12:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:37.198 * Looking for test storage... 00:15:37.198 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:37.198 04:12:51 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:37.198 04:12:51 -- nvmf/common.sh@7 -- # uname -s 00:15:37.198 04:12:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:37.198 04:12:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:37.198 04:12:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:37.198 04:12:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:37.198 04:12:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:37.198 04:12:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:37.198 04:12:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:37.198 04:12:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:37.198 04:12:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:37.198 04:12:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:37.198 04:12:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:37.198 04:12:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:37.198 04:12:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:37.198 04:12:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:37.198 04:12:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:37.198 04:12:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:37.198 04:12:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:37.198 04:12:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:37.198 04:12:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:37.198 04:12:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.198 04:12:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.198 04:12:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.198 04:12:51 -- paths/export.sh@5 -- # export PATH 00:15:37.198 04:12:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:37.198 04:12:51 -- nvmf/common.sh@46 -- # : 0 00:15:37.198 04:12:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:37.198 04:12:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:37.198 04:12:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:37.198 04:12:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:37.198 04:12:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:37.198 04:12:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:37.198 04:12:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:37.198 04:12:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:37.198 04:12:51 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:37.198 04:12:51 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:37.198 04:12:51 -- target/nvme_cli.sh@14 -- # devs=() 00:15:37.198 04:12:51 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:37.198 04:12:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:37.198 04:12:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:37.198 04:12:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:37.198 04:12:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:37.198 04:12:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:37.198 04:12:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:37.198 04:12:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:37.198 04:12:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:37.198 04:12:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:37.198 04:12:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:37.198 04:12:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:37.198 04:12:51 -- common/autotest_common.sh@10 -- # set +x 00:15:43.790 04:12:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:43.791 04:12:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:43.791 04:12:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:43.791 04:12:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:43.791 04:12:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:43.791 04:12:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:43.791 04:12:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:43.791 04:12:58 -- nvmf/common.sh@294 -- # net_devs=() 00:15:43.791 04:12:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:43.791 04:12:58 -- nvmf/common.sh@295 -- # e810=() 00:15:43.791 04:12:58 -- nvmf/common.sh@295 -- # local -ga e810 00:15:43.791 04:12:58 -- nvmf/common.sh@296 -- # x722=() 00:15:43.791 04:12:58 -- nvmf/common.sh@296 -- # local -ga x722 00:15:43.791 04:12:58 -- nvmf/common.sh@297 -- # mlx=() 00:15:43.791 04:12:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:43.791 04:12:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:43.791 04:12:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:43.791 04:12:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:43.791 04:12:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:43.791 04:12:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:43.791 04:12:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:15:43.791 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:15:43.791 04:12:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:43.791 04:12:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:15:43.791 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:15:43.791 04:12:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:43.791 04:12:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:43.791 04:12:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:43.791 04:12:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:43.791 04:12:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:43.791 04:12:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:15:43.791 Found net devices under 0000:4b:00.0: cvl_0_0 00:15:43.791 04:12:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:43.791 04:12:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:43.791 04:12:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:43.791 04:12:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:43.791 04:12:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:43.791 04:12:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:15:43.791 Found net devices under 0000:4b:00.1: cvl_0_1 00:15:43.791 04:12:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:43.791 04:12:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:43.791 04:12:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:43.791 04:12:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:43.791 04:12:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:43.791 04:12:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:43.791 04:12:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:43.791 04:12:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:43.791 04:12:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:43.791 04:12:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:43.791 04:12:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:43.791 04:12:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:43.791 04:12:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:43.791 04:12:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:43.791 04:12:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:43.791 04:12:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:43.791 04:12:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:43.791 04:12:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:44.052 04:12:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:44.052 04:12:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:44.052 04:12:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:44.052 04:12:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:44.052 04:12:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:44.052 04:12:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:44.052 04:12:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:44.052 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:44.052 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.656 ms 00:15:44.052 00:15:44.052 --- 10.0.0.2 ping statistics --- 00:15:44.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:44.052 rtt min/avg/max/mdev = 0.656/0.656/0.656/0.000 ms 00:15:44.052 04:12:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:44.052 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:44.052 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.451 ms 00:15:44.052 00:15:44.052 --- 10.0.0.1 ping statistics --- 00:15:44.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:44.052 rtt min/avg/max/mdev = 0.451/0.451/0.451/0.000 ms 00:15:44.052 04:12:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:44.052 04:12:58 -- nvmf/common.sh@410 -- # return 0 00:15:44.052 04:12:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:44.052 04:12:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:44.052 04:12:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:44.052 04:12:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:44.052 04:12:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:44.052 04:12:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:44.052 04:12:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:44.314 04:12:58 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:44.314 04:12:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:44.314 04:12:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:44.314 04:12:58 -- common/autotest_common.sh@10 -- # set +x 00:15:44.314 04:12:58 -- nvmf/common.sh@469 -- # nvmfpid=3888578 00:15:44.314 04:12:58 -- nvmf/common.sh@470 -- # waitforlisten 3888578 00:15:44.314 04:12:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:44.314 04:12:58 -- common/autotest_common.sh@819 -- # '[' -z 3888578 ']' 00:15:44.314 04:12:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:44.314 04:12:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:44.314 04:12:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:44.314 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:44.314 04:12:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:44.314 04:12:58 -- common/autotest_common.sh@10 -- # set +x 00:15:44.314 [2024-05-14 04:12:58.734072] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:44.314 [2024-05-14 04:12:58.734136] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:44.314 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.314 [2024-05-14 04:12:58.806593] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:44.314 [2024-05-14 04:12:58.879490] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:44.314 [2024-05-14 04:12:58.879632] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:44.314 [2024-05-14 04:12:58.879642] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:44.314 [2024-05-14 04:12:58.879651] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:44.314 [2024-05-14 04:12:58.879717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:44.314 [2024-05-14 04:12:58.879818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:44.314 [2024-05-14 04:12:58.879978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:44.314 [2024-05-14 04:12:58.879979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:45.260 04:12:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:45.260 04:12:59 -- common/autotest_common.sh@852 -- # return 0 00:15:45.260 04:12:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:45.260 04:12:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:45.260 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.260 04:12:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:45.260 04:12:59 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:45.260 04:12:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.260 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.260 [2024-05-14 04:12:59.559460] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:45.260 04:12:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.260 04:12:59 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:45.260 04:12:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.260 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.260 Malloc0 00:15:45.260 04:12:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.260 04:12:59 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:45.260 04:12:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.260 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.260 Malloc1 00:15:45.260 04:12:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.260 04:12:59 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:45.260 04:12:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.260 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.260 04:12:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.260 04:12:59 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:45.260 04:12:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.260 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.260 04:12:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.260 04:12:59 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:45.260 04:12:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.260 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.260 04:12:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.260 04:12:59 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:45.260 04:12:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.260 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.260 [2024-05-14 04:12:59.649484] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:45.260 04:12:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.260 04:12:59 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:45.260 04:12:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:45.260 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:15:45.260 04:12:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:45.260 04:12:59 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 4420 00:15:45.260 00:15:45.260 Discovery Log Number of Records 2, Generation counter 2 00:15:45.260 =====Discovery Log Entry 0====== 00:15:45.260 trtype: tcp 00:15:45.260 adrfam: ipv4 00:15:45.260 subtype: current discovery subsystem 00:15:45.260 treq: not required 00:15:45.260 portid: 0 00:15:45.260 trsvcid: 4420 00:15:45.260 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:45.260 traddr: 10.0.0.2 00:15:45.260 eflags: explicit discovery connections, duplicate discovery information 00:15:45.260 sectype: none 00:15:45.260 =====Discovery Log Entry 1====== 00:15:45.260 trtype: tcp 00:15:45.260 adrfam: ipv4 00:15:45.260 subtype: nvme subsystem 00:15:45.260 treq: not required 00:15:45.260 portid: 0 00:15:45.260 trsvcid: 4420 00:15:45.260 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:45.260 traddr: 10.0.0.2 00:15:45.260 eflags: none 00:15:45.260 sectype: none 00:15:45.260 04:12:59 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:45.260 04:12:59 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:45.260 04:12:59 -- nvmf/common.sh@510 -- # local dev _ 00:15:45.260 04:12:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:45.260 04:12:59 -- nvmf/common.sh@509 -- # nvme list 00:15:45.260 04:12:59 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:45.260 04:12:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:45.260 04:12:59 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:45.260 04:12:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:45.260 04:12:59 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:45.260 04:12:59 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:47.174 04:13:01 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:47.174 04:13:01 -- common/autotest_common.sh@1177 -- # local i=0 00:15:47.174 04:13:01 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:15:47.174 04:13:01 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:15:47.174 04:13:01 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:15:47.174 04:13:01 -- common/autotest_common.sh@1184 -- # sleep 2 00:15:49.125 04:13:03 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:15:49.125 04:13:03 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:15:49.125 04:13:03 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:15:49.125 04:13:03 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:15:49.125 04:13:03 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:15:49.125 04:13:03 -- common/autotest_common.sh@1187 -- # return 0 00:15:49.125 04:13:03 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:49.125 04:13:03 -- nvmf/common.sh@510 -- # local dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@509 -- # nvme list 00:15:49.125 04:13:03 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:49.125 04:13:03 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:49.125 04:13:03 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:15:49.125 /dev/nvme0n1 ]] 00:15:49.125 04:13:03 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:49.125 04:13:03 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:49.125 04:13:03 -- nvmf/common.sh@510 -- # local dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@509 -- # nvme list 00:15:49.125 04:13:03 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:49.125 04:13:03 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:49.125 04:13:03 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:49.125 04:13:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:49.125 04:13:03 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:49.125 04:13:03 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:49.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:49.125 04:13:03 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:49.125 04:13:03 -- common/autotest_common.sh@1198 -- # local i=0 00:15:49.125 04:13:03 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:15:49.125 04:13:03 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:49.125 04:13:03 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:15:49.125 04:13:03 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:49.125 04:13:03 -- common/autotest_common.sh@1210 -- # return 0 00:15:49.125 04:13:03 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:49.125 04:13:03 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:49.125 04:13:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:49.125 04:13:03 -- common/autotest_common.sh@10 -- # set +x 00:15:49.125 04:13:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:49.125 04:13:03 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:49.125 04:13:03 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:49.125 04:13:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:49.125 04:13:03 -- nvmf/common.sh@116 -- # sync 00:15:49.125 04:13:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:49.125 04:13:03 -- nvmf/common.sh@119 -- # set +e 00:15:49.125 04:13:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:49.125 04:13:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:49.125 rmmod nvme_tcp 00:15:49.125 rmmod nvme_fabrics 00:15:49.125 rmmod nvme_keyring 00:15:49.125 04:13:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:49.125 04:13:03 -- nvmf/common.sh@123 -- # set -e 00:15:49.125 04:13:03 -- nvmf/common.sh@124 -- # return 0 00:15:49.125 04:13:03 -- nvmf/common.sh@477 -- # '[' -n 3888578 ']' 00:15:49.125 04:13:03 -- nvmf/common.sh@478 -- # killprocess 3888578 00:15:49.125 04:13:03 -- common/autotest_common.sh@926 -- # '[' -z 3888578 ']' 00:15:49.125 04:13:03 -- common/autotest_common.sh@930 -- # kill -0 3888578 00:15:49.125 04:13:03 -- common/autotest_common.sh@931 -- # uname 00:15:49.125 04:13:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:49.125 04:13:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3888578 00:15:49.125 04:13:03 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:49.125 04:13:03 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:49.125 04:13:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3888578' 00:15:49.125 killing process with pid 3888578 00:15:49.125 04:13:03 -- common/autotest_common.sh@945 -- # kill 3888578 00:15:49.125 04:13:03 -- common/autotest_common.sh@950 -- # wait 3888578 00:15:49.386 04:13:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:49.386 04:13:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:49.386 04:13:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:49.386 04:13:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:49.386 04:13:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:49.386 04:13:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.386 04:13:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.386 04:13:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:51.936 04:13:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:51.936 00:15:51.936 real 0m14.578s 00:15:51.936 user 0m21.880s 00:15:51.936 sys 0m5.892s 00:15:51.936 04:13:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:51.936 04:13:05 -- common/autotest_common.sh@10 -- # set +x 00:15:51.936 ************************************ 00:15:51.936 END TEST nvmf_nvme_cli 00:15:51.936 ************************************ 00:15:51.936 04:13:05 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:15:51.936 04:13:05 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:15:51.936 04:13:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:51.936 04:13:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:51.936 04:13:05 -- common/autotest_common.sh@10 -- # set +x 00:15:51.936 ************************************ 00:15:51.936 START TEST nvmf_host_management 00:15:51.936 ************************************ 00:15:51.936 04:13:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:15:51.936 * Looking for test storage... 00:15:51.936 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:51.936 04:13:06 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:51.936 04:13:06 -- nvmf/common.sh@7 -- # uname -s 00:15:51.936 04:13:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:51.936 04:13:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:51.936 04:13:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:51.936 04:13:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:51.936 04:13:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:51.936 04:13:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:51.936 04:13:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:51.936 04:13:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:51.936 04:13:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:51.936 04:13:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:51.936 04:13:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:51.936 04:13:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:51.936 04:13:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:51.936 04:13:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:51.936 04:13:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:51.936 04:13:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:51.936 04:13:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:51.936 04:13:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:51.936 04:13:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:51.936 04:13:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.936 04:13:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.936 04:13:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.936 04:13:06 -- paths/export.sh@5 -- # export PATH 00:15:51.936 04:13:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.936 04:13:06 -- nvmf/common.sh@46 -- # : 0 00:15:51.936 04:13:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:51.936 04:13:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:51.936 04:13:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:51.936 04:13:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:51.936 04:13:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:51.937 04:13:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:51.937 04:13:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:51.937 04:13:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:51.937 04:13:06 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:51.937 04:13:06 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:51.937 04:13:06 -- target/host_management.sh@104 -- # nvmftestinit 00:15:51.937 04:13:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:51.937 04:13:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:51.937 04:13:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:51.937 04:13:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:51.937 04:13:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:51.937 04:13:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:51.937 04:13:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:51.937 04:13:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:51.937 04:13:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:51.937 04:13:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:51.937 04:13:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:51.937 04:13:06 -- common/autotest_common.sh@10 -- # set +x 00:15:58.529 04:13:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:58.529 04:13:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:58.529 04:13:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:58.529 04:13:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:58.529 04:13:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:58.529 04:13:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:58.529 04:13:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:58.529 04:13:12 -- nvmf/common.sh@294 -- # net_devs=() 00:15:58.529 04:13:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:58.529 04:13:12 -- nvmf/common.sh@295 -- # e810=() 00:15:58.529 04:13:12 -- nvmf/common.sh@295 -- # local -ga e810 00:15:58.529 04:13:12 -- nvmf/common.sh@296 -- # x722=() 00:15:58.529 04:13:12 -- nvmf/common.sh@296 -- # local -ga x722 00:15:58.529 04:13:12 -- nvmf/common.sh@297 -- # mlx=() 00:15:58.529 04:13:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:58.529 04:13:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:58.529 04:13:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:58.529 04:13:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:58.529 04:13:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:58.529 04:13:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.529 04:13:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:15:58.529 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:15:58.529 04:13:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.529 04:13:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:15:58.529 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:15:58.529 04:13:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:58.529 04:13:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:58.529 04:13:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.529 04:13:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.529 04:13:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.529 04:13:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.529 04:13:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:15:58.529 Found net devices under 0000:4b:00.0: cvl_0_0 00:15:58.529 04:13:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.530 04:13:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.530 04:13:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.530 04:13:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.530 04:13:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.530 04:13:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:15:58.530 Found net devices under 0000:4b:00.1: cvl_0_1 00:15:58.530 04:13:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.530 04:13:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:58.530 04:13:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:58.530 04:13:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:58.530 04:13:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:58.530 04:13:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:58.530 04:13:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:58.530 04:13:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:58.530 04:13:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:58.530 04:13:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:58.530 04:13:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:58.530 04:13:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:58.530 04:13:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:58.530 04:13:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:58.530 04:13:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:58.530 04:13:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:58.530 04:13:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:58.530 04:13:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:58.530 04:13:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:58.530 04:13:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:58.530 04:13:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:58.530 04:13:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:58.530 04:13:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:58.530 04:13:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:58.530 04:13:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:58.530 04:13:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:58.530 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:58.530 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.699 ms 00:15:58.530 00:15:58.530 --- 10.0.0.2 ping statistics --- 00:15:58.530 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.530 rtt min/avg/max/mdev = 0.699/0.699/0.699/0.000 ms 00:15:58.530 04:13:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:58.530 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:58.530 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.483 ms 00:15:58.530 00:15:58.530 --- 10.0.0.1 ping statistics --- 00:15:58.530 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.530 rtt min/avg/max/mdev = 0.483/0.483/0.483/0.000 ms 00:15:58.530 04:13:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:58.530 04:13:13 -- nvmf/common.sh@410 -- # return 0 00:15:58.530 04:13:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:58.530 04:13:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:58.530 04:13:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:58.530 04:13:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:58.530 04:13:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:58.530 04:13:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:58.530 04:13:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:58.530 04:13:13 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:15:58.530 04:13:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:15:58.530 04:13:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:58.530 04:13:13 -- common/autotest_common.sh@10 -- # set +x 00:15:58.530 ************************************ 00:15:58.530 START TEST nvmf_host_management 00:15:58.530 ************************************ 00:15:58.530 04:13:13 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:15:58.530 04:13:13 -- target/host_management.sh@69 -- # starttarget 00:15:58.530 04:13:13 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:15:58.530 04:13:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:58.530 04:13:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:58.530 04:13:13 -- common/autotest_common.sh@10 -- # set +x 00:15:58.530 04:13:13 -- nvmf/common.sh@469 -- # nvmfpid=3893659 00:15:58.530 04:13:13 -- nvmf/common.sh@470 -- # waitforlisten 3893659 00:15:58.530 04:13:13 -- common/autotest_common.sh@819 -- # '[' -z 3893659 ']' 00:15:58.530 04:13:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:15:58.530 04:13:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:58.530 04:13:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:58.530 04:13:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:58.530 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:58.530 04:13:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:58.530 04:13:13 -- common/autotest_common.sh@10 -- # set +x 00:15:58.791 [2024-05-14 04:13:13.146620] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:58.791 [2024-05-14 04:13:13.146685] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:58.791 EAL: No free 2048 kB hugepages reported on node 1 00:15:58.791 [2024-05-14 04:13:13.234309] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:58.791 [2024-05-14 04:13:13.327075] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:58.791 [2024-05-14 04:13:13.327241] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:58.791 [2024-05-14 04:13:13.327257] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:58.791 [2024-05-14 04:13:13.327265] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:58.791 [2024-05-14 04:13:13.327406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:58.791 [2024-05-14 04:13:13.327618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:58.791 [2024-05-14 04:13:13.327890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:58.791 [2024-05-14 04:13:13.327892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:59.363 04:13:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:59.363 04:13:13 -- common/autotest_common.sh@852 -- # return 0 00:15:59.363 04:13:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:59.363 04:13:13 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:59.363 04:13:13 -- common/autotest_common.sh@10 -- # set +x 00:15:59.622 04:13:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:59.622 04:13:13 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:59.622 04:13:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:59.622 04:13:13 -- common/autotest_common.sh@10 -- # set +x 00:15:59.622 [2024-05-14 04:13:13.974295] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:59.622 04:13:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:59.622 04:13:13 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:15:59.622 04:13:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:59.623 04:13:13 -- common/autotest_common.sh@10 -- # set +x 00:15:59.623 04:13:13 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:15:59.623 04:13:13 -- target/host_management.sh@23 -- # cat 00:15:59.623 04:13:13 -- target/host_management.sh@30 -- # rpc_cmd 00:15:59.623 04:13:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:59.623 04:13:13 -- common/autotest_common.sh@10 -- # set +x 00:15:59.623 Malloc0 00:15:59.623 [2024-05-14 04:13:14.033622] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:59.623 04:13:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:59.623 04:13:14 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:15:59.623 04:13:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:59.623 04:13:14 -- common/autotest_common.sh@10 -- # set +x 00:15:59.623 04:13:14 -- target/host_management.sh@73 -- # perfpid=3894029 00:15:59.623 04:13:14 -- target/host_management.sh@74 -- # waitforlisten 3894029 /var/tmp/bdevperf.sock 00:15:59.623 04:13:14 -- common/autotest_common.sh@819 -- # '[' -z 3894029 ']' 00:15:59.623 04:13:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:59.623 04:13:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:59.623 04:13:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:59.623 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:59.623 04:13:14 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:15:59.623 04:13:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:59.623 04:13:14 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:15:59.623 04:13:14 -- common/autotest_common.sh@10 -- # set +x 00:15:59.623 04:13:14 -- nvmf/common.sh@520 -- # config=() 00:15:59.623 04:13:14 -- nvmf/common.sh@520 -- # local subsystem config 00:15:59.623 04:13:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:59.623 04:13:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:59.623 { 00:15:59.623 "params": { 00:15:59.623 "name": "Nvme$subsystem", 00:15:59.623 "trtype": "$TEST_TRANSPORT", 00:15:59.623 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:59.623 "adrfam": "ipv4", 00:15:59.623 "trsvcid": "$NVMF_PORT", 00:15:59.623 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:59.623 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:59.623 "hdgst": ${hdgst:-false}, 00:15:59.623 "ddgst": ${ddgst:-false} 00:15:59.623 }, 00:15:59.623 "method": "bdev_nvme_attach_controller" 00:15:59.623 } 00:15:59.623 EOF 00:15:59.623 )") 00:15:59.623 04:13:14 -- nvmf/common.sh@542 -- # cat 00:15:59.623 04:13:14 -- nvmf/common.sh@544 -- # jq . 00:15:59.623 04:13:14 -- nvmf/common.sh@545 -- # IFS=, 00:15:59.623 04:13:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:59.623 "params": { 00:15:59.623 "name": "Nvme0", 00:15:59.623 "trtype": "tcp", 00:15:59.623 "traddr": "10.0.0.2", 00:15:59.623 "adrfam": "ipv4", 00:15:59.623 "trsvcid": "4420", 00:15:59.623 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:59.623 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:15:59.623 "hdgst": false, 00:15:59.623 "ddgst": false 00:15:59.623 }, 00:15:59.623 "method": "bdev_nvme_attach_controller" 00:15:59.623 }' 00:15:59.623 [2024-05-14 04:13:14.130748] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:59.623 [2024-05-14 04:13:14.130797] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3894029 ] 00:15:59.623 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.623 [2024-05-14 04:13:14.189448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:59.883 [2024-05-14 04:13:14.251919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:00.144 Running I/O for 10 seconds... 00:16:00.407 04:13:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:00.407 04:13:14 -- common/autotest_common.sh@852 -- # return 0 00:16:00.407 04:13:14 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:00.407 04:13:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:00.407 04:13:14 -- common/autotest_common.sh@10 -- # set +x 00:16:00.407 04:13:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:00.407 04:13:14 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:00.407 04:13:14 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:00.407 04:13:14 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:00.407 04:13:14 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:00.407 04:13:14 -- target/host_management.sh@52 -- # local ret=1 00:16:00.407 04:13:14 -- target/host_management.sh@53 -- # local i 00:16:00.407 04:13:14 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:00.407 04:13:14 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:00.407 04:13:14 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:00.407 04:13:14 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:00.407 04:13:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:00.407 04:13:14 -- common/autotest_common.sh@10 -- # set +x 00:16:00.407 04:13:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:00.407 04:13:14 -- target/host_management.sh@55 -- # read_io_count=826 00:16:00.407 04:13:14 -- target/host_management.sh@58 -- # '[' 826 -ge 100 ']' 00:16:00.407 04:13:14 -- target/host_management.sh@59 -- # ret=0 00:16:00.407 04:13:14 -- target/host_management.sh@60 -- # break 00:16:00.407 04:13:14 -- target/host_management.sh@64 -- # return 0 00:16:00.407 04:13:14 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:00.407 04:13:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:00.407 04:13:14 -- common/autotest_common.sh@10 -- # set +x 00:16:00.407 [2024-05-14 04:13:14.964705] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964778] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964787] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964793] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964800] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964807] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964814] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964821] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964833] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964840] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964846] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964853] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964860] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964866] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964873] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964879] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964886] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964893] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964899] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964912] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964919] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964932] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964939] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964945] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964965] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964977] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964984] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.964997] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.407 [2024-05-14 04:13:14.965003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.408 [2024-05-14 04:13:14.965011] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.408 [2024-05-14 04:13:14.965018] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.408 [2024-05-14 04:13:14.965024] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.408 [2024-05-14 04:13:14.965031] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.408 [2024-05-14 04:13:14.965037] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.408 [2024-05-14 04:13:14.965044] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x78c540 is same with the state(5) to be set 00:16:00.408 [2024-05-14 04:13:14.965912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:124288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.965946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.965964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:124416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.965973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.965982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:124544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.965990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.965999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:118784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:124672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:124800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:124928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:125056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:125184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:125312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:125440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:125568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:125696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:125824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:125952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:126080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:119296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:119424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:119552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:120064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:126208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:126336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:120448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:126464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:120832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:120960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:121088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:126592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:126720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:126848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:121216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.408 [2024-05-14 04:13:14.966469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.408 [2024-05-14 04:13:14.966479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:121344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:126976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:127104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:121472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:121728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:127232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:121856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:127360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:121984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:122112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:127488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:127616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:127744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:122624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:127872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:123136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:128000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:123264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:128128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:123392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:128256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:123520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:128384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:123648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:128512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:123776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:128640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:123904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:128768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:124032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.966990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.966999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:128896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.967007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.967016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:124160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:00.409 [2024-05-14 04:13:14.967023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.409 [2024-05-14 04:13:14.967031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x841370 is same with the state(5) to be set 00:16:00.410 [2024-05-14 04:13:14.967073] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x841370 was disconnected and freed. reset controller. 00:16:00.410 [2024-05-14 04:13:14.968263] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:00.410 04:13:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:00.410 task offset: 124288 on job bdev=Nvme0n1 fails 00:16:00.410 00:16:00.410 Latency(us) 00:16:00.410 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:00.410 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:00.410 Job: Nvme0n1 ended in about 0.41 seconds with error 00:16:00.410 Verification LBA range: start 0x0 length 0x400 00:16:00.410 Nvme0n1 : 0.41 2278.30 142.39 154.46 0.00 25830.59 1788.59 31675.73 00:16:00.410 =================================================================================================================== 00:16:00.410 Total : 2278.30 142.39 154.46 0.00 25830.59 1788.59 31675.73 00:16:00.410 04:13:14 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:00.410 [2024-05-14 04:13:14.970243] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:00.410 [2024-05-14 04:13:14.970267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8439c0 (9): Bad file descriptor 00:16:00.410 04:13:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:00.410 04:13:14 -- common/autotest_common.sh@10 -- # set +x 00:16:00.410 [2024-05-14 04:13:14.976450] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode0' does not allow host 'nqn.2016-06.io.spdk:host0' 00:16:00.410 [2024-05-14 04:13:14.976592] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:16:00.410 [2024-05-14 04:13:14.976616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND SPECIFIC (01/84) qid:0 cid:3 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:00.410 [2024-05-14 04:13:14.976631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode0 00:16:00.410 [2024-05-14 04:13:14.976638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 132 00:16:00.410 [2024-05-14 04:13:14.976646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:16:00.410 [2024-05-14 04:13:14.976657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x8439c0 00:16:00.410 [2024-05-14 04:13:14.976678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8439c0 (9): Bad file descriptor 00:16:00.410 [2024-05-14 04:13:14.976690] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:16:00.410 [2024-05-14 04:13:14.976697] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:16:00.410 [2024-05-14 04:13:14.976706] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:16:00.410 [2024-05-14 04:13:14.976718] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:00.410 04:13:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:00.410 04:13:14 -- target/host_management.sh@87 -- # sleep 1 00:16:01.796 04:13:15 -- target/host_management.sh@91 -- # kill -9 3894029 00:16:01.796 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3894029) - No such process 00:16:01.796 04:13:15 -- target/host_management.sh@91 -- # true 00:16:01.796 04:13:15 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:16:01.796 04:13:15 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:16:01.796 04:13:15 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:16:01.796 04:13:15 -- nvmf/common.sh@520 -- # config=() 00:16:01.796 04:13:15 -- nvmf/common.sh@520 -- # local subsystem config 00:16:01.796 04:13:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:01.796 04:13:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:01.796 { 00:16:01.796 "params": { 00:16:01.796 "name": "Nvme$subsystem", 00:16:01.796 "trtype": "$TEST_TRANSPORT", 00:16:01.796 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:01.796 "adrfam": "ipv4", 00:16:01.796 "trsvcid": "$NVMF_PORT", 00:16:01.796 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:01.796 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:01.796 "hdgst": ${hdgst:-false}, 00:16:01.796 "ddgst": ${ddgst:-false} 00:16:01.796 }, 00:16:01.796 "method": "bdev_nvme_attach_controller" 00:16:01.796 } 00:16:01.796 EOF 00:16:01.796 )") 00:16:01.796 04:13:15 -- nvmf/common.sh@542 -- # cat 00:16:01.796 04:13:15 -- nvmf/common.sh@544 -- # jq . 00:16:01.796 04:13:16 -- nvmf/common.sh@545 -- # IFS=, 00:16:01.796 04:13:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:01.796 "params": { 00:16:01.796 "name": "Nvme0", 00:16:01.796 "trtype": "tcp", 00:16:01.796 "traddr": "10.0.0.2", 00:16:01.796 "adrfam": "ipv4", 00:16:01.796 "trsvcid": "4420", 00:16:01.796 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:01.796 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:01.797 "hdgst": false, 00:16:01.797 "ddgst": false 00:16:01.797 }, 00:16:01.797 "method": "bdev_nvme_attach_controller" 00:16:01.797 }' 00:16:01.797 [2024-05-14 04:13:16.042428] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:01.797 [2024-05-14 04:13:16.042497] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3894399 ] 00:16:01.797 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.797 [2024-05-14 04:13:16.102716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:01.797 [2024-05-14 04:13:16.164197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:02.058 Running I/O for 1 seconds... 00:16:03.002 00:16:03.002 Latency(us) 00:16:03.002 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:03.002 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:03.002 Verification LBA range: start 0x0 length 0x400 00:16:03.002 Nvme0n1 : 1.07 2037.38 127.34 0.00 0.00 29822.52 4833.28 47185.92 00:16:03.002 =================================================================================================================== 00:16:03.002 Total : 2037.38 127.34 0.00 0.00 29822.52 4833.28 47185.92 00:16:03.263 04:13:17 -- target/host_management.sh@101 -- # stoptarget 00:16:03.263 04:13:17 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:16:03.263 04:13:17 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:16:03.263 04:13:17 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:03.263 04:13:17 -- target/host_management.sh@40 -- # nvmftestfini 00:16:03.263 04:13:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:03.263 04:13:17 -- nvmf/common.sh@116 -- # sync 00:16:03.263 04:13:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:03.263 04:13:17 -- nvmf/common.sh@119 -- # set +e 00:16:03.263 04:13:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:03.263 04:13:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:03.263 rmmod nvme_tcp 00:16:03.263 rmmod nvme_fabrics 00:16:03.263 rmmod nvme_keyring 00:16:03.263 04:13:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:03.263 04:13:17 -- nvmf/common.sh@123 -- # set -e 00:16:03.263 04:13:17 -- nvmf/common.sh@124 -- # return 0 00:16:03.263 04:13:17 -- nvmf/common.sh@477 -- # '[' -n 3893659 ']' 00:16:03.263 04:13:17 -- nvmf/common.sh@478 -- # killprocess 3893659 00:16:03.263 04:13:17 -- common/autotest_common.sh@926 -- # '[' -z 3893659 ']' 00:16:03.263 04:13:17 -- common/autotest_common.sh@930 -- # kill -0 3893659 00:16:03.263 04:13:17 -- common/autotest_common.sh@931 -- # uname 00:16:03.263 04:13:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:03.263 04:13:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3893659 00:16:03.263 04:13:17 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:03.263 04:13:17 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:03.263 04:13:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3893659' 00:16:03.263 killing process with pid 3893659 00:16:03.263 04:13:17 -- common/autotest_common.sh@945 -- # kill 3893659 00:16:03.263 04:13:17 -- common/autotest_common.sh@950 -- # wait 3893659 00:16:03.524 [2024-05-14 04:13:17.912981] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:16:03.524 04:13:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:03.524 04:13:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:03.524 04:13:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:03.524 04:13:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:03.524 04:13:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:03.524 04:13:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:03.524 04:13:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:03.524 04:13:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:05.441 04:13:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:05.441 00:16:05.441 real 0m6.918s 00:16:05.441 user 0m20.959s 00:16:05.441 sys 0m1.086s 00:16:05.441 04:13:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:05.441 04:13:20 -- common/autotest_common.sh@10 -- # set +x 00:16:05.441 ************************************ 00:16:05.441 END TEST nvmf_host_management 00:16:05.441 ************************************ 00:16:05.703 04:13:20 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:16:05.703 00:16:05.703 real 0m14.095s 00:16:05.703 user 0m22.850s 00:16:05.703 sys 0m6.288s 00:16:05.703 04:13:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:05.703 04:13:20 -- common/autotest_common.sh@10 -- # set +x 00:16:05.703 ************************************ 00:16:05.703 END TEST nvmf_host_management 00:16:05.703 ************************************ 00:16:05.703 04:13:20 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:05.703 04:13:20 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:05.703 04:13:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:05.703 04:13:20 -- common/autotest_common.sh@10 -- # set +x 00:16:05.703 ************************************ 00:16:05.703 START TEST nvmf_lvol 00:16:05.703 ************************************ 00:16:05.703 04:13:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:05.703 * Looking for test storage... 00:16:05.703 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:05.703 04:13:20 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:05.703 04:13:20 -- nvmf/common.sh@7 -- # uname -s 00:16:05.703 04:13:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:05.703 04:13:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:05.703 04:13:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:05.703 04:13:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:05.703 04:13:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:05.703 04:13:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:05.703 04:13:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:05.703 04:13:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:05.703 04:13:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:05.703 04:13:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:05.703 04:13:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:05.703 04:13:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:05.703 04:13:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:05.703 04:13:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:05.703 04:13:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:05.703 04:13:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:05.703 04:13:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:05.703 04:13:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:05.703 04:13:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:05.703 04:13:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:05.703 04:13:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:05.703 04:13:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:05.703 04:13:20 -- paths/export.sh@5 -- # export PATH 00:16:05.703 04:13:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:05.703 04:13:20 -- nvmf/common.sh@46 -- # : 0 00:16:05.703 04:13:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:05.703 04:13:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:05.703 04:13:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:05.703 04:13:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:05.703 04:13:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:05.703 04:13:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:05.703 04:13:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:05.703 04:13:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:05.703 04:13:20 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:05.703 04:13:20 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:05.703 04:13:20 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:16:05.703 04:13:20 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:16:05.703 04:13:20 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:05.703 04:13:20 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:16:05.703 04:13:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:05.703 04:13:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:05.703 04:13:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:05.703 04:13:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:05.703 04:13:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:05.703 04:13:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:05.703 04:13:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:05.703 04:13:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:05.703 04:13:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:05.703 04:13:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:05.703 04:13:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:05.703 04:13:20 -- common/autotest_common.sh@10 -- # set +x 00:16:13.854 04:13:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:13.854 04:13:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:13.854 04:13:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:13.854 04:13:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:13.854 04:13:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:13.854 04:13:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:13.854 04:13:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:13.854 04:13:26 -- nvmf/common.sh@294 -- # net_devs=() 00:16:13.854 04:13:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:13.854 04:13:26 -- nvmf/common.sh@295 -- # e810=() 00:16:13.854 04:13:26 -- nvmf/common.sh@295 -- # local -ga e810 00:16:13.854 04:13:26 -- nvmf/common.sh@296 -- # x722=() 00:16:13.854 04:13:26 -- nvmf/common.sh@296 -- # local -ga x722 00:16:13.854 04:13:26 -- nvmf/common.sh@297 -- # mlx=() 00:16:13.854 04:13:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:13.854 04:13:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:13.854 04:13:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:13.854 04:13:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:13.854 04:13:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:13.854 04:13:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:13.854 04:13:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:16:13.854 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:16:13.854 04:13:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:13.854 04:13:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:16:13.854 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:16:13.854 04:13:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:13.854 04:13:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:13.854 04:13:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:13.854 04:13:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:13.854 04:13:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:13.854 04:13:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:16:13.854 Found net devices under 0000:4b:00.0: cvl_0_0 00:16:13.854 04:13:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:13.854 04:13:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:13.854 04:13:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:13.854 04:13:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:13.854 04:13:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:13.854 04:13:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:16:13.854 Found net devices under 0000:4b:00.1: cvl_0_1 00:16:13.854 04:13:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:13.854 04:13:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:13.854 04:13:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:13.854 04:13:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:13.854 04:13:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:13.854 04:13:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:13.854 04:13:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:13.854 04:13:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:13.854 04:13:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:13.854 04:13:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:13.854 04:13:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:13.854 04:13:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:13.854 04:13:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:13.854 04:13:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:13.854 04:13:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:13.854 04:13:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:13.854 04:13:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:13.854 04:13:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:13.854 04:13:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:13.854 04:13:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:13.854 04:13:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:13.854 04:13:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:13.854 04:13:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:13.854 04:13:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:13.854 04:13:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:13.854 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:13.854 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.559 ms 00:16:13.854 00:16:13.854 --- 10.0.0.2 ping statistics --- 00:16:13.854 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:13.854 rtt min/avg/max/mdev = 0.559/0.559/0.559/0.000 ms 00:16:13.854 04:13:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:13.854 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:13.854 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.445 ms 00:16:13.854 00:16:13.854 --- 10.0.0.1 ping statistics --- 00:16:13.854 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:13.854 rtt min/avg/max/mdev = 0.445/0.445/0.445/0.000 ms 00:16:13.854 04:13:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:13.854 04:13:27 -- nvmf/common.sh@410 -- # return 0 00:16:13.854 04:13:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:13.854 04:13:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:13.854 04:13:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:13.854 04:13:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:13.854 04:13:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:13.854 04:13:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:13.854 04:13:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:13.854 04:13:27 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:16:13.854 04:13:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:13.854 04:13:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:13.854 04:13:27 -- common/autotest_common.sh@10 -- # set +x 00:16:13.854 04:13:27 -- nvmf/common.sh@469 -- # nvmfpid=3898780 00:16:13.854 04:13:27 -- nvmf/common.sh@470 -- # waitforlisten 3898780 00:16:13.854 04:13:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:13.854 04:13:27 -- common/autotest_common.sh@819 -- # '[' -z 3898780 ']' 00:16:13.854 04:13:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:13.854 04:13:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:13.854 04:13:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:13.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:13.854 04:13:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:13.854 04:13:27 -- common/autotest_common.sh@10 -- # set +x 00:16:13.854 [2024-05-14 04:13:27.406343] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:13.854 [2024-05-14 04:13:27.406410] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:13.854 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.854 [2024-05-14 04:13:27.477781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:13.854 [2024-05-14 04:13:27.551963] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:13.854 [2024-05-14 04:13:27.552090] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:13.854 [2024-05-14 04:13:27.552098] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:13.854 [2024-05-14 04:13:27.552105] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:13.854 [2024-05-14 04:13:27.552240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:13.854 [2024-05-14 04:13:27.552426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:13.854 [2024-05-14 04:13:27.552550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:13.854 04:13:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:13.854 04:13:28 -- common/autotest_common.sh@852 -- # return 0 00:16:13.855 04:13:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:13.855 04:13:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:13.855 04:13:28 -- common/autotest_common.sh@10 -- # set +x 00:16:13.855 04:13:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:13.855 04:13:28 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:13.855 [2024-05-14 04:13:28.365116] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:13.855 04:13:28 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:14.153 04:13:28 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:16:14.153 04:13:28 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:14.414 04:13:28 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:16:14.414 04:13:28 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:16:14.414 04:13:28 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:16:14.684 04:13:29 -- target/nvmf_lvol.sh@29 -- # lvs=3360efa6-7cd0-48fe-b735-c60d05891fe4 00:16:14.684 04:13:29 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 3360efa6-7cd0-48fe-b735-c60d05891fe4 lvol 20 00:16:14.945 04:13:29 -- target/nvmf_lvol.sh@32 -- # lvol=4fe70bbf-f00f-4802-ba35-553390c9b59b 00:16:14.945 04:13:29 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:14.945 04:13:29 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 4fe70bbf-f00f-4802-ba35-553390c9b59b 00:16:15.206 04:13:29 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:15.206 [2024-05-14 04:13:29.717770] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:15.206 04:13:29 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:15.466 04:13:29 -- target/nvmf_lvol.sh@42 -- # perf_pid=3899483 00:16:15.466 04:13:29 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:16:15.466 04:13:29 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:16:15.466 EAL: No free 2048 kB hugepages reported on node 1 00:16:16.409 04:13:30 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 4fe70bbf-f00f-4802-ba35-553390c9b59b MY_SNAPSHOT 00:16:16.670 04:13:31 -- target/nvmf_lvol.sh@47 -- # snapshot=15cc2390-67f9-48c6-affe-363815c6f6e8 00:16:16.670 04:13:31 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 4fe70bbf-f00f-4802-ba35-553390c9b59b 30 00:16:16.931 04:13:31 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 15cc2390-67f9-48c6-affe-363815c6f6e8 MY_CLONE 00:16:16.931 04:13:31 -- target/nvmf_lvol.sh@49 -- # clone=d0b4b838-a5e3-4f34-b13c-6a9ae0d1a88a 00:16:16.931 04:13:31 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate d0b4b838-a5e3-4f34-b13c-6a9ae0d1a88a 00:16:17.503 04:13:31 -- target/nvmf_lvol.sh@53 -- # wait 3899483 00:16:25.642 Initializing NVMe Controllers 00:16:25.642 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:16:25.642 Controller IO queue size 128, less than required. 00:16:25.642 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:25.642 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:16:25.642 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:16:25.642 Initialization complete. Launching workers. 00:16:25.642 ======================================================== 00:16:25.642 Latency(us) 00:16:25.642 Device Information : IOPS MiB/s Average min max 00:16:25.642 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 17770.70 69.42 7204.82 1761.26 49793.17 00:16:25.642 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 12606.30 49.24 10155.43 3902.28 49288.60 00:16:25.642 ======================================================== 00:16:25.642 Total : 30377.00 118.66 8429.31 1761.26 49793.17 00:16:25.642 00:16:25.642 04:13:40 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:16:25.903 04:13:40 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4fe70bbf-f00f-4802-ba35-553390c9b59b 00:16:25.903 04:13:40 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 3360efa6-7cd0-48fe-b735-c60d05891fe4 00:16:26.163 04:13:40 -- target/nvmf_lvol.sh@60 -- # rm -f 00:16:26.163 04:13:40 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:16:26.163 04:13:40 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:16:26.163 04:13:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:26.163 04:13:40 -- nvmf/common.sh@116 -- # sync 00:16:26.163 04:13:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:26.163 04:13:40 -- nvmf/common.sh@119 -- # set +e 00:16:26.163 04:13:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:26.163 04:13:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:26.163 rmmod nvme_tcp 00:16:26.163 rmmod nvme_fabrics 00:16:26.163 rmmod nvme_keyring 00:16:26.163 04:13:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:26.163 04:13:40 -- nvmf/common.sh@123 -- # set -e 00:16:26.163 04:13:40 -- nvmf/common.sh@124 -- # return 0 00:16:26.163 04:13:40 -- nvmf/common.sh@477 -- # '[' -n 3898780 ']' 00:16:26.163 04:13:40 -- nvmf/common.sh@478 -- # killprocess 3898780 00:16:26.163 04:13:40 -- common/autotest_common.sh@926 -- # '[' -z 3898780 ']' 00:16:26.163 04:13:40 -- common/autotest_common.sh@930 -- # kill -0 3898780 00:16:26.163 04:13:40 -- common/autotest_common.sh@931 -- # uname 00:16:26.163 04:13:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:26.163 04:13:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3898780 00:16:26.424 04:13:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:26.424 04:13:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:26.424 04:13:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3898780' 00:16:26.424 killing process with pid 3898780 00:16:26.424 04:13:40 -- common/autotest_common.sh@945 -- # kill 3898780 00:16:26.424 04:13:40 -- common/autotest_common.sh@950 -- # wait 3898780 00:16:26.424 04:13:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:26.424 04:13:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:26.424 04:13:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:26.424 04:13:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:26.424 04:13:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:26.424 04:13:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.424 04:13:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.424 04:13:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:28.972 04:13:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:28.972 00:16:28.972 real 0m22.899s 00:16:28.972 user 1m3.171s 00:16:28.972 sys 0m7.600s 00:16:28.972 04:13:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:28.972 04:13:42 -- common/autotest_common.sh@10 -- # set +x 00:16:28.972 ************************************ 00:16:28.972 END TEST nvmf_lvol 00:16:28.972 ************************************ 00:16:28.972 04:13:43 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:16:28.972 04:13:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:28.972 04:13:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:28.972 04:13:43 -- common/autotest_common.sh@10 -- # set +x 00:16:28.972 ************************************ 00:16:28.972 START TEST nvmf_lvs_grow 00:16:28.972 ************************************ 00:16:28.972 04:13:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:16:28.972 * Looking for test storage... 00:16:28.972 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:28.972 04:13:43 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:28.972 04:13:43 -- nvmf/common.sh@7 -- # uname -s 00:16:28.972 04:13:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:28.972 04:13:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:28.972 04:13:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:28.972 04:13:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:28.972 04:13:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:28.972 04:13:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:28.973 04:13:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:28.973 04:13:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:28.973 04:13:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:28.973 04:13:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:28.973 04:13:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:28.973 04:13:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:28.973 04:13:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:28.973 04:13:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:28.973 04:13:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:28.973 04:13:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:28.973 04:13:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:28.973 04:13:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:28.973 04:13:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:28.973 04:13:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.973 04:13:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.973 04:13:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.973 04:13:43 -- paths/export.sh@5 -- # export PATH 00:16:28.973 04:13:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.973 04:13:43 -- nvmf/common.sh@46 -- # : 0 00:16:28.973 04:13:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:28.973 04:13:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:28.973 04:13:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:28.973 04:13:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:28.973 04:13:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:28.973 04:13:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:28.973 04:13:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:28.973 04:13:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:28.973 04:13:43 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:28.973 04:13:43 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:28.973 04:13:43 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:16:28.973 04:13:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:28.973 04:13:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:28.973 04:13:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:28.973 04:13:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:28.973 04:13:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:28.973 04:13:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:28.973 04:13:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:28.973 04:13:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:28.973 04:13:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:28.973 04:13:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:28.973 04:13:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:28.973 04:13:43 -- common/autotest_common.sh@10 -- # set +x 00:16:35.564 04:13:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:35.564 04:13:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:35.564 04:13:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:35.564 04:13:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:35.564 04:13:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:35.564 04:13:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:35.564 04:13:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:35.564 04:13:49 -- nvmf/common.sh@294 -- # net_devs=() 00:16:35.564 04:13:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:35.564 04:13:49 -- nvmf/common.sh@295 -- # e810=() 00:16:35.564 04:13:49 -- nvmf/common.sh@295 -- # local -ga e810 00:16:35.564 04:13:49 -- nvmf/common.sh@296 -- # x722=() 00:16:35.564 04:13:49 -- nvmf/common.sh@296 -- # local -ga x722 00:16:35.564 04:13:49 -- nvmf/common.sh@297 -- # mlx=() 00:16:35.564 04:13:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:35.564 04:13:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:35.564 04:13:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:35.564 04:13:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:35.564 04:13:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:35.564 04:13:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:35.564 04:13:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:16:35.564 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:16:35.564 04:13:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:35.564 04:13:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:16:35.564 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:16:35.564 04:13:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:35.564 04:13:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:35.564 04:13:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:35.564 04:13:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:35.564 04:13:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:35.564 04:13:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:35.564 04:13:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:16:35.565 Found net devices under 0000:4b:00.0: cvl_0_0 00:16:35.565 04:13:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:35.565 04:13:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:35.565 04:13:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:35.565 04:13:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:35.565 04:13:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:35.565 04:13:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:16:35.565 Found net devices under 0000:4b:00.1: cvl_0_1 00:16:35.565 04:13:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:35.565 04:13:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:35.565 04:13:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:35.565 04:13:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:35.565 04:13:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:35.565 04:13:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:35.565 04:13:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:35.565 04:13:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:35.565 04:13:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:35.565 04:13:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:35.565 04:13:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:35.565 04:13:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:35.565 04:13:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:35.565 04:13:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:35.565 04:13:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:35.565 04:13:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:35.565 04:13:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:35.565 04:13:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:35.565 04:13:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:35.565 04:13:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:35.565 04:13:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:35.565 04:13:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:35.565 04:13:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:35.565 04:13:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:35.565 04:13:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:35.826 04:13:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:35.826 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:35.826 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.703 ms 00:16:35.826 00:16:35.826 --- 10.0.0.2 ping statistics --- 00:16:35.826 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:35.826 rtt min/avg/max/mdev = 0.703/0.703/0.703/0.000 ms 00:16:35.826 04:13:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:35.826 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:35.826 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.440 ms 00:16:35.826 00:16:35.826 --- 10.0.0.1 ping statistics --- 00:16:35.826 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:35.826 rtt min/avg/max/mdev = 0.440/0.440/0.440/0.000 ms 00:16:35.826 04:13:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:35.826 04:13:50 -- nvmf/common.sh@410 -- # return 0 00:16:35.826 04:13:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:35.826 04:13:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:35.826 04:13:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:35.826 04:13:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:35.826 04:13:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:35.826 04:13:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:35.826 04:13:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:35.826 04:13:50 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:16:35.826 04:13:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:35.826 04:13:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:35.826 04:13:50 -- common/autotest_common.sh@10 -- # set +x 00:16:35.826 04:13:50 -- nvmf/common.sh@469 -- # nvmfpid=3905567 00:16:35.826 04:13:50 -- nvmf/common.sh@470 -- # waitforlisten 3905567 00:16:35.826 04:13:50 -- common/autotest_common.sh@819 -- # '[' -z 3905567 ']' 00:16:35.826 04:13:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:35.826 04:13:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:35.826 04:13:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:35.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:35.826 04:13:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:35.826 04:13:50 -- common/autotest_common.sh@10 -- # set +x 00:16:35.826 04:13:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:35.826 [2024-05-14 04:13:50.271823] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:35.826 [2024-05-14 04:13:50.271888] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:35.826 EAL: No free 2048 kB hugepages reported on node 1 00:16:35.826 [2024-05-14 04:13:50.341767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:36.088 [2024-05-14 04:13:50.415076] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:36.088 [2024-05-14 04:13:50.415201] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:36.088 [2024-05-14 04:13:50.415210] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:36.088 [2024-05-14 04:13:50.415217] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:36.088 [2024-05-14 04:13:50.415235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:36.660 04:13:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:36.660 04:13:51 -- common/autotest_common.sh@852 -- # return 0 00:16:36.660 04:13:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:36.660 04:13:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:36.660 04:13:51 -- common/autotest_common.sh@10 -- # set +x 00:16:36.660 04:13:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:36.660 04:13:51 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:36.660 [2024-05-14 04:13:51.207201] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:36.660 04:13:51 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:16:36.660 04:13:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:16:36.660 04:13:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:36.660 04:13:51 -- common/autotest_common.sh@10 -- # set +x 00:16:36.660 ************************************ 00:16:36.660 START TEST lvs_grow_clean 00:16:36.660 ************************************ 00:16:36.660 04:13:51 -- common/autotest_common.sh@1104 -- # lvs_grow 00:16:36.660 04:13:51 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:16:36.660 04:13:51 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:16:36.660 04:13:51 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:16:36.660 04:13:51 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:16:36.660 04:13:51 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:16:36.660 04:13:51 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:16:36.661 04:13:51 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:36.922 04:13:51 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:36.922 04:13:51 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:36.922 04:13:51 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:16:36.922 04:13:51 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:16:37.183 04:13:51 -- target/nvmf_lvs_grow.sh@28 -- # lvs=1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:37.183 04:13:51 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:37.183 04:13:51 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:16:37.183 04:13:51 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:16:37.183 04:13:51 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:16:37.183 04:13:51 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed lvol 150 00:16:37.445 04:13:51 -- target/nvmf_lvs_grow.sh@33 -- # lvol=7bd5088f-bc91-4405-acf0-ca8b36f9aa6b 00:16:37.445 04:13:51 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:37.445 04:13:51 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:16:37.706 [2024-05-14 04:13:52.033708] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:16:37.706 [2024-05-14 04:13:52.033762] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:16:37.706 true 00:16:37.706 04:13:52 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:16:37.706 04:13:52 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:37.706 04:13:52 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:16:37.706 04:13:52 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:37.967 04:13:52 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 7bd5088f-bc91-4405-acf0-ca8b36f9aa6b 00:16:37.967 04:13:52 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:38.228 [2024-05-14 04:13:52.611512] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:38.228 04:13:52 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:38.228 04:13:52 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3906249 00:16:38.229 04:13:52 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:38.229 04:13:52 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3906249 /var/tmp/bdevperf.sock 00:16:38.229 04:13:52 -- common/autotest_common.sh@819 -- # '[' -z 3906249 ']' 00:16:38.229 04:13:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:38.229 04:13:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:38.229 04:13:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:38.229 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:38.229 04:13:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:38.229 04:13:52 -- common/autotest_common.sh@10 -- # set +x 00:16:38.229 04:13:52 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:16:38.523 [2024-05-14 04:13:52.828118] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:38.523 [2024-05-14 04:13:52.828185] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3906249 ] 00:16:38.523 EAL: No free 2048 kB hugepages reported on node 1 00:16:38.523 [2024-05-14 04:13:52.904447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:38.523 [2024-05-14 04:13:52.966847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:39.094 04:13:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:39.094 04:13:53 -- common/autotest_common.sh@852 -- # return 0 00:16:39.094 04:13:53 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:16:39.666 Nvme0n1 00:16:39.666 04:13:53 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:16:39.666 [ 00:16:39.666 { 00:16:39.666 "name": "Nvme0n1", 00:16:39.666 "aliases": [ 00:16:39.666 "7bd5088f-bc91-4405-acf0-ca8b36f9aa6b" 00:16:39.666 ], 00:16:39.666 "product_name": "NVMe disk", 00:16:39.666 "block_size": 4096, 00:16:39.666 "num_blocks": 38912, 00:16:39.666 "uuid": "7bd5088f-bc91-4405-acf0-ca8b36f9aa6b", 00:16:39.666 "assigned_rate_limits": { 00:16:39.666 "rw_ios_per_sec": 0, 00:16:39.666 "rw_mbytes_per_sec": 0, 00:16:39.666 "r_mbytes_per_sec": 0, 00:16:39.666 "w_mbytes_per_sec": 0 00:16:39.666 }, 00:16:39.666 "claimed": false, 00:16:39.666 "zoned": false, 00:16:39.666 "supported_io_types": { 00:16:39.666 "read": true, 00:16:39.666 "write": true, 00:16:39.666 "unmap": true, 00:16:39.666 "write_zeroes": true, 00:16:39.666 "flush": true, 00:16:39.666 "reset": true, 00:16:39.666 "compare": true, 00:16:39.666 "compare_and_write": true, 00:16:39.666 "abort": true, 00:16:39.666 "nvme_admin": true, 00:16:39.666 "nvme_io": true 00:16:39.666 }, 00:16:39.667 "driver_specific": { 00:16:39.667 "nvme": [ 00:16:39.667 { 00:16:39.667 "trid": { 00:16:39.667 "trtype": "TCP", 00:16:39.667 "adrfam": "IPv4", 00:16:39.667 "traddr": "10.0.0.2", 00:16:39.667 "trsvcid": "4420", 00:16:39.667 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:16:39.667 }, 00:16:39.667 "ctrlr_data": { 00:16:39.667 "cntlid": 1, 00:16:39.667 "vendor_id": "0x8086", 00:16:39.667 "model_number": "SPDK bdev Controller", 00:16:39.667 "serial_number": "SPDK0", 00:16:39.667 "firmware_revision": "24.01.1", 00:16:39.667 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:39.667 "oacs": { 00:16:39.667 "security": 0, 00:16:39.667 "format": 0, 00:16:39.667 "firmware": 0, 00:16:39.667 "ns_manage": 0 00:16:39.667 }, 00:16:39.667 "multi_ctrlr": true, 00:16:39.667 "ana_reporting": false 00:16:39.667 }, 00:16:39.667 "vs": { 00:16:39.667 "nvme_version": "1.3" 00:16:39.667 }, 00:16:39.667 "ns_data": { 00:16:39.667 "id": 1, 00:16:39.667 "can_share": true 00:16:39.667 } 00:16:39.667 } 00:16:39.667 ], 00:16:39.667 "mp_policy": "active_passive" 00:16:39.667 } 00:16:39.667 } 00:16:39.667 ] 00:16:39.667 04:13:54 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3906513 00:16:39.667 04:13:54 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:16:39.667 04:13:54 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:16:39.667 Running I/O for 10 seconds... 00:16:41.055 Latency(us) 00:16:41.055 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:41.055 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:41.055 Nvme0n1 : 1.00 18532.00 72.39 0.00 0.00 0.00 0.00 0.00 00:16:41.055 =================================================================================================================== 00:16:41.055 Total : 18532.00 72.39 0.00 0.00 0.00 0.00 0.00 00:16:41.055 00:16:41.626 04:13:56 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:41.626 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:41.626 Nvme0n1 : 2.00 18665.50 72.91 0.00 0.00 0.00 0.00 0.00 00:16:41.626 =================================================================================================================== 00:16:41.626 Total : 18665.50 72.91 0.00 0.00 0.00 0.00 0.00 00:16:41.626 00:16:41.887 true 00:16:41.887 04:13:56 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:41.887 04:13:56 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:16:41.887 04:13:56 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:16:41.887 04:13:56 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:16:41.887 04:13:56 -- target/nvmf_lvs_grow.sh@65 -- # wait 3906513 00:16:42.830 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:42.830 Nvme0n1 : 3.00 18727.00 73.15 0.00 0.00 0.00 0.00 0.00 00:16:42.830 =================================================================================================================== 00:16:42.830 Total : 18727.00 73.15 0.00 0.00 0.00 0.00 0.00 00:16:42.830 00:16:43.771 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:43.771 Nvme0n1 : 4.00 18765.25 73.30 0.00 0.00 0.00 0.00 0.00 00:16:43.771 =================================================================================================================== 00:16:43.771 Total : 18765.25 73.30 0.00 0.00 0.00 0.00 0.00 00:16:43.771 00:16:44.713 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:44.713 Nvme0n1 : 5.00 18794.20 73.41 0.00 0.00 0.00 0.00 0.00 00:16:44.713 =================================================================================================================== 00:16:44.713 Total : 18794.20 73.41 0.00 0.00 0.00 0.00 0.00 00:16:44.713 00:16:45.654 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:45.654 Nvme0n1 : 6.00 18819.17 73.51 0.00 0.00 0.00 0.00 0.00 00:16:45.654 =================================================================================================================== 00:16:45.654 Total : 18819.17 73.51 0.00 0.00 0.00 0.00 0.00 00:16:45.654 00:16:47.038 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:47.038 Nvme0n1 : 7.00 18835.14 73.57 0.00 0.00 0.00 0.00 0.00 00:16:47.038 =================================================================================================================== 00:16:47.038 Total : 18835.14 73.57 0.00 0.00 0.00 0.00 0.00 00:16:47.038 00:16:47.978 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:47.978 Nvme0n1 : 8.00 18850.38 73.63 0.00 0.00 0.00 0.00 0.00 00:16:47.978 =================================================================================================================== 00:16:47.978 Total : 18850.38 73.63 0.00 0.00 0.00 0.00 0.00 00:16:47.978 00:16:48.919 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:48.919 Nvme0n1 : 9.00 18860.78 73.67 0.00 0.00 0.00 0.00 0.00 00:16:48.919 =================================================================================================================== 00:16:48.919 Total : 18860.78 73.67 0.00 0.00 0.00 0.00 0.00 00:16:48.919 00:16:49.860 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:49.860 Nvme0n1 : 10.00 18869.10 73.71 0.00 0.00 0.00 0.00 0.00 00:16:49.860 =================================================================================================================== 00:16:49.860 Total : 18869.10 73.71 0.00 0.00 0.00 0.00 0.00 00:16:49.860 00:16:49.860 00:16:49.860 Latency(us) 00:16:49.860 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:49.860 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:49.860 Nvme0n1 : 10.01 18871.50 73.72 0.00 0.00 6778.72 2375.68 14964.05 00:16:49.860 =================================================================================================================== 00:16:49.860 Total : 18871.50 73.72 0.00 0.00 6778.72 2375.68 14964.05 00:16:49.860 0 00:16:49.860 04:14:04 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3906249 00:16:49.860 04:14:04 -- common/autotest_common.sh@926 -- # '[' -z 3906249 ']' 00:16:49.860 04:14:04 -- common/autotest_common.sh@930 -- # kill -0 3906249 00:16:49.860 04:14:04 -- common/autotest_common.sh@931 -- # uname 00:16:49.860 04:14:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:49.860 04:14:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3906249 00:16:49.860 04:14:04 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:49.860 04:14:04 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:49.860 04:14:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3906249' 00:16:49.860 killing process with pid 3906249 00:16:49.860 04:14:04 -- common/autotest_common.sh@945 -- # kill 3906249 00:16:49.860 Received shutdown signal, test time was about 10.000000 seconds 00:16:49.860 00:16:49.860 Latency(us) 00:16:49.860 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:49.860 =================================================================================================================== 00:16:49.860 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:49.860 04:14:04 -- common/autotest_common.sh@950 -- # wait 3906249 00:16:49.860 04:14:04 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:16:50.121 04:14:04 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:50.121 04:14:04 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:16:50.381 04:14:04 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:16:50.381 04:14:04 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:16:50.381 04:14:04 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:16:50.381 [2024-05-14 04:14:04.892422] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:16:50.381 04:14:04 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:50.381 04:14:04 -- common/autotest_common.sh@640 -- # local es=0 00:16:50.381 04:14:04 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:50.381 04:14:04 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:50.381 04:14:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:50.381 04:14:04 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:50.381 04:14:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:50.381 04:14:04 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:50.381 04:14:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:50.381 04:14:04 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:50.381 04:14:04 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:16:50.381 04:14:04 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:50.641 request: 00:16:50.641 { 00:16:50.641 "uuid": "1ff26fa4-3db6-4a74-973c-e9b8534fbbed", 00:16:50.641 "method": "bdev_lvol_get_lvstores", 00:16:50.641 "req_id": 1 00:16:50.641 } 00:16:50.641 Got JSON-RPC error response 00:16:50.641 response: 00:16:50.641 { 00:16:50.641 "code": -19, 00:16:50.641 "message": "No such device" 00:16:50.641 } 00:16:50.641 04:14:05 -- common/autotest_common.sh@643 -- # es=1 00:16:50.641 04:14:05 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:16:50.641 04:14:05 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:16:50.641 04:14:05 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:16:50.641 04:14:05 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:50.641 aio_bdev 00:16:50.901 04:14:05 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 7bd5088f-bc91-4405-acf0-ca8b36f9aa6b 00:16:50.901 04:14:05 -- common/autotest_common.sh@887 -- # local bdev_name=7bd5088f-bc91-4405-acf0-ca8b36f9aa6b 00:16:50.901 04:14:05 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:16:50.901 04:14:05 -- common/autotest_common.sh@889 -- # local i 00:16:50.901 04:14:05 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:16:50.901 04:14:05 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:16:50.901 04:14:05 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:16:50.901 04:14:05 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 7bd5088f-bc91-4405-acf0-ca8b36f9aa6b -t 2000 00:16:51.162 [ 00:16:51.162 { 00:16:51.162 "name": "7bd5088f-bc91-4405-acf0-ca8b36f9aa6b", 00:16:51.162 "aliases": [ 00:16:51.162 "lvs/lvol" 00:16:51.162 ], 00:16:51.162 "product_name": "Logical Volume", 00:16:51.162 "block_size": 4096, 00:16:51.162 "num_blocks": 38912, 00:16:51.162 "uuid": "7bd5088f-bc91-4405-acf0-ca8b36f9aa6b", 00:16:51.162 "assigned_rate_limits": { 00:16:51.162 "rw_ios_per_sec": 0, 00:16:51.162 "rw_mbytes_per_sec": 0, 00:16:51.162 "r_mbytes_per_sec": 0, 00:16:51.162 "w_mbytes_per_sec": 0 00:16:51.162 }, 00:16:51.162 "claimed": false, 00:16:51.162 "zoned": false, 00:16:51.162 "supported_io_types": { 00:16:51.162 "read": true, 00:16:51.162 "write": true, 00:16:51.162 "unmap": true, 00:16:51.162 "write_zeroes": true, 00:16:51.162 "flush": false, 00:16:51.162 "reset": true, 00:16:51.162 "compare": false, 00:16:51.162 "compare_and_write": false, 00:16:51.162 "abort": false, 00:16:51.162 "nvme_admin": false, 00:16:51.162 "nvme_io": false 00:16:51.162 }, 00:16:51.162 "driver_specific": { 00:16:51.162 "lvol": { 00:16:51.162 "lvol_store_uuid": "1ff26fa4-3db6-4a74-973c-e9b8534fbbed", 00:16:51.162 "base_bdev": "aio_bdev", 00:16:51.162 "thin_provision": false, 00:16:51.162 "snapshot": false, 00:16:51.162 "clone": false, 00:16:51.162 "esnap_clone": false 00:16:51.162 } 00:16:51.162 } 00:16:51.162 } 00:16:51.162 ] 00:16:51.162 04:14:05 -- common/autotest_common.sh@895 -- # return 0 00:16:51.162 04:14:05 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:51.162 04:14:05 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:16:51.162 04:14:05 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:16:51.162 04:14:05 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:51.162 04:14:05 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:16:51.424 04:14:05 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:16:51.424 04:14:05 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7bd5088f-bc91-4405-acf0-ca8b36f9aa6b 00:16:51.424 04:14:05 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 1ff26fa4-3db6-4a74-973c-e9b8534fbbed 00:16:51.685 04:14:06 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:16:51.946 04:14:06 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:51.946 00:16:51.946 real 0m15.129s 00:16:51.946 user 0m14.843s 00:16:51.946 sys 0m1.232s 00:16:51.946 04:14:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:51.946 04:14:06 -- common/autotest_common.sh@10 -- # set +x 00:16:51.946 ************************************ 00:16:51.946 END TEST lvs_grow_clean 00:16:51.946 ************************************ 00:16:51.946 04:14:06 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:16:51.946 04:14:06 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:51.946 04:14:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:51.946 04:14:06 -- common/autotest_common.sh@10 -- # set +x 00:16:51.946 ************************************ 00:16:51.946 START TEST lvs_grow_dirty 00:16:51.946 ************************************ 00:16:51.946 04:14:06 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:16:51.946 04:14:06 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:16:51.946 04:14:06 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:16:51.946 04:14:06 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:16:51.946 04:14:06 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:16:51.947 04:14:06 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:16:51.947 04:14:06 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:16:51.947 04:14:06 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:51.947 04:14:06 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:51.947 04:14:06 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:52.208 04:14:06 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:16:52.208 04:14:06 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:16:52.208 04:14:06 -- target/nvmf_lvs_grow.sh@28 -- # lvs=75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:16:52.208 04:14:06 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:16:52.208 04:14:06 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:16:52.469 04:14:06 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:16:52.469 04:14:06 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:16:52.469 04:14:06 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 lvol 150 00:16:52.730 04:14:07 -- target/nvmf_lvs_grow.sh@33 -- # lvol=ee689dd4-cf8d-48fc-9b4d-3f1cd494613a 00:16:52.730 04:14:07 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:52.730 04:14:07 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:16:52.730 [2024-05-14 04:14:07.213876] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:16:52.730 [2024-05-14 04:14:07.213929] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:16:52.730 true 00:16:52.730 04:14:07 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:16:52.730 04:14:07 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:16:52.991 04:14:07 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:16:52.992 04:14:07 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:52.992 04:14:07 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 ee689dd4-cf8d-48fc-9b4d-3f1cd494613a 00:16:53.252 04:14:07 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:53.252 04:14:07 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:53.513 04:14:07 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3909318 00:16:53.513 04:14:07 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:53.513 04:14:07 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3909318 /var/tmp/bdevperf.sock 00:16:53.513 04:14:07 -- common/autotest_common.sh@819 -- # '[' -z 3909318 ']' 00:16:53.513 04:14:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:53.513 04:14:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:53.513 04:14:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:53.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:53.513 04:14:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:53.513 04:14:07 -- common/autotest_common.sh@10 -- # set +x 00:16:53.513 04:14:07 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:16:53.513 [2024-05-14 04:14:08.032261] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:53.513 [2024-05-14 04:14:08.032329] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3909318 ] 00:16:53.513 EAL: No free 2048 kB hugepages reported on node 1 00:16:53.775 [2024-05-14 04:14:08.105979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:53.775 [2024-05-14 04:14:08.158717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:54.381 04:14:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:54.381 04:14:08 -- common/autotest_common.sh@852 -- # return 0 00:16:54.381 04:14:08 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:16:54.655 Nvme0n1 00:16:54.655 04:14:09 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:16:54.917 [ 00:16:54.917 { 00:16:54.917 "name": "Nvme0n1", 00:16:54.917 "aliases": [ 00:16:54.917 "ee689dd4-cf8d-48fc-9b4d-3f1cd494613a" 00:16:54.917 ], 00:16:54.917 "product_name": "NVMe disk", 00:16:54.917 "block_size": 4096, 00:16:54.917 "num_blocks": 38912, 00:16:54.917 "uuid": "ee689dd4-cf8d-48fc-9b4d-3f1cd494613a", 00:16:54.917 "assigned_rate_limits": { 00:16:54.917 "rw_ios_per_sec": 0, 00:16:54.917 "rw_mbytes_per_sec": 0, 00:16:54.917 "r_mbytes_per_sec": 0, 00:16:54.917 "w_mbytes_per_sec": 0 00:16:54.917 }, 00:16:54.917 "claimed": false, 00:16:54.917 "zoned": false, 00:16:54.917 "supported_io_types": { 00:16:54.917 "read": true, 00:16:54.917 "write": true, 00:16:54.917 "unmap": true, 00:16:54.917 "write_zeroes": true, 00:16:54.917 "flush": true, 00:16:54.917 "reset": true, 00:16:54.917 "compare": true, 00:16:54.917 "compare_and_write": true, 00:16:54.917 "abort": true, 00:16:54.917 "nvme_admin": true, 00:16:54.917 "nvme_io": true 00:16:54.917 }, 00:16:54.917 "driver_specific": { 00:16:54.917 "nvme": [ 00:16:54.917 { 00:16:54.917 "trid": { 00:16:54.917 "trtype": "TCP", 00:16:54.917 "adrfam": "IPv4", 00:16:54.917 "traddr": "10.0.0.2", 00:16:54.917 "trsvcid": "4420", 00:16:54.917 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:16:54.917 }, 00:16:54.917 "ctrlr_data": { 00:16:54.917 "cntlid": 1, 00:16:54.917 "vendor_id": "0x8086", 00:16:54.917 "model_number": "SPDK bdev Controller", 00:16:54.917 "serial_number": "SPDK0", 00:16:54.917 "firmware_revision": "24.01.1", 00:16:54.917 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:54.917 "oacs": { 00:16:54.917 "security": 0, 00:16:54.917 "format": 0, 00:16:54.917 "firmware": 0, 00:16:54.917 "ns_manage": 0 00:16:54.917 }, 00:16:54.917 "multi_ctrlr": true, 00:16:54.917 "ana_reporting": false 00:16:54.917 }, 00:16:54.917 "vs": { 00:16:54.917 "nvme_version": "1.3" 00:16:54.917 }, 00:16:54.917 "ns_data": { 00:16:54.917 "id": 1, 00:16:54.917 "can_share": true 00:16:54.917 } 00:16:54.917 } 00:16:54.917 ], 00:16:54.917 "mp_policy": "active_passive" 00:16:54.917 } 00:16:54.917 } 00:16:54.917 ] 00:16:54.917 04:14:09 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3909473 00:16:54.917 04:14:09 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:16:54.917 04:14:09 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:16:54.917 Running I/O for 10 seconds... 00:16:55.861 Latency(us) 00:16:55.861 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:55.861 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:55.861 Nvme0n1 : 1.00 18397.00 71.86 0.00 0.00 0.00 0.00 0.00 00:16:55.861 =================================================================================================================== 00:16:55.861 Total : 18397.00 71.86 0.00 0.00 0.00 0.00 0.00 00:16:55.861 00:16:56.805 04:14:11 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:16:57.066 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:57.066 Nvme0n1 : 2.00 18600.00 72.66 0.00 0.00 0.00 0.00 0.00 00:16:57.066 =================================================================================================================== 00:16:57.066 Total : 18600.00 72.66 0.00 0.00 0.00 0.00 0.00 00:16:57.066 00:16:57.066 true 00:16:57.066 04:14:11 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:16:57.066 04:14:11 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:16:57.066 04:14:11 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:16:57.066 04:14:11 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:16:57.066 04:14:11 -- target/nvmf_lvs_grow.sh@65 -- # wait 3909473 00:16:58.010 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:58.010 Nvme0n1 : 3.00 18676.33 72.95 0.00 0.00 0.00 0.00 0.00 00:16:58.010 =================================================================================================================== 00:16:58.010 Total : 18676.33 72.95 0.00 0.00 0.00 0.00 0.00 00:16:58.010 00:16:58.952 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:58.952 Nvme0n1 : 4.00 18711.25 73.09 0.00 0.00 0.00 0.00 0.00 00:16:58.952 =================================================================================================================== 00:16:58.952 Total : 18711.25 73.09 0.00 0.00 0.00 0.00 0.00 00:16:58.952 00:16:59.893 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:59.893 Nvme0n1 : 5.00 18751.80 73.25 0.00 0.00 0.00 0.00 0.00 00:16:59.893 =================================================================================================================== 00:16:59.893 Total : 18751.80 73.25 0.00 0.00 0.00 0.00 0.00 00:16:59.893 00:17:00.836 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:00.836 Nvme0n1 : 6.00 18778.17 73.35 0.00 0.00 0.00 0.00 0.00 00:17:00.836 =================================================================================================================== 00:17:00.836 Total : 18778.17 73.35 0.00 0.00 0.00 0.00 0.00 00:17:00.836 00:17:02.220 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:02.220 Nvme0n1 : 7.00 18801.86 73.44 0.00 0.00 0.00 0.00 0.00 00:17:02.220 =================================================================================================================== 00:17:02.220 Total : 18801.86 73.44 0.00 0.00 0.00 0.00 0.00 00:17:02.220 00:17:03.163 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:03.163 Nvme0n1 : 8.00 18811.62 73.48 0.00 0.00 0.00 0.00 0.00 00:17:03.163 =================================================================================================================== 00:17:03.163 Total : 18811.62 73.48 0.00 0.00 0.00 0.00 0.00 00:17:03.163 00:17:04.104 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:04.104 Nvme0n1 : 9.00 18826.33 73.54 0.00 0.00 0.00 0.00 0.00 00:17:04.104 =================================================================================================================== 00:17:04.104 Total : 18826.33 73.54 0.00 0.00 0.00 0.00 0.00 00:17:04.104 00:17:05.044 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:05.044 Nvme0n1 : 10.00 18838.10 73.59 0.00 0.00 0.00 0.00 0.00 00:17:05.044 =================================================================================================================== 00:17:05.044 Total : 18838.10 73.59 0.00 0.00 0.00 0.00 0.00 00:17:05.044 00:17:05.044 00:17:05.044 Latency(us) 00:17:05.044 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:05.044 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:05.044 Nvme0n1 : 10.00 18842.59 73.60 0.00 0.00 6789.86 4751.36 19442.35 00:17:05.044 =================================================================================================================== 00:17:05.044 Total : 18842.59 73.60 0.00 0.00 6789.86 4751.36 19442.35 00:17:05.044 0 00:17:05.044 04:14:19 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3909318 00:17:05.044 04:14:19 -- common/autotest_common.sh@926 -- # '[' -z 3909318 ']' 00:17:05.044 04:14:19 -- common/autotest_common.sh@930 -- # kill -0 3909318 00:17:05.044 04:14:19 -- common/autotest_common.sh@931 -- # uname 00:17:05.044 04:14:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:05.044 04:14:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3909318 00:17:05.044 04:14:19 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:05.044 04:14:19 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:05.044 04:14:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3909318' 00:17:05.044 killing process with pid 3909318 00:17:05.044 04:14:19 -- common/autotest_common.sh@945 -- # kill 3909318 00:17:05.044 Received shutdown signal, test time was about 10.000000 seconds 00:17:05.044 00:17:05.044 Latency(us) 00:17:05.044 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:05.044 =================================================================================================================== 00:17:05.044 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:05.044 04:14:19 -- common/autotest_common.sh@950 -- # wait 3909318 00:17:05.044 04:14:19 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:05.304 04:14:19 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:17:05.304 04:14:19 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:05.564 04:14:19 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:05.564 04:14:19 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:17:05.564 04:14:19 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3905567 00:17:05.564 04:14:19 -- target/nvmf_lvs_grow.sh@74 -- # wait 3905567 00:17:05.564 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3905567 Killed "${NVMF_APP[@]}" "$@" 00:17:05.564 04:14:19 -- target/nvmf_lvs_grow.sh@74 -- # true 00:17:05.564 04:14:19 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:17:05.564 04:14:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:05.564 04:14:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:05.564 04:14:19 -- common/autotest_common.sh@10 -- # set +x 00:17:05.564 04:14:19 -- nvmf/common.sh@469 -- # nvmfpid=3911664 00:17:05.564 04:14:19 -- nvmf/common.sh@470 -- # waitforlisten 3911664 00:17:05.564 04:14:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:05.564 04:14:19 -- common/autotest_common.sh@819 -- # '[' -z 3911664 ']' 00:17:05.564 04:14:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:05.564 04:14:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:05.564 04:14:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:05.564 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:05.564 04:14:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:05.564 04:14:19 -- common/autotest_common.sh@10 -- # set +x 00:17:05.564 [2024-05-14 04:14:20.043558] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:05.564 [2024-05-14 04:14:20.043613] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:05.564 EAL: No free 2048 kB hugepages reported on node 1 00:17:05.564 [2024-05-14 04:14:20.109641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:05.824 [2024-05-14 04:14:20.172853] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:05.824 [2024-05-14 04:14:20.172975] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:05.824 [2024-05-14 04:14:20.172983] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:05.824 [2024-05-14 04:14:20.172991] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:05.824 [2024-05-14 04:14:20.173012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:06.395 04:14:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:06.395 04:14:20 -- common/autotest_common.sh@852 -- # return 0 00:17:06.395 04:14:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:06.395 04:14:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:06.395 04:14:20 -- common/autotest_common.sh@10 -- # set +x 00:17:06.395 04:14:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:06.395 04:14:20 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:06.395 [2024-05-14 04:14:20.977881] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:17:06.395 [2024-05-14 04:14:20.977966] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:17:06.395 [2024-05-14 04:14:20.977995] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:17:06.656 04:14:20 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:17:06.656 04:14:20 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev ee689dd4-cf8d-48fc-9b4d-3f1cd494613a 00:17:06.656 04:14:20 -- common/autotest_common.sh@887 -- # local bdev_name=ee689dd4-cf8d-48fc-9b4d-3f1cd494613a 00:17:06.656 04:14:20 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:17:06.656 04:14:20 -- common/autotest_common.sh@889 -- # local i 00:17:06.656 04:14:20 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:17:06.656 04:14:20 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:17:06.656 04:14:20 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:06.656 04:14:21 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b ee689dd4-cf8d-48fc-9b4d-3f1cd494613a -t 2000 00:17:06.917 [ 00:17:06.917 { 00:17:06.917 "name": "ee689dd4-cf8d-48fc-9b4d-3f1cd494613a", 00:17:06.917 "aliases": [ 00:17:06.917 "lvs/lvol" 00:17:06.917 ], 00:17:06.917 "product_name": "Logical Volume", 00:17:06.917 "block_size": 4096, 00:17:06.917 "num_blocks": 38912, 00:17:06.917 "uuid": "ee689dd4-cf8d-48fc-9b4d-3f1cd494613a", 00:17:06.917 "assigned_rate_limits": { 00:17:06.917 "rw_ios_per_sec": 0, 00:17:06.917 "rw_mbytes_per_sec": 0, 00:17:06.917 "r_mbytes_per_sec": 0, 00:17:06.917 "w_mbytes_per_sec": 0 00:17:06.917 }, 00:17:06.917 "claimed": false, 00:17:06.917 "zoned": false, 00:17:06.917 "supported_io_types": { 00:17:06.917 "read": true, 00:17:06.917 "write": true, 00:17:06.917 "unmap": true, 00:17:06.917 "write_zeroes": true, 00:17:06.917 "flush": false, 00:17:06.917 "reset": true, 00:17:06.917 "compare": false, 00:17:06.917 "compare_and_write": false, 00:17:06.917 "abort": false, 00:17:06.917 "nvme_admin": false, 00:17:06.917 "nvme_io": false 00:17:06.917 }, 00:17:06.917 "driver_specific": { 00:17:06.917 "lvol": { 00:17:06.917 "lvol_store_uuid": "75acdf00-96c1-4b8c-b7dd-44c7e0222597", 00:17:06.917 "base_bdev": "aio_bdev", 00:17:06.917 "thin_provision": false, 00:17:06.917 "snapshot": false, 00:17:06.917 "clone": false, 00:17:06.917 "esnap_clone": false 00:17:06.917 } 00:17:06.917 } 00:17:06.917 } 00:17:06.917 ] 00:17:06.917 04:14:21 -- common/autotest_common.sh@895 -- # return 0 00:17:06.917 04:14:21 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:17:06.917 04:14:21 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:17:06.917 04:14:21 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:17:06.917 04:14:21 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:17:06.917 04:14:21 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:17:07.177 04:14:21 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:17:07.177 04:14:21 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:07.178 [2024-05-14 04:14:21.729777] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:07.439 04:14:21 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:17:07.439 04:14:21 -- common/autotest_common.sh@640 -- # local es=0 00:17:07.439 04:14:21 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:17:07.439 04:14:21 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:07.439 04:14:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:07.439 04:14:21 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:07.439 04:14:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:07.439 04:14:21 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:07.439 04:14:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:07.439 04:14:21 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:07.439 04:14:21 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:07.439 04:14:21 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:17:07.439 request: 00:17:07.439 { 00:17:07.439 "uuid": "75acdf00-96c1-4b8c-b7dd-44c7e0222597", 00:17:07.439 "method": "bdev_lvol_get_lvstores", 00:17:07.439 "req_id": 1 00:17:07.439 } 00:17:07.439 Got JSON-RPC error response 00:17:07.439 response: 00:17:07.439 { 00:17:07.439 "code": -19, 00:17:07.439 "message": "No such device" 00:17:07.439 } 00:17:07.439 04:14:21 -- common/autotest_common.sh@643 -- # es=1 00:17:07.439 04:14:21 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:07.439 04:14:21 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:07.439 04:14:21 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:07.439 04:14:21 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:07.700 aio_bdev 00:17:07.700 04:14:22 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev ee689dd4-cf8d-48fc-9b4d-3f1cd494613a 00:17:07.700 04:14:22 -- common/autotest_common.sh@887 -- # local bdev_name=ee689dd4-cf8d-48fc-9b4d-3f1cd494613a 00:17:07.700 04:14:22 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:17:07.700 04:14:22 -- common/autotest_common.sh@889 -- # local i 00:17:07.700 04:14:22 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:17:07.700 04:14:22 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:17:07.700 04:14:22 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:07.700 04:14:22 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b ee689dd4-cf8d-48fc-9b4d-3f1cd494613a -t 2000 00:17:08.123 [ 00:17:08.123 { 00:17:08.123 "name": "ee689dd4-cf8d-48fc-9b4d-3f1cd494613a", 00:17:08.123 "aliases": [ 00:17:08.123 "lvs/lvol" 00:17:08.123 ], 00:17:08.123 "product_name": "Logical Volume", 00:17:08.123 "block_size": 4096, 00:17:08.123 "num_blocks": 38912, 00:17:08.123 "uuid": "ee689dd4-cf8d-48fc-9b4d-3f1cd494613a", 00:17:08.123 "assigned_rate_limits": { 00:17:08.123 "rw_ios_per_sec": 0, 00:17:08.123 "rw_mbytes_per_sec": 0, 00:17:08.123 "r_mbytes_per_sec": 0, 00:17:08.123 "w_mbytes_per_sec": 0 00:17:08.123 }, 00:17:08.123 "claimed": false, 00:17:08.123 "zoned": false, 00:17:08.123 "supported_io_types": { 00:17:08.123 "read": true, 00:17:08.123 "write": true, 00:17:08.123 "unmap": true, 00:17:08.123 "write_zeroes": true, 00:17:08.123 "flush": false, 00:17:08.123 "reset": true, 00:17:08.123 "compare": false, 00:17:08.123 "compare_and_write": false, 00:17:08.123 "abort": false, 00:17:08.123 "nvme_admin": false, 00:17:08.123 "nvme_io": false 00:17:08.123 }, 00:17:08.123 "driver_specific": { 00:17:08.123 "lvol": { 00:17:08.123 "lvol_store_uuid": "75acdf00-96c1-4b8c-b7dd-44c7e0222597", 00:17:08.123 "base_bdev": "aio_bdev", 00:17:08.123 "thin_provision": false, 00:17:08.123 "snapshot": false, 00:17:08.123 "clone": false, 00:17:08.123 "esnap_clone": false 00:17:08.123 } 00:17:08.123 } 00:17:08.123 } 00:17:08.123 ] 00:17:08.123 04:14:22 -- common/autotest_common.sh@895 -- # return 0 00:17:08.123 04:14:22 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:17:08.123 04:14:22 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:08.123 04:14:22 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:08.123 04:14:22 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:17:08.123 04:14:22 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:08.123 04:14:22 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:08.123 04:14:22 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ee689dd4-cf8d-48fc-9b4d-3f1cd494613a 00:17:08.383 04:14:22 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 75acdf00-96c1-4b8c-b7dd-44c7e0222597 00:17:08.643 04:14:23 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:08.643 04:14:23 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:08.643 00:17:08.643 real 0m16.798s 00:17:08.643 user 0m43.870s 00:17:08.643 sys 0m2.811s 00:17:08.643 04:14:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:08.643 04:14:23 -- common/autotest_common.sh@10 -- # set +x 00:17:08.643 ************************************ 00:17:08.643 END TEST lvs_grow_dirty 00:17:08.643 ************************************ 00:17:08.903 04:14:23 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:17:08.903 04:14:23 -- common/autotest_common.sh@796 -- # type=--id 00:17:08.903 04:14:23 -- common/autotest_common.sh@797 -- # id=0 00:17:08.903 04:14:23 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:17:08.903 04:14:23 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:08.903 04:14:23 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:17:08.903 04:14:23 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:17:08.903 04:14:23 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:17:08.903 04:14:23 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:08.903 nvmf_trace.0 00:17:08.903 04:14:23 -- common/autotest_common.sh@811 -- # return 0 00:17:08.903 04:14:23 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:17:08.903 04:14:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:08.903 04:14:23 -- nvmf/common.sh@116 -- # sync 00:17:08.903 04:14:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:08.903 04:14:23 -- nvmf/common.sh@119 -- # set +e 00:17:08.903 04:14:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:08.903 04:14:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:08.903 rmmod nvme_tcp 00:17:08.903 rmmod nvme_fabrics 00:17:08.903 rmmod nvme_keyring 00:17:08.903 04:14:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:08.903 04:14:23 -- nvmf/common.sh@123 -- # set -e 00:17:08.903 04:14:23 -- nvmf/common.sh@124 -- # return 0 00:17:08.903 04:14:23 -- nvmf/common.sh@477 -- # '[' -n 3911664 ']' 00:17:08.903 04:14:23 -- nvmf/common.sh@478 -- # killprocess 3911664 00:17:08.903 04:14:23 -- common/autotest_common.sh@926 -- # '[' -z 3911664 ']' 00:17:08.903 04:14:23 -- common/autotest_common.sh@930 -- # kill -0 3911664 00:17:08.903 04:14:23 -- common/autotest_common.sh@931 -- # uname 00:17:08.903 04:14:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:08.903 04:14:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3911664 00:17:08.903 04:14:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:08.903 04:14:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:08.903 04:14:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3911664' 00:17:08.903 killing process with pid 3911664 00:17:08.903 04:14:23 -- common/autotest_common.sh@945 -- # kill 3911664 00:17:08.903 04:14:23 -- common/autotest_common.sh@950 -- # wait 3911664 00:17:09.162 04:14:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:09.162 04:14:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:09.162 04:14:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:09.162 04:14:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:09.162 04:14:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:09.162 04:14:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:09.162 04:14:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:09.162 04:14:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.074 04:14:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:11.074 00:17:11.074 real 0m42.596s 00:17:11.074 user 1m4.520s 00:17:11.074 sys 0m9.657s 00:17:11.074 04:14:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:11.074 04:14:25 -- common/autotest_common.sh@10 -- # set +x 00:17:11.074 ************************************ 00:17:11.074 END TEST nvmf_lvs_grow 00:17:11.074 ************************************ 00:17:11.335 04:14:25 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:11.335 04:14:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:11.335 04:14:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:11.335 04:14:25 -- common/autotest_common.sh@10 -- # set +x 00:17:11.335 ************************************ 00:17:11.335 START TEST nvmf_bdev_io_wait 00:17:11.335 ************************************ 00:17:11.335 04:14:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:11.335 * Looking for test storage... 00:17:11.335 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:11.335 04:14:25 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:11.335 04:14:25 -- nvmf/common.sh@7 -- # uname -s 00:17:11.335 04:14:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:11.335 04:14:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:11.335 04:14:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:11.335 04:14:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:11.335 04:14:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:11.335 04:14:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:11.335 04:14:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:11.335 04:14:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:11.335 04:14:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:11.335 04:14:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:11.335 04:14:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:11.335 04:14:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:11.335 04:14:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:11.335 04:14:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:11.335 04:14:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:11.335 04:14:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:11.336 04:14:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:11.336 04:14:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:11.336 04:14:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:11.336 04:14:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.336 04:14:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.336 04:14:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.336 04:14:25 -- paths/export.sh@5 -- # export PATH 00:17:11.336 04:14:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.336 04:14:25 -- nvmf/common.sh@46 -- # : 0 00:17:11.336 04:14:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:11.336 04:14:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:11.336 04:14:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:11.336 04:14:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:11.336 04:14:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:11.336 04:14:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:11.336 04:14:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:11.336 04:14:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:11.336 04:14:25 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:11.336 04:14:25 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:11.336 04:14:25 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:17:11.336 04:14:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:11.336 04:14:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:11.336 04:14:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:11.336 04:14:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:11.336 04:14:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:11.336 04:14:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:11.336 04:14:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:11.336 04:14:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.336 04:14:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:11.336 04:14:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:11.336 04:14:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:11.336 04:14:25 -- common/autotest_common.sh@10 -- # set +x 00:17:19.481 04:14:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:19.481 04:14:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:19.481 04:14:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:19.481 04:14:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:19.481 04:14:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:19.481 04:14:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:19.481 04:14:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:19.481 04:14:32 -- nvmf/common.sh@294 -- # net_devs=() 00:17:19.481 04:14:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:19.481 04:14:32 -- nvmf/common.sh@295 -- # e810=() 00:17:19.481 04:14:32 -- nvmf/common.sh@295 -- # local -ga e810 00:17:19.481 04:14:32 -- nvmf/common.sh@296 -- # x722=() 00:17:19.481 04:14:32 -- nvmf/common.sh@296 -- # local -ga x722 00:17:19.481 04:14:32 -- nvmf/common.sh@297 -- # mlx=() 00:17:19.481 04:14:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:19.481 04:14:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:19.481 04:14:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:19.481 04:14:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:19.481 04:14:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:19.481 04:14:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:19.481 04:14:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:17:19.481 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:17:19.481 04:14:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:19.481 04:14:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:17:19.481 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:17:19.481 04:14:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:19.481 04:14:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:19.481 04:14:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:19.481 04:14:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:19.481 04:14:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:19.482 04:14:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:19.482 04:14:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:17:19.482 Found net devices under 0000:4b:00.0: cvl_0_0 00:17:19.482 04:14:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:19.482 04:14:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:19.482 04:14:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:19.482 04:14:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:19.482 04:14:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:19.482 04:14:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:17:19.482 Found net devices under 0000:4b:00.1: cvl_0_1 00:17:19.482 04:14:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:19.482 04:14:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:19.482 04:14:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:19.482 04:14:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:19.482 04:14:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:19.482 04:14:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:19.482 04:14:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:19.482 04:14:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:19.482 04:14:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:19.482 04:14:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:19.482 04:14:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:19.482 04:14:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:19.482 04:14:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:19.482 04:14:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:19.482 04:14:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:19.482 04:14:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:19.482 04:14:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:19.482 04:14:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:19.482 04:14:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:19.482 04:14:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:19.482 04:14:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:19.482 04:14:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:19.482 04:14:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:19.482 04:14:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:19.482 04:14:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:19.482 04:14:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:19.482 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:19.482 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.675 ms 00:17:19.482 00:17:19.482 --- 10.0.0.2 ping statistics --- 00:17:19.482 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:19.482 rtt min/avg/max/mdev = 0.675/0.675/0.675/0.000 ms 00:17:19.482 04:14:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:19.482 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:19.482 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.432 ms 00:17:19.482 00:17:19.482 --- 10.0.0.1 ping statistics --- 00:17:19.482 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:19.482 rtt min/avg/max/mdev = 0.432/0.432/0.432/0.000 ms 00:17:19.482 04:14:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:19.482 04:14:32 -- nvmf/common.sh@410 -- # return 0 00:17:19.482 04:14:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:19.482 04:14:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:19.482 04:14:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:19.482 04:14:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:19.482 04:14:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:19.482 04:14:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:19.482 04:14:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:19.482 04:14:32 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:17:19.482 04:14:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:19.482 04:14:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:19.482 04:14:32 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 04:14:32 -- nvmf/common.sh@469 -- # nvmfpid=3916500 00:17:19.482 04:14:32 -- nvmf/common.sh@470 -- # waitforlisten 3916500 00:17:19.482 04:14:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:17:19.482 04:14:32 -- common/autotest_common.sh@819 -- # '[' -z 3916500 ']' 00:17:19.482 04:14:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:19.482 04:14:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:19.482 04:14:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:19.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:19.482 04:14:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:19.482 04:14:32 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 [2024-05-14 04:14:32.980660] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:19.482 [2024-05-14 04:14:32.980723] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:19.482 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.482 [2024-05-14 04:14:33.051982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:19.482 [2024-05-14 04:14:33.128304] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:19.482 [2024-05-14 04:14:33.128436] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:19.482 [2024-05-14 04:14:33.128447] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:19.482 [2024-05-14 04:14:33.128455] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:19.482 [2024-05-14 04:14:33.128545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:19.482 [2024-05-14 04:14:33.128661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:19.482 [2024-05-14 04:14:33.128818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:19.482 [2024-05-14 04:14:33.128820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:19.482 04:14:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:19.482 04:14:33 -- common/autotest_common.sh@852 -- # return 0 00:17:19.482 04:14:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:19.482 04:14:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:19.482 04:14:33 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 04:14:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:17:19.482 04:14:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:19.482 04:14:33 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 04:14:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:17:19.482 04:14:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:19.482 04:14:33 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 04:14:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:19.482 04:14:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:19.482 04:14:33 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 [2024-05-14 04:14:33.864875] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:19.482 04:14:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:19.482 04:14:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:19.482 04:14:33 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 Malloc0 00:17:19.482 04:14:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:19.482 04:14:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:19.482 04:14:33 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 04:14:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:19.482 04:14:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:19.482 04:14:33 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 04:14:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:19.482 04:14:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:19.482 04:14:33 -- common/autotest_common.sh@10 -- # set +x 00:17:19.482 [2024-05-14 04:14:33.934539] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:19.482 04:14:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3916705 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@30 -- # READ_PID=3916708 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:17:19.482 04:14:33 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:17:19.482 04:14:33 -- nvmf/common.sh@520 -- # config=() 00:17:19.483 04:14:33 -- nvmf/common.sh@520 -- # local subsystem config 00:17:19.483 04:14:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:19.483 04:14:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:19.483 { 00:17:19.483 "params": { 00:17:19.483 "name": "Nvme$subsystem", 00:17:19.483 "trtype": "$TEST_TRANSPORT", 00:17:19.483 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.483 "adrfam": "ipv4", 00:17:19.483 "trsvcid": "$NVMF_PORT", 00:17:19.483 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.483 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.483 "hdgst": ${hdgst:-false}, 00:17:19.483 "ddgst": ${ddgst:-false} 00:17:19.483 }, 00:17:19.483 "method": "bdev_nvme_attach_controller" 00:17:19.483 } 00:17:19.483 EOF 00:17:19.483 )") 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3916711 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:17:19.483 04:14:33 -- nvmf/common.sh@520 -- # config=() 00:17:19.483 04:14:33 -- nvmf/common.sh@520 -- # local subsystem config 00:17:19.483 04:14:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:19.483 04:14:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:19.483 { 00:17:19.483 "params": { 00:17:19.483 "name": "Nvme$subsystem", 00:17:19.483 "trtype": "$TEST_TRANSPORT", 00:17:19.483 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.483 "adrfam": "ipv4", 00:17:19.483 "trsvcid": "$NVMF_PORT", 00:17:19.483 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.483 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.483 "hdgst": ${hdgst:-false}, 00:17:19.483 "ddgst": ${ddgst:-false} 00:17:19.483 }, 00:17:19.483 "method": "bdev_nvme_attach_controller" 00:17:19.483 } 00:17:19.483 EOF 00:17:19.483 )") 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3916715 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@35 -- # sync 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:17:19.483 04:14:33 -- nvmf/common.sh@520 -- # config=() 00:17:19.483 04:14:33 -- nvmf/common.sh@542 -- # cat 00:17:19.483 04:14:33 -- nvmf/common.sh@520 -- # local subsystem config 00:17:19.483 04:14:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:19.483 04:14:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:19.483 { 00:17:19.483 "params": { 00:17:19.483 "name": "Nvme$subsystem", 00:17:19.483 "trtype": "$TEST_TRANSPORT", 00:17:19.483 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.483 "adrfam": "ipv4", 00:17:19.483 "trsvcid": "$NVMF_PORT", 00:17:19.483 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.483 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.483 "hdgst": ${hdgst:-false}, 00:17:19.483 "ddgst": ${ddgst:-false} 00:17:19.483 }, 00:17:19.483 "method": "bdev_nvme_attach_controller" 00:17:19.483 } 00:17:19.483 EOF 00:17:19.483 )") 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:17:19.483 04:14:33 -- nvmf/common.sh@520 -- # config=() 00:17:19.483 04:14:33 -- nvmf/common.sh@542 -- # cat 00:17:19.483 04:14:33 -- nvmf/common.sh@520 -- # local subsystem config 00:17:19.483 04:14:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:19.483 04:14:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:19.483 { 00:17:19.483 "params": { 00:17:19.483 "name": "Nvme$subsystem", 00:17:19.483 "trtype": "$TEST_TRANSPORT", 00:17:19.483 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:19.483 "adrfam": "ipv4", 00:17:19.483 "trsvcid": "$NVMF_PORT", 00:17:19.483 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:19.483 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:19.483 "hdgst": ${hdgst:-false}, 00:17:19.483 "ddgst": ${ddgst:-false} 00:17:19.483 }, 00:17:19.483 "method": "bdev_nvme_attach_controller" 00:17:19.483 } 00:17:19.483 EOF 00:17:19.483 )") 00:17:19.483 04:14:33 -- nvmf/common.sh@542 -- # cat 00:17:19.483 04:14:33 -- target/bdev_io_wait.sh@37 -- # wait 3916705 00:17:19.483 04:14:33 -- nvmf/common.sh@542 -- # cat 00:17:19.483 04:14:33 -- nvmf/common.sh@544 -- # jq . 00:17:19.483 04:14:33 -- nvmf/common.sh@544 -- # jq . 00:17:19.483 04:14:33 -- nvmf/common.sh@544 -- # jq . 00:17:19.483 04:14:33 -- nvmf/common.sh@545 -- # IFS=, 00:17:19.483 04:14:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:19.483 "params": { 00:17:19.483 "name": "Nvme1", 00:17:19.483 "trtype": "tcp", 00:17:19.483 "traddr": "10.0.0.2", 00:17:19.483 "adrfam": "ipv4", 00:17:19.483 "trsvcid": "4420", 00:17:19.483 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:19.483 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:19.483 "hdgst": false, 00:17:19.483 "ddgst": false 00:17:19.483 }, 00:17:19.483 "method": "bdev_nvme_attach_controller" 00:17:19.483 }' 00:17:19.483 04:14:33 -- nvmf/common.sh@544 -- # jq . 00:17:19.483 04:14:33 -- nvmf/common.sh@545 -- # IFS=, 00:17:19.483 04:14:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:19.483 "params": { 00:17:19.483 "name": "Nvme1", 00:17:19.483 "trtype": "tcp", 00:17:19.483 "traddr": "10.0.0.2", 00:17:19.483 "adrfam": "ipv4", 00:17:19.483 "trsvcid": "4420", 00:17:19.483 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:19.483 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:19.483 "hdgst": false, 00:17:19.483 "ddgst": false 00:17:19.483 }, 00:17:19.483 "method": "bdev_nvme_attach_controller" 00:17:19.483 }' 00:17:19.483 04:14:33 -- nvmf/common.sh@545 -- # IFS=, 00:17:19.483 04:14:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:19.483 "params": { 00:17:19.483 "name": "Nvme1", 00:17:19.483 "trtype": "tcp", 00:17:19.483 "traddr": "10.0.0.2", 00:17:19.483 "adrfam": "ipv4", 00:17:19.483 "trsvcid": "4420", 00:17:19.483 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:19.483 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:19.483 "hdgst": false, 00:17:19.483 "ddgst": false 00:17:19.483 }, 00:17:19.483 "method": "bdev_nvme_attach_controller" 00:17:19.483 }' 00:17:19.483 04:14:33 -- nvmf/common.sh@545 -- # IFS=, 00:17:19.483 04:14:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:19.483 "params": { 00:17:19.483 "name": "Nvme1", 00:17:19.483 "trtype": "tcp", 00:17:19.483 "traddr": "10.0.0.2", 00:17:19.483 "adrfam": "ipv4", 00:17:19.483 "trsvcid": "4420", 00:17:19.483 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:19.483 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:19.483 "hdgst": false, 00:17:19.483 "ddgst": false 00:17:19.483 }, 00:17:19.483 "method": "bdev_nvme_attach_controller" 00:17:19.483 }' 00:17:19.483 [2024-05-14 04:14:33.985748] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:19.483 [2024-05-14 04:14:33.985797] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:17:19.483 [2024-05-14 04:14:33.986225] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:19.483 [2024-05-14 04:14:33.986275] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:17:19.483 [2024-05-14 04:14:33.987375] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:19.483 [2024-05-14 04:14:33.987426] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:17:19.483 [2024-05-14 04:14:33.987820] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:19.484 [2024-05-14 04:14:33.987862] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:17:19.484 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.744 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.744 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.744 [2024-05-14 04:14:34.122072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.744 [2024-05-14 04:14:34.162317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.744 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.744 [2024-05-14 04:14:34.170771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:19.744 [2024-05-14 04:14:34.209522] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.744 [2024-05-14 04:14:34.210315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:19.744 [2024-05-14 04:14:34.258233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:17:19.744 [2024-05-14 04:14:34.270748] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.744 [2024-05-14 04:14:34.319267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:20.004 Running I/O for 1 seconds... 00:17:20.004 Running I/O for 1 seconds... 00:17:20.004 Running I/O for 1 seconds... 00:17:20.265 Running I/O for 1 seconds... 00:17:20.836 00:17:20.836 Latency(us) 00:17:20.836 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:20.836 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:17:20.836 Nvme1n1 : 1.00 192535.69 752.09 0.00 0.00 662.59 262.83 754.35 00:17:20.836 =================================================================================================================== 00:17:20.836 Total : 192535.69 752.09 0.00 0.00 662.59 262.83 754.35 00:17:21.098 00:17:21.098 Latency(us) 00:17:21.098 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:21.098 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:17:21.098 Nvme1n1 : 1.01 10353.11 40.44 0.00 0.00 12288.36 3659.09 22719.15 00:17:21.098 =================================================================================================================== 00:17:21.098 Total : 10353.11 40.44 0.00 0.00 12288.36 3659.09 22719.15 00:17:21.098 00:17:21.098 Latency(us) 00:17:21.098 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:21.098 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:17:21.098 Nvme1n1 : 1.01 13756.85 53.74 0.00 0.00 9260.43 4915.20 14636.37 00:17:21.098 =================================================================================================================== 00:17:21.098 Total : 13756.85 53.74 0.00 0.00 9260.43 4915.20 14636.37 00:17:21.098 00:17:21.098 Latency(us) 00:17:21.098 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:21.098 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:17:21.098 Nvme1n1 : 1.00 10033.31 39.19 0.00 0.00 12724.22 4751.36 32112.64 00:17:21.098 =================================================================================================================== 00:17:21.098 Total : 10033.31 39.19 0.00 0.00 12724.22 4751.36 32112.64 00:17:21.098 04:14:35 -- target/bdev_io_wait.sh@38 -- # wait 3916708 00:17:21.360 04:14:35 -- target/bdev_io_wait.sh@39 -- # wait 3916711 00:17:21.360 04:14:35 -- target/bdev_io_wait.sh@40 -- # wait 3916715 00:17:21.360 04:14:35 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:21.360 04:14:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:21.360 04:14:35 -- common/autotest_common.sh@10 -- # set +x 00:17:21.360 04:14:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:21.360 04:14:35 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:17:21.360 04:14:35 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:17:21.360 04:14:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:21.360 04:14:35 -- nvmf/common.sh@116 -- # sync 00:17:21.360 04:14:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:21.360 04:14:35 -- nvmf/common.sh@119 -- # set +e 00:17:21.360 04:14:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:21.360 04:14:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:21.360 rmmod nvme_tcp 00:17:21.360 rmmod nvme_fabrics 00:17:21.360 rmmod nvme_keyring 00:17:21.360 04:14:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:21.360 04:14:35 -- nvmf/common.sh@123 -- # set -e 00:17:21.360 04:14:35 -- nvmf/common.sh@124 -- # return 0 00:17:21.360 04:14:35 -- nvmf/common.sh@477 -- # '[' -n 3916500 ']' 00:17:21.360 04:14:35 -- nvmf/common.sh@478 -- # killprocess 3916500 00:17:21.360 04:14:35 -- common/autotest_common.sh@926 -- # '[' -z 3916500 ']' 00:17:21.360 04:14:35 -- common/autotest_common.sh@930 -- # kill -0 3916500 00:17:21.360 04:14:35 -- common/autotest_common.sh@931 -- # uname 00:17:21.360 04:14:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:21.360 04:14:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3916500 00:17:21.360 04:14:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:21.360 04:14:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:21.360 04:14:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3916500' 00:17:21.360 killing process with pid 3916500 00:17:21.360 04:14:35 -- common/autotest_common.sh@945 -- # kill 3916500 00:17:21.360 04:14:35 -- common/autotest_common.sh@950 -- # wait 3916500 00:17:21.621 04:14:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:21.621 04:14:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:21.621 04:14:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:21.621 04:14:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:21.621 04:14:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:21.621 04:14:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:21.621 04:14:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:21.621 04:14:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:23.536 04:14:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:23.536 00:17:23.536 real 0m12.443s 00:17:23.536 user 0m18.408s 00:17:23.536 sys 0m6.779s 00:17:23.536 04:14:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:23.536 04:14:38 -- common/autotest_common.sh@10 -- # set +x 00:17:23.536 ************************************ 00:17:23.536 END TEST nvmf_bdev_io_wait 00:17:23.536 ************************************ 00:17:23.795 04:14:38 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:17:23.795 04:14:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:23.795 04:14:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:23.795 04:14:38 -- common/autotest_common.sh@10 -- # set +x 00:17:23.795 ************************************ 00:17:23.795 START TEST nvmf_queue_depth 00:17:23.795 ************************************ 00:17:23.795 04:14:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:17:23.795 * Looking for test storage... 00:17:23.795 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:23.795 04:14:38 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:23.795 04:14:38 -- nvmf/common.sh@7 -- # uname -s 00:17:23.795 04:14:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:23.796 04:14:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:23.796 04:14:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:23.796 04:14:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:23.796 04:14:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:23.796 04:14:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:23.796 04:14:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:23.796 04:14:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:23.796 04:14:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:23.796 04:14:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:23.796 04:14:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:23.796 04:14:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:23.796 04:14:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:23.796 04:14:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:23.796 04:14:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:23.796 04:14:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:23.796 04:14:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:23.796 04:14:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:23.796 04:14:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:23.796 04:14:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:23.796 04:14:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:23.796 04:14:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:23.796 04:14:38 -- paths/export.sh@5 -- # export PATH 00:17:23.796 04:14:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:23.796 04:14:38 -- nvmf/common.sh@46 -- # : 0 00:17:23.796 04:14:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:23.796 04:14:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:23.796 04:14:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:23.796 04:14:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:23.796 04:14:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:23.796 04:14:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:23.796 04:14:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:23.796 04:14:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:23.796 04:14:38 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:17:23.796 04:14:38 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:17:23.796 04:14:38 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:23.796 04:14:38 -- target/queue_depth.sh@19 -- # nvmftestinit 00:17:23.796 04:14:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:23.796 04:14:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:23.796 04:14:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:23.796 04:14:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:23.796 04:14:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:23.796 04:14:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:23.796 04:14:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:23.796 04:14:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:23.796 04:14:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:23.796 04:14:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:23.796 04:14:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:23.796 04:14:38 -- common/autotest_common.sh@10 -- # set +x 00:17:31.945 04:14:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:31.945 04:14:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:31.945 04:14:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:31.945 04:14:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:31.945 04:14:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:31.945 04:14:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:31.945 04:14:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:31.945 04:14:45 -- nvmf/common.sh@294 -- # net_devs=() 00:17:31.945 04:14:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:31.945 04:14:45 -- nvmf/common.sh@295 -- # e810=() 00:17:31.945 04:14:45 -- nvmf/common.sh@295 -- # local -ga e810 00:17:31.945 04:14:45 -- nvmf/common.sh@296 -- # x722=() 00:17:31.945 04:14:45 -- nvmf/common.sh@296 -- # local -ga x722 00:17:31.945 04:14:45 -- nvmf/common.sh@297 -- # mlx=() 00:17:31.945 04:14:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:31.945 04:14:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:31.945 04:14:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:31.945 04:14:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:31.945 04:14:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:31.945 04:14:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:31.945 04:14:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:17:31.945 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:17:31.945 04:14:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:31.945 04:14:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:17:31.945 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:17:31.945 04:14:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:31.945 04:14:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:31.945 04:14:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:31.945 04:14:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:31.945 04:14:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:31.945 04:14:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:17:31.945 Found net devices under 0000:4b:00.0: cvl_0_0 00:17:31.945 04:14:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:31.945 04:14:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:31.945 04:14:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:31.945 04:14:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:31.945 04:14:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:31.945 04:14:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:17:31.945 Found net devices under 0000:4b:00.1: cvl_0_1 00:17:31.945 04:14:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:31.945 04:14:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:31.945 04:14:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:31.945 04:14:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:31.945 04:14:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:31.945 04:14:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:31.945 04:14:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:31.945 04:14:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:31.945 04:14:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:31.945 04:14:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:31.945 04:14:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:31.945 04:14:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:31.945 04:14:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:31.945 04:14:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:31.945 04:14:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:31.945 04:14:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:31.945 04:14:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:31.945 04:14:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:31.945 04:14:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:31.945 04:14:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:31.945 04:14:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:31.945 04:14:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:31.945 04:14:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:31.945 04:14:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:31.945 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:31.945 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.721 ms 00:17:31.945 00:17:31.945 --- 10.0.0.2 ping statistics --- 00:17:31.945 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:31.945 rtt min/avg/max/mdev = 0.721/0.721/0.721/0.000 ms 00:17:31.945 04:14:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:31.945 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:31.945 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.427 ms 00:17:31.945 00:17:31.945 --- 10.0.0.1 ping statistics --- 00:17:31.945 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:31.945 rtt min/avg/max/mdev = 0.427/0.427/0.427/0.000 ms 00:17:31.945 04:14:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:31.945 04:14:45 -- nvmf/common.sh@410 -- # return 0 00:17:31.945 04:14:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:31.945 04:14:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:31.945 04:14:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:31.945 04:14:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:31.945 04:14:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:31.945 04:14:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:31.945 04:14:45 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:17:31.945 04:14:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:31.945 04:14:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:31.945 04:14:45 -- common/autotest_common.sh@10 -- # set +x 00:17:31.945 04:14:45 -- nvmf/common.sh@469 -- # nvmfpid=3921237 00:17:31.945 04:14:45 -- nvmf/common.sh@470 -- # waitforlisten 3921237 00:17:31.945 04:14:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:31.945 04:14:45 -- common/autotest_common.sh@819 -- # '[' -z 3921237 ']' 00:17:31.945 04:14:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:31.945 04:14:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:31.945 04:14:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:31.945 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:31.945 04:14:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:31.945 04:14:45 -- common/autotest_common.sh@10 -- # set +x 00:17:31.945 [2024-05-14 04:14:45.453558] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:31.945 [2024-05-14 04:14:45.453606] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:31.945 EAL: No free 2048 kB hugepages reported on node 1 00:17:31.945 [2024-05-14 04:14:45.535102] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:31.945 [2024-05-14 04:14:45.604769] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:31.945 [2024-05-14 04:14:45.604906] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:31.945 [2024-05-14 04:14:45.604914] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:31.945 [2024-05-14 04:14:45.604922] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:31.945 [2024-05-14 04:14:45.604942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:31.945 04:14:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:31.945 04:14:46 -- common/autotest_common.sh@852 -- # return 0 00:17:31.945 04:14:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:31.946 04:14:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:31.946 04:14:46 -- common/autotest_common.sh@10 -- # set +x 00:17:31.946 04:14:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:31.946 04:14:46 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:31.946 04:14:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:31.946 04:14:46 -- common/autotest_common.sh@10 -- # set +x 00:17:31.946 [2024-05-14 04:14:46.275521] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:31.946 04:14:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:31.946 04:14:46 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:31.946 04:14:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:31.946 04:14:46 -- common/autotest_common.sh@10 -- # set +x 00:17:31.946 Malloc0 00:17:31.946 04:14:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:31.946 04:14:46 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:31.946 04:14:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:31.946 04:14:46 -- common/autotest_common.sh@10 -- # set +x 00:17:31.946 04:14:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:31.946 04:14:46 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:31.946 04:14:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:31.946 04:14:46 -- common/autotest_common.sh@10 -- # set +x 00:17:31.946 04:14:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:31.946 04:14:46 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:31.946 04:14:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:31.946 04:14:46 -- common/autotest_common.sh@10 -- # set +x 00:17:31.946 [2024-05-14 04:14:46.332685] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:31.946 04:14:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:31.946 04:14:46 -- target/queue_depth.sh@30 -- # bdevperf_pid=3921427 00:17:31.946 04:14:46 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:31.946 04:14:46 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:17:31.946 04:14:46 -- target/queue_depth.sh@33 -- # waitforlisten 3921427 /var/tmp/bdevperf.sock 00:17:31.946 04:14:46 -- common/autotest_common.sh@819 -- # '[' -z 3921427 ']' 00:17:31.946 04:14:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:31.946 04:14:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:31.946 04:14:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:31.946 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:31.946 04:14:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:31.946 04:14:46 -- common/autotest_common.sh@10 -- # set +x 00:17:31.946 [2024-05-14 04:14:46.385105] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:31.946 [2024-05-14 04:14:46.385168] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3921427 ] 00:17:31.946 EAL: No free 2048 kB hugepages reported on node 1 00:17:31.946 [2024-05-14 04:14:46.450249] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:31.946 [2024-05-14 04:14:46.522762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:32.890 04:14:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:32.890 04:14:47 -- common/autotest_common.sh@852 -- # return 0 00:17:32.890 04:14:47 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:17:32.890 04:14:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:32.890 04:14:47 -- common/autotest_common.sh@10 -- # set +x 00:17:32.890 NVMe0n1 00:17:32.890 04:14:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:32.890 04:14:47 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:32.890 Running I/O for 10 seconds... 00:17:42.895 00:17:42.895 Latency(us) 00:17:42.895 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:42.895 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:17:42.895 Verification LBA range: start 0x0 length 0x4000 00:17:42.895 NVMe0n1 : 10.04 18959.39 74.06 0.00 0.00 53857.33 9721.17 60730.03 00:17:42.895 =================================================================================================================== 00:17:42.895 Total : 18959.39 74.06 0.00 0.00 53857.33 9721.17 60730.03 00:17:42.895 0 00:17:42.895 04:14:57 -- target/queue_depth.sh@39 -- # killprocess 3921427 00:17:42.895 04:14:57 -- common/autotest_common.sh@926 -- # '[' -z 3921427 ']' 00:17:42.895 04:14:57 -- common/autotest_common.sh@930 -- # kill -0 3921427 00:17:42.895 04:14:57 -- common/autotest_common.sh@931 -- # uname 00:17:42.895 04:14:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:42.895 04:14:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3921427 00:17:42.895 04:14:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:42.895 04:14:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:42.895 04:14:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3921427' 00:17:42.895 killing process with pid 3921427 00:17:42.895 04:14:57 -- common/autotest_common.sh@945 -- # kill 3921427 00:17:42.895 Received shutdown signal, test time was about 10.000000 seconds 00:17:42.895 00:17:42.895 Latency(us) 00:17:42.895 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:42.895 =================================================================================================================== 00:17:42.895 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:42.895 04:14:57 -- common/autotest_common.sh@950 -- # wait 3921427 00:17:43.157 04:14:57 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:17:43.157 04:14:57 -- target/queue_depth.sh@43 -- # nvmftestfini 00:17:43.157 04:14:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:43.157 04:14:57 -- nvmf/common.sh@116 -- # sync 00:17:43.157 04:14:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:43.157 04:14:57 -- nvmf/common.sh@119 -- # set +e 00:17:43.157 04:14:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:43.157 04:14:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:43.157 rmmod nvme_tcp 00:17:43.157 rmmod nvme_fabrics 00:17:43.157 rmmod nvme_keyring 00:17:43.157 04:14:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:43.157 04:14:57 -- nvmf/common.sh@123 -- # set -e 00:17:43.157 04:14:57 -- nvmf/common.sh@124 -- # return 0 00:17:43.157 04:14:57 -- nvmf/common.sh@477 -- # '[' -n 3921237 ']' 00:17:43.157 04:14:57 -- nvmf/common.sh@478 -- # killprocess 3921237 00:17:43.157 04:14:57 -- common/autotest_common.sh@926 -- # '[' -z 3921237 ']' 00:17:43.157 04:14:57 -- common/autotest_common.sh@930 -- # kill -0 3921237 00:17:43.157 04:14:57 -- common/autotest_common.sh@931 -- # uname 00:17:43.157 04:14:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:43.157 04:14:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3921237 00:17:43.157 04:14:57 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:43.157 04:14:57 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:43.157 04:14:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3921237' 00:17:43.157 killing process with pid 3921237 00:17:43.157 04:14:57 -- common/autotest_common.sh@945 -- # kill 3921237 00:17:43.157 04:14:57 -- common/autotest_common.sh@950 -- # wait 3921237 00:17:43.419 04:14:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:43.419 04:14:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:43.419 04:14:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:43.419 04:14:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:43.419 04:14:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:43.419 04:14:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:43.419 04:14:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:43.419 04:14:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:45.335 04:14:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:45.336 00:17:45.336 real 0m21.757s 00:17:45.336 user 0m25.262s 00:17:45.336 sys 0m6.498s 00:17:45.598 04:14:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:45.598 04:14:59 -- common/autotest_common.sh@10 -- # set +x 00:17:45.598 ************************************ 00:17:45.598 END TEST nvmf_queue_depth 00:17:45.598 ************************************ 00:17:45.598 04:14:59 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:17:45.598 04:14:59 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:45.598 04:14:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:45.598 04:14:59 -- common/autotest_common.sh@10 -- # set +x 00:17:45.598 ************************************ 00:17:45.598 START TEST nvmf_multipath 00:17:45.598 ************************************ 00:17:45.598 04:14:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:17:45.598 * Looking for test storage... 00:17:45.598 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:45.598 04:15:00 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:45.598 04:15:00 -- nvmf/common.sh@7 -- # uname -s 00:17:45.598 04:15:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:45.598 04:15:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:45.598 04:15:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:45.598 04:15:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:45.598 04:15:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:45.598 04:15:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:45.598 04:15:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:45.598 04:15:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:45.598 04:15:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:45.598 04:15:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:45.598 04:15:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:45.598 04:15:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:45.598 04:15:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:45.598 04:15:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:45.598 04:15:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:45.598 04:15:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:45.598 04:15:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:45.598 04:15:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:45.598 04:15:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:45.598 04:15:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.598 04:15:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.598 04:15:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.598 04:15:00 -- paths/export.sh@5 -- # export PATH 00:17:45.598 04:15:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.598 04:15:00 -- nvmf/common.sh@46 -- # : 0 00:17:45.598 04:15:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:45.598 04:15:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:45.599 04:15:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:45.599 04:15:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:45.599 04:15:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:45.599 04:15:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:45.599 04:15:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:45.599 04:15:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:45.599 04:15:00 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:45.599 04:15:00 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:45.599 04:15:00 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:17:45.599 04:15:00 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:45.599 04:15:00 -- target/multipath.sh@43 -- # nvmftestinit 00:17:45.599 04:15:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:45.599 04:15:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:45.599 04:15:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:45.599 04:15:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:45.599 04:15:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:45.599 04:15:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:45.599 04:15:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:45.599 04:15:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:45.599 04:15:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:45.599 04:15:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:45.599 04:15:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:45.599 04:15:00 -- common/autotest_common.sh@10 -- # set +x 00:17:53.746 04:15:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:53.746 04:15:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:53.746 04:15:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:53.746 04:15:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:53.746 04:15:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:53.746 04:15:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:53.746 04:15:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:53.746 04:15:06 -- nvmf/common.sh@294 -- # net_devs=() 00:17:53.746 04:15:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:53.746 04:15:06 -- nvmf/common.sh@295 -- # e810=() 00:17:53.746 04:15:06 -- nvmf/common.sh@295 -- # local -ga e810 00:17:53.746 04:15:06 -- nvmf/common.sh@296 -- # x722=() 00:17:53.746 04:15:06 -- nvmf/common.sh@296 -- # local -ga x722 00:17:53.746 04:15:06 -- nvmf/common.sh@297 -- # mlx=() 00:17:53.746 04:15:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:53.746 04:15:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:53.746 04:15:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:53.746 04:15:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:53.746 04:15:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:53.746 04:15:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:53.747 04:15:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:53.747 04:15:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:53.747 04:15:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:53.747 04:15:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:53.747 04:15:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:53.747 04:15:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:53.747 04:15:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:53.747 04:15:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:53.747 04:15:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:53.747 04:15:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:53.747 04:15:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:17:53.747 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:17:53.747 04:15:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:53.747 04:15:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:17:53.747 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:17:53.747 04:15:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:53.747 04:15:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:53.747 04:15:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:53.747 04:15:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:53.747 04:15:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:53.747 04:15:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:17:53.747 Found net devices under 0000:4b:00.0: cvl_0_0 00:17:53.747 04:15:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:53.747 04:15:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:53.747 04:15:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:53.747 04:15:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:53.747 04:15:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:53.747 04:15:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:17:53.747 Found net devices under 0000:4b:00.1: cvl_0_1 00:17:53.747 04:15:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:53.747 04:15:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:53.747 04:15:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:53.747 04:15:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:53.747 04:15:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:53.747 04:15:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:53.747 04:15:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:53.747 04:15:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:53.747 04:15:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:53.747 04:15:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:53.747 04:15:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:53.747 04:15:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:53.747 04:15:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:53.747 04:15:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:53.747 04:15:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:53.747 04:15:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:53.747 04:15:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:53.747 04:15:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:53.747 04:15:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:53.747 04:15:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:53.747 04:15:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:53.747 04:15:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:53.747 04:15:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:53.747 04:15:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:53.747 04:15:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:53.747 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:53.747 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.618 ms 00:17:53.747 00:17:53.747 --- 10.0.0.2 ping statistics --- 00:17:53.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:53.747 rtt min/avg/max/mdev = 0.618/0.618/0.618/0.000 ms 00:17:53.747 04:15:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:53.747 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:53.747 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.376 ms 00:17:53.747 00:17:53.747 --- 10.0.0.1 ping statistics --- 00:17:53.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:53.747 rtt min/avg/max/mdev = 0.376/0.376/0.376/0.000 ms 00:17:53.747 04:15:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:53.747 04:15:07 -- nvmf/common.sh@410 -- # return 0 00:17:53.747 04:15:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:53.747 04:15:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:53.747 04:15:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:53.747 04:15:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:53.747 04:15:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:53.747 04:15:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:53.747 04:15:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:53.747 04:15:07 -- target/multipath.sh@45 -- # '[' -z ']' 00:17:53.747 04:15:07 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:17:53.747 only one NIC for nvmf test 00:17:53.747 04:15:07 -- target/multipath.sh@47 -- # nvmftestfini 00:17:53.747 04:15:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:53.747 04:15:07 -- nvmf/common.sh@116 -- # sync 00:17:53.747 04:15:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:53.747 04:15:07 -- nvmf/common.sh@119 -- # set +e 00:17:53.747 04:15:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:53.747 04:15:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:53.747 rmmod nvme_tcp 00:17:53.747 rmmod nvme_fabrics 00:17:53.747 rmmod nvme_keyring 00:17:53.747 04:15:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:53.747 04:15:07 -- nvmf/common.sh@123 -- # set -e 00:17:53.747 04:15:07 -- nvmf/common.sh@124 -- # return 0 00:17:53.747 04:15:07 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:17:53.747 04:15:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:53.747 04:15:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:53.747 04:15:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:53.747 04:15:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:53.747 04:15:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:53.747 04:15:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:53.747 04:15:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:53.747 04:15:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:55.162 04:15:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:55.162 04:15:09 -- target/multipath.sh@48 -- # exit 0 00:17:55.162 04:15:09 -- target/multipath.sh@1 -- # nvmftestfini 00:17:55.162 04:15:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:55.162 04:15:09 -- nvmf/common.sh@116 -- # sync 00:17:55.162 04:15:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:55.162 04:15:09 -- nvmf/common.sh@119 -- # set +e 00:17:55.162 04:15:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:55.162 04:15:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:55.162 04:15:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:55.162 04:15:09 -- nvmf/common.sh@123 -- # set -e 00:17:55.162 04:15:09 -- nvmf/common.sh@124 -- # return 0 00:17:55.162 04:15:09 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:17:55.162 04:15:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:55.162 04:15:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:55.162 04:15:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:55.162 04:15:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:55.162 04:15:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:55.162 04:15:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:55.163 04:15:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:55.163 04:15:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:55.163 04:15:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:55.163 00:17:55.163 real 0m9.552s 00:17:55.163 user 0m2.042s 00:17:55.163 sys 0m5.405s 00:17:55.163 04:15:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:55.163 04:15:09 -- common/autotest_common.sh@10 -- # set +x 00:17:55.163 ************************************ 00:17:55.163 END TEST nvmf_multipath 00:17:55.163 ************************************ 00:17:55.163 04:15:09 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:17:55.163 04:15:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:55.163 04:15:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:55.163 04:15:09 -- common/autotest_common.sh@10 -- # set +x 00:17:55.163 ************************************ 00:17:55.163 START TEST nvmf_zcopy 00:17:55.163 ************************************ 00:17:55.163 04:15:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:17:55.163 * Looking for test storage... 00:17:55.163 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:55.163 04:15:09 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:55.163 04:15:09 -- nvmf/common.sh@7 -- # uname -s 00:17:55.163 04:15:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:55.163 04:15:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:55.163 04:15:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:55.163 04:15:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:55.163 04:15:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:55.163 04:15:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:55.163 04:15:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:55.163 04:15:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:55.163 04:15:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:55.163 04:15:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:55.163 04:15:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:55.163 04:15:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:55.163 04:15:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:55.163 04:15:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:55.163 04:15:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:55.163 04:15:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:55.163 04:15:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:55.163 04:15:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:55.163 04:15:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:55.163 04:15:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.163 04:15:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.163 04:15:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.163 04:15:09 -- paths/export.sh@5 -- # export PATH 00:17:55.163 04:15:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:55.163 04:15:09 -- nvmf/common.sh@46 -- # : 0 00:17:55.163 04:15:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:55.163 04:15:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:55.163 04:15:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:55.163 04:15:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:55.163 04:15:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:55.163 04:15:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:55.163 04:15:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:55.163 04:15:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:55.163 04:15:09 -- target/zcopy.sh@12 -- # nvmftestinit 00:17:55.163 04:15:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:55.163 04:15:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:55.163 04:15:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:55.163 04:15:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:55.163 04:15:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:55.163 04:15:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:55.163 04:15:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:55.163 04:15:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:55.163 04:15:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:55.163 04:15:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:55.163 04:15:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:55.163 04:15:09 -- common/autotest_common.sh@10 -- # set +x 00:18:03.310 04:15:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:03.310 04:15:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:03.310 04:15:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:03.310 04:15:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:03.310 04:15:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:03.310 04:15:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:03.310 04:15:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:03.310 04:15:16 -- nvmf/common.sh@294 -- # net_devs=() 00:18:03.310 04:15:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:03.310 04:15:16 -- nvmf/common.sh@295 -- # e810=() 00:18:03.310 04:15:16 -- nvmf/common.sh@295 -- # local -ga e810 00:18:03.310 04:15:16 -- nvmf/common.sh@296 -- # x722=() 00:18:03.310 04:15:16 -- nvmf/common.sh@296 -- # local -ga x722 00:18:03.310 04:15:16 -- nvmf/common.sh@297 -- # mlx=() 00:18:03.310 04:15:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:03.310 04:15:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:03.310 04:15:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:03.310 04:15:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:03.310 04:15:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:03.310 04:15:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:03.310 04:15:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:18:03.310 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:18:03.310 04:15:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:03.310 04:15:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:18:03.310 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:18:03.310 04:15:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:03.310 04:15:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:03.310 04:15:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:03.310 04:15:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:03.310 04:15:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:03.310 04:15:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:18:03.310 Found net devices under 0000:4b:00.0: cvl_0_0 00:18:03.310 04:15:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:03.310 04:15:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:03.310 04:15:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:03.310 04:15:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:03.310 04:15:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:03.310 04:15:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:18:03.310 Found net devices under 0000:4b:00.1: cvl_0_1 00:18:03.310 04:15:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:03.310 04:15:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:03.310 04:15:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:03.310 04:15:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:03.310 04:15:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:03.310 04:15:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:03.310 04:15:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:03.310 04:15:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:03.310 04:15:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:03.310 04:15:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:03.310 04:15:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:03.310 04:15:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:03.310 04:15:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:03.310 04:15:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:03.310 04:15:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:03.310 04:15:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:03.310 04:15:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:03.310 04:15:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:03.310 04:15:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:03.310 04:15:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:03.310 04:15:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:03.310 04:15:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:03.310 04:15:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:03.310 04:15:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:03.310 04:15:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:03.310 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:03.310 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.675 ms 00:18:03.310 00:18:03.310 --- 10.0.0.2 ping statistics --- 00:18:03.310 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:03.310 rtt min/avg/max/mdev = 0.675/0.675/0.675/0.000 ms 00:18:03.310 04:15:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:03.310 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:03.310 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.429 ms 00:18:03.310 00:18:03.310 --- 10.0.0.1 ping statistics --- 00:18:03.310 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:03.310 rtt min/avg/max/mdev = 0.429/0.429/0.429/0.000 ms 00:18:03.310 04:15:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:03.310 04:15:16 -- nvmf/common.sh@410 -- # return 0 00:18:03.311 04:15:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:03.311 04:15:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:03.311 04:15:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:03.311 04:15:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:03.311 04:15:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:03.311 04:15:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:03.311 04:15:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:03.311 04:15:16 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:03.311 04:15:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:03.311 04:15:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:03.311 04:15:16 -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 04:15:16 -- nvmf/common.sh@469 -- # nvmfpid=3932545 00:18:03.311 04:15:16 -- nvmf/common.sh@470 -- # waitforlisten 3932545 00:18:03.311 04:15:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:03.311 04:15:16 -- common/autotest_common.sh@819 -- # '[' -z 3932545 ']' 00:18:03.311 04:15:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:03.311 04:15:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:03.311 04:15:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:03.311 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:03.311 04:15:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:03.311 04:15:16 -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 [2024-05-14 04:15:16.788364] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:03.311 [2024-05-14 04:15:16.788442] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:03.311 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.311 [2024-05-14 04:15:16.876691] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:03.311 [2024-05-14 04:15:16.966178] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:03.311 [2024-05-14 04:15:16.966341] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:03.311 [2024-05-14 04:15:16.966352] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:03.311 [2024-05-14 04:15:16.966360] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:03.311 [2024-05-14 04:15:16.966384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:03.311 04:15:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:03.311 04:15:17 -- common/autotest_common.sh@852 -- # return 0 00:18:03.311 04:15:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:03.311 04:15:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:03.311 04:15:17 -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 04:15:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:03.311 04:15:17 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:03.311 04:15:17 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:03.311 04:15:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:03.311 04:15:17 -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 [2024-05-14 04:15:17.610243] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:03.311 04:15:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:03.311 04:15:17 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:03.311 04:15:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:03.311 04:15:17 -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 04:15:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:03.311 04:15:17 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:03.311 04:15:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:03.311 04:15:17 -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 [2024-05-14 04:15:17.626420] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:03.311 04:15:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:03.311 04:15:17 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:03.311 04:15:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:03.311 04:15:17 -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 04:15:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:03.311 04:15:17 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:03.311 04:15:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:03.311 04:15:17 -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 malloc0 00:18:03.311 04:15:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:03.311 04:15:17 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:03.311 04:15:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:03.311 04:15:17 -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 04:15:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:03.311 04:15:17 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:03.311 04:15:17 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:03.311 04:15:17 -- nvmf/common.sh@520 -- # config=() 00:18:03.311 04:15:17 -- nvmf/common.sh@520 -- # local subsystem config 00:18:03.311 04:15:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:03.311 04:15:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:03.311 { 00:18:03.311 "params": { 00:18:03.311 "name": "Nvme$subsystem", 00:18:03.311 "trtype": "$TEST_TRANSPORT", 00:18:03.311 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:03.311 "adrfam": "ipv4", 00:18:03.311 "trsvcid": "$NVMF_PORT", 00:18:03.311 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:03.311 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:03.311 "hdgst": ${hdgst:-false}, 00:18:03.311 "ddgst": ${ddgst:-false} 00:18:03.311 }, 00:18:03.311 "method": "bdev_nvme_attach_controller" 00:18:03.311 } 00:18:03.311 EOF 00:18:03.311 )") 00:18:03.311 04:15:17 -- nvmf/common.sh@542 -- # cat 00:18:03.311 04:15:17 -- nvmf/common.sh@544 -- # jq . 00:18:03.311 04:15:17 -- nvmf/common.sh@545 -- # IFS=, 00:18:03.311 04:15:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:03.311 "params": { 00:18:03.311 "name": "Nvme1", 00:18:03.311 "trtype": "tcp", 00:18:03.311 "traddr": "10.0.0.2", 00:18:03.311 "adrfam": "ipv4", 00:18:03.311 "trsvcid": "4420", 00:18:03.311 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:03.311 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:03.311 "hdgst": false, 00:18:03.311 "ddgst": false 00:18:03.311 }, 00:18:03.311 "method": "bdev_nvme_attach_controller" 00:18:03.311 }' 00:18:03.311 [2024-05-14 04:15:17.703932] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:03.311 [2024-05-14 04:15:17.703996] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3932568 ] 00:18:03.311 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.311 [2024-05-14 04:15:17.770211] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:03.311 [2024-05-14 04:15:17.842668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:03.571 Running I/O for 10 seconds... 00:18:15.810 00:18:15.810 Latency(us) 00:18:15.810 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.810 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:15.810 Verification LBA range: start 0x0 length 0x1000 00:18:15.810 Nvme1n1 : 10.01 14401.79 112.51 0.00 0.00 8859.96 1181.01 30146.56 00:18:15.810 =================================================================================================================== 00:18:15.810 Total : 14401.79 112.51 0.00 0.00 8859.96 1181.01 30146.56 00:18:15.810 04:15:28 -- target/zcopy.sh@39 -- # perfpid=3934676 00:18:15.810 04:15:28 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:15.810 04:15:28 -- common/autotest_common.sh@10 -- # set +x 00:18:15.810 04:15:28 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:15.810 04:15:28 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:15.810 04:15:28 -- nvmf/common.sh@520 -- # config=() 00:18:15.810 04:15:28 -- nvmf/common.sh@520 -- # local subsystem config 00:18:15.810 04:15:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:15.810 04:15:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:15.810 { 00:18:15.810 "params": { 00:18:15.810 "name": "Nvme$subsystem", 00:18:15.810 "trtype": "$TEST_TRANSPORT", 00:18:15.810 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:15.810 "adrfam": "ipv4", 00:18:15.810 "trsvcid": "$NVMF_PORT", 00:18:15.810 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:15.810 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:15.810 "hdgst": ${hdgst:-false}, 00:18:15.810 "ddgst": ${ddgst:-false} 00:18:15.810 }, 00:18:15.810 "method": "bdev_nvme_attach_controller" 00:18:15.810 } 00:18:15.810 EOF 00:18:15.810 )") 00:18:15.810 04:15:28 -- nvmf/common.sh@542 -- # cat 00:18:15.810 [2024-05-14 04:15:28.316906] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.810 [2024-05-14 04:15:28.316935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.810 04:15:28 -- nvmf/common.sh@544 -- # jq . 00:18:15.810 [2024-05-14 04:15:28.324896] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.810 [2024-05-14 04:15:28.324906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.810 04:15:28 -- nvmf/common.sh@545 -- # IFS=, 00:18:15.810 04:15:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:15.810 "params": { 00:18:15.810 "name": "Nvme1", 00:18:15.810 "trtype": "tcp", 00:18:15.810 "traddr": "10.0.0.2", 00:18:15.810 "adrfam": "ipv4", 00:18:15.810 "trsvcid": "4420", 00:18:15.810 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.810 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:15.810 "hdgst": false, 00:18:15.810 "ddgst": false 00:18:15.810 }, 00:18:15.810 "method": "bdev_nvme_attach_controller" 00:18:15.810 }' 00:18:15.810 [2024-05-14 04:15:28.332915] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.810 [2024-05-14 04:15:28.332924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.810 [2024-05-14 04:15:28.340936] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.810 [2024-05-14 04:15:28.340944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.810 [2024-05-14 04:15:28.348956] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.348965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.356976] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.356984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.362576] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:15.811 [2024-05-14 04:15:28.362624] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3934676 ] 00:18:15.811 [2024-05-14 04:15:28.364998] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.365007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.373018] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.373026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.381040] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.381049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.811 [2024-05-14 04:15:28.389060] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.389068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.397080] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.397088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.405102] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.405110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.413122] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.413130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.420416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.811 [2024-05-14 04:15:28.421142] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.421150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.429165] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.429173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.437185] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.437193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.445205] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.445214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.453225] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.453235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.461247] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.461258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.469266] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.469278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.477287] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.477300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.483688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:15.811 [2024-05-14 04:15:28.485310] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.485318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.493332] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.493340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.501354] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.501366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.509374] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.509384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.517391] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.517400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.525413] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.525421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.533433] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.533441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.541452] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.541460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.549471] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.549479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.557497] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.557507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.565522] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.565533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.573536] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.573546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.581559] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.581571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.589580] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.589588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.597601] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.597611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.605622] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.605631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.613642] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.613653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.621664] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.621671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.629686] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.629693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.637706] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.637713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.645729] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.645737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.653748] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.653755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.700955] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.700968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 [2024-05-14 04:15:28.705885] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.811 [2024-05-14 04:15:28.705894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.811 Running I/O for 5 seconds... 00:18:15.811 [2024-05-14 04:15:28.713904] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.713910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.735365] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.735381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.745812] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.745828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.753592] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.753607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.762757] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.762774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.770729] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.770745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.779776] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.779790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.788338] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.788353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.796530] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.796545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.805334] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.805348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.813569] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.813583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.821843] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.821862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.831075] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.831090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.839295] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.839309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.848019] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.848033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.856447] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.856461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.864793] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.864807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.871187] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.871201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.881505] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.881519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.889830] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.889844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.898269] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.898284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.906767] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.906781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.915657] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.915672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.924110] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.924124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.932905] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.932919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.941451] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.941465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.950142] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.950156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.958618] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.958633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.967778] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.967793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.976672] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.976686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.985151] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.985169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:28.993885] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:28.993899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.002906] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.002920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.010508] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.010522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.019633] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.019647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.028336] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.028350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.036889] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.036903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.045046] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.045060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.053653] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.053667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.062260] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.062273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.070604] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.070618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.079088] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.079101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.087753] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.087768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.096595] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.096609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.105422] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.105436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.113677] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.113691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.122299] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.122314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.130836] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.812 [2024-05-14 04:15:29.130850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.812 [2024-05-14 04:15:29.138753] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.138767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.147949] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.147966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.155627] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.155641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.164491] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.164505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.173018] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.173032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.181776] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.181790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.190090] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.190104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.198740] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.198754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.207358] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.207372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.216206] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.216220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.224911] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.224926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.233404] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.233418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.241898] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.241912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.250275] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.250289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.258641] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.258655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.266979] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.266993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.275511] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.275525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.283889] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.283903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.292574] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.292588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.300735] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.300749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.309515] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.309529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.318241] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.318255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.326992] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.327006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.335481] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.335495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.344344] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.344358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.353145] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.353159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.361845] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.361859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.369875] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.369889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.378413] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.378427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.386943] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.386957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.395576] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.395590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.404197] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.404211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.412187] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.412201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.420912] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.420926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.429397] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.429411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.437501] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.437515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.445830] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.445844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.454338] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.454353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.463194] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.463208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.471532] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.471545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.480403] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.480417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.489019] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.489033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.497626] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.497640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.505887] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.505901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.514213] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.514227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.522732] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.522746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.531462] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.531476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.539748] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.813 [2024-05-14 04:15:29.539763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.813 [2024-05-14 04:15:29.548634] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.548649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.557150] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.557164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.565793] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.565808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.572171] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.572186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.582526] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.582540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.591133] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.591147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.599410] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.599425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.608005] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.608019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.616918] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.616932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.625453] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.625467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.633843] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.633858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.642235] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.642249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.650845] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.650860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.659422] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.659436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.667750] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.667764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.676066] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.676080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.684603] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.684617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.693019] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.693033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.701567] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.701581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.709982] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.709996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.718734] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.718748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.727145] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.727159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.735328] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.735343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.743892] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.743906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.752957] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.752971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.761156] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.761171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.770163] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.770177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.778868] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.778882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.787193] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.787210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.795675] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.795689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.804141] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.804156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.812910] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.812924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.821325] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.821339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.830026] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.830040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.839024] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.839038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.846999] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.847013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.855317] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.855332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.864084] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.864099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.872246] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.872260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.880752] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.880767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.889171] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.889186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.897727] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.897741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.906553] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.906567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.914930] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.914943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.923713] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.923727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.931624] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.931639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.940504] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.940518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.948427] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.948445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.957162] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.957176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.965738] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.965752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.974159] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.974173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.982461] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.982474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.814 [2024-05-14 04:15:29.990790] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.814 [2024-05-14 04:15:29.990804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:29.999422] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:29.999437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.007849] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.007865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.016390] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.016404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.023179] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.023194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.033781] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.033796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.042097] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.042112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.050589] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.050603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.058717] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.058731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.067297] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.067312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.076192] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.076207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.084775] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.084789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.093400] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.093415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.102398] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.102413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.110842] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.110861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.119598] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.119613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.128202] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.128216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.137186] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.137200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.145455] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.145468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.153976] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.153990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.162199] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.162213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.170901] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.170916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.179650] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.179664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.188368] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.188382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.196587] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.196602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.205070] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.205084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.213477] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.213492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.221808] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.221822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.230269] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.230283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.239240] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.239254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.247849] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.247863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.256414] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.256428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.265206] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.815 [2024-05-14 04:15:30.265220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.815 [2024-05-14 04:15:30.273703] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.273722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.282243] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.282257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.290982] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.290996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.299868] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.299883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.308809] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.308823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.317737] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.317751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.326280] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.326299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.335316] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.335330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.343281] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.343301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.352567] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.352581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.361218] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.361233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.369182] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.369195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.377894] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.377908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.386331] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.386345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:15.816 [2024-05-14 04:15:30.395083] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:15.816 [2024-05-14 04:15:30.395098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.403638] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.403652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.412475] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.412490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.420834] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.420849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.429277] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.429296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.437912] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.437931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.446941] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.446956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.455730] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.455745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.464134] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.464148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.472516] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.472530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.480986] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.481000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.489229] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.489244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.498157] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.498172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.506547] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.506561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.515084] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.515098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.523915] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.523929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.532257] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.532272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.540817] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.540832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.549796] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.549810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.557971] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.557985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.566432] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.566446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.574989] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.575004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.583304] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.077 [2024-05-14 04:15:30.583318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.077 [2024-05-14 04:15:30.591283] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.078 [2024-05-14 04:15:30.591302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.078 [2024-05-14 04:15:30.599796] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.078 [2024-05-14 04:15:30.599810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.078 [2024-05-14 04:15:30.608862] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.078 [2024-05-14 04:15:30.608875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.078 [2024-05-14 04:15:30.617117] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.078 [2024-05-14 04:15:30.617132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.078 [2024-05-14 04:15:30.626066] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.078 [2024-05-14 04:15:30.626081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.078 [2024-05-14 04:15:30.634472] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.078 [2024-05-14 04:15:30.634486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.078 [2024-05-14 04:15:30.643031] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.078 [2024-05-14 04:15:30.643045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.078 [2024-05-14 04:15:30.651840] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.078 [2024-05-14 04:15:30.651854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.078 [2024-05-14 04:15:30.660604] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.078 [2024-05-14 04:15:30.660618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.669267] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.669281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.678004] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.678019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.686913] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.686928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.695299] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.695313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.704069] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.704084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.712775] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.712789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.721708] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.721722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.730006] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.730020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.738481] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.738496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.747165] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.747180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.755758] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.755773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.764002] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.764016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.772590] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.772604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.780926] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.780940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.789837] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.789852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.339 [2024-05-14 04:15:30.798540] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.339 [2024-05-14 04:15:30.798554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.807127] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.807141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.815980] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.815994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.824847] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.824861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.833028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.833042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.841870] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.841884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.850063] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.850077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.858817] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.858831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.867822] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.867836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.876227] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.876241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.884984] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.884997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.893021] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.893035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.901782] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.901797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.910444] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.910458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.918933] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.918947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.340 [2024-05-14 04:15:30.927242] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.340 [2024-05-14 04:15:30.927255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:30.935638] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:30.935652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:30.944472] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:30.944487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:30.953316] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:30.953330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:30.961949] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:30.961964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:30.970415] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:30.970429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:30.978737] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:30.978751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:30.987569] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:30.987583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:30.996238] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:30.996251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.004981] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.004995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.013820] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.013834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.022538] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.022552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.031515] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.031528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.040266] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.040279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.048626] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.048640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.057282] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.057301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.065891] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.065905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.074263] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.074277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.082838] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.082856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.091594] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.091608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.099979] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.099993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.108432] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.108446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.117233] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.117247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.125639] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.125653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.134107] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.134121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.142594] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.142608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.151282] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.151300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.159898] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.159912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.168432] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.168446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.176764] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.176778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.602 [2024-05-14 04:15:31.185786] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.602 [2024-05-14 04:15:31.185800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.193880] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.193893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.202599] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.202613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.211140] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.211155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.219560] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.219574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.228054] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.228068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.236294] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.236308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.244728] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.244746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.253744] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.253758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.262349] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.262362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.271274] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.271288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.279689] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.279703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.288325] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.288338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.297034] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.297048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.305888] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.305902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.313994] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.314009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.322396] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.322410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.331016] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.331030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.339575] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.339588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.348858] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.348872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.357030] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.357044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.366048] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.366062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.375102] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.375116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.383761] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.383775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.392262] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.392275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.401160] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.401174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.409844] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.864 [2024-05-14 04:15:31.409861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.864 [2024-05-14 04:15:31.418576] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.865 [2024-05-14 04:15:31.418590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.865 [2024-05-14 04:15:31.426856] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.865 [2024-05-14 04:15:31.426870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.865 [2024-05-14 04:15:31.435799] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.865 [2024-05-14 04:15:31.435813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:16.865 [2024-05-14 04:15:31.444499] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:16.865 [2024-05-14 04:15:31.444513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.453104] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.453118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.461468] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.461482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.469863] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.469877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.478609] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.478622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.487295] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.487309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.496197] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.496211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.504772] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.504786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.512855] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.512869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.521247] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.521261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.530178] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.530191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.538659] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.538672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.547236] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.547250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.555833] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.555846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.564166] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.564180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.572846] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.572863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.581589] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.581603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.590176] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.590191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.598473] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.598488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.607117] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.607131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.616007] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.616021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.624653] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.126 [2024-05-14 04:15:31.624667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.126 [2024-05-14 04:15:31.632964] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.632978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.127 [2024-05-14 04:15:31.641812] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.641827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.127 [2024-05-14 04:15:31.650584] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.650598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.127 [2024-05-14 04:15:31.659138] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.659153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.127 [2024-05-14 04:15:31.668131] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.668145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.127 [2024-05-14 04:15:31.676760] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.676774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.127 [2024-05-14 04:15:31.685446] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.685460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.127 [2024-05-14 04:15:31.693683] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.693697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.127 [2024-05-14 04:15:31.702624] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.702638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.127 [2024-05-14 04:15:31.711434] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.127 [2024-05-14 04:15:31.711447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.388 [2024-05-14 04:15:31.719720] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.388 [2024-05-14 04:15:31.719734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.388 [2024-05-14 04:15:31.728611] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.388 [2024-05-14 04:15:31.728625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.388 [2024-05-14 04:15:31.736806] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.388 [2024-05-14 04:15:31.736824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.388 [2024-05-14 04:15:31.745227] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.388 [2024-05-14 04:15:31.745241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.388 [2024-05-14 04:15:31.753960] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.388 [2024-05-14 04:15:31.753974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.388 [2024-05-14 04:15:31.762414] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.388 [2024-05-14 04:15:31.762428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.388 [2024-05-14 04:15:31.770969] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.388 [2024-05-14 04:15:31.770983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.388 [2024-05-14 04:15:31.779587] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.779602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.788191] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.788205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.796666] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.796680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.805005] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.805020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.813572] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.813586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.822028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.822044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.830419] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.830433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.839088] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.839103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.847959] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.847973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.856748] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.856762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.865145] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.865159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.873686] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.873700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.882224] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.882238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.890786] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.890800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.899038] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.899052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.907400] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.907414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.915894] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.915909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.924473] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.924487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.933170] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.933185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.941425] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.941439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.950062] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.950077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.958091] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.958105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.966337] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.966352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.389 [2024-05-14 04:15:31.974768] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.389 [2024-05-14 04:15:31.974785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.650 [2024-05-14 04:15:31.983251] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.650 [2024-05-14 04:15:31.983266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.650 [2024-05-14 04:15:31.992136] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.650 [2024-05-14 04:15:31.992151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.650 [2024-05-14 04:15:32.000866] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.650 [2024-05-14 04:15:32.000880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.650 [2024-05-14 04:15:32.009232] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.650 [2024-05-14 04:15:32.009246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.650 [2024-05-14 04:15:32.018045] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.018059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.026475] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.026489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.034433] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.034447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.043328] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.043343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.051313] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.051327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.060219] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.060233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.068647] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.068661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.077100] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.077114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.085791] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.085805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.094454] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.094469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.102817] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.102831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.111203] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.111218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.119975] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.119990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.128611] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.128626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.137221] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.137236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.146168] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.146182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.154924] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.154938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.163396] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.163411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.171736] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.171751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.180041] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.180055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.188754] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.188768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.197770] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.197785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.205868] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.205882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.214399] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.214413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.222882] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.222896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.651 [2024-05-14 04:15:32.231746] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.651 [2024-05-14 04:15:32.231761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.239678] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.239692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.252224] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.252239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.259805] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.259820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.268959] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.268973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.277389] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.277403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.286108] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.286122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.294695] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.294710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.303462] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.303477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.312036] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.312050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.320676] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.320690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.328975] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.328989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.337382] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.337396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.346030] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.346044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.354633] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.354648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.363456] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.363470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.371877] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.371890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.380232] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.380249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.388678] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.388693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.397317] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.397331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.406148] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.406162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.414123] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.414137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.422877] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.422891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.431511] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.431524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.439769] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.439783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.448016] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.448031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.456360] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.456374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.464758] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.464773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.473338] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.473353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.912 [2024-05-14 04:15:32.481843] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.912 [2024-05-14 04:15:32.481858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.913 [2024-05-14 04:15:32.490491] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.913 [2024-05-14 04:15:32.490506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:17.913 [2024-05-14 04:15:32.498719] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:17.913 [2024-05-14 04:15:32.498734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.507215] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.507229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.516086] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.516100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.524118] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.524132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.532635] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.532649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.540670] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.540688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.549561] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.549574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.558221] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.558235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.566481] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.566495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.574857] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.574871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.583161] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.583175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.591663] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.591677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.599930] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.599944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.608256] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.608270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.617048] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.617062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.625640] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.625653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.634462] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.634476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.643172] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.643186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.651928] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.651943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.660458] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.660472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.669084] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.669097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.677480] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.677494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.686124] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.686138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.694724] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.694738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.703590] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.703607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.712739] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.712754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.721596] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.721610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.730066] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.730080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.739055] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.739069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.747535] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.747549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.175 [2024-05-14 04:15:32.755795] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.175 [2024-05-14 04:15:32.755809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.764541] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.764555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.771510] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.771523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.781592] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.781606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.790042] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.790055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.798591] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.798605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.807083] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.807097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.815569] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.815583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.824207] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.824220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.833152] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.833166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.841831] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.841844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.850418] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.850432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.859723] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.436 [2024-05-14 04:15:32.859737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.436 [2024-05-14 04:15:32.867858] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.867876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.876743] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.876757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.885305] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.885319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.893854] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.893868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.902493] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.902507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.911467] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.911481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.919144] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.919158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.928322] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.928336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.936195] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.936209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.944909] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.944923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.953408] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.953423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.961799] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.961813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.970489] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.970503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.978843] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.978858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.987221] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.987235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:32.995772] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:32.995787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:33.004373] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:33.004388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:33.013234] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:33.013248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.437 [2024-05-14 04:15:33.021922] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.437 [2024-05-14 04:15:33.021936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.698 [2024-05-14 04:15:33.030468] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.698 [2024-05-14 04:15:33.030486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.698 [2024-05-14 04:15:33.038944] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.698 [2024-05-14 04:15:33.038959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.698 [2024-05-14 04:15:33.047848] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.698 [2024-05-14 04:15:33.047862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.698 [2024-05-14 04:15:33.056567] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.698 [2024-05-14 04:15:33.056581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.698 [2024-05-14 04:15:33.064901] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.698 [2024-05-14 04:15:33.064915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.698 [2024-05-14 04:15:33.073265] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.698 [2024-05-14 04:15:33.073279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.698 [2024-05-14 04:15:33.082338] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.698 [2024-05-14 04:15:33.082352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.698 [2024-05-14 04:15:33.090764] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.090779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.099394] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.099409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.107941] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.107955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.116876] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.116890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.125092] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.125105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.133840] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.133854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.142475] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.142489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.151576] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.151591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.159214] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.159228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.168236] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.168250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.176939] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.176953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.185891] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.185905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.194256] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.194270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.202979] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.202994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.211896] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.211910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.220500] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.220515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.229038] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.229052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.237629] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.237643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.246629] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.246643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.255394] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.255408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.264299] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.264313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.273156] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.273169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.699 [2024-05-14 04:15:33.281701] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.699 [2024-05-14 04:15:33.281716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.290318] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.290332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.299120] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.299134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.307498] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.307513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.316282] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.316303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.324719] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.324733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.333229] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.333244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.341859] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.341873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.350275] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.350290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.359038] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.359053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.960 [2024-05-14 04:15:33.367542] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.960 [2024-05-14 04:15:33.367556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.376443] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.376458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.385163] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.385178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.393720] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.393734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.402078] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.402093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.411093] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.411108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.419793] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.419808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.428028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.428041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.436777] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.436790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.445050] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.445064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.453559] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.453573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.462694] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.462709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.470802] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.470816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.479745] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.479759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.488332] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.488347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.497244] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.497258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.505863] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.505877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.514199] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.514213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.523161] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.523175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.531475] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.531489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.540088] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.540103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:18.961 [2024-05-14 04:15:33.548478] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:18.961 [2024-05-14 04:15:33.548492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.557440] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.557454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.565475] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.565490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.574346] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.574360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.582322] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.582336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.591047] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.591061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.599495] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.599510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.608385] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.608400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.617269] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.617284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.625690] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.625704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.634153] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.634167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.643117] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.643131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.651831] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.651845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.660360] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.660374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.668989] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.669004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.676966] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.676981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.685698] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.685712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.694278] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.694298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.703194] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.703209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.711712] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.711726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.221 [2024-05-14 04:15:33.720218] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.221 [2024-05-14 04:15:33.720233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.728121] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.728135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.734265] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.734278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 00:18:19.222 Latency(us) 00:18:19.222 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.222 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:18:19.222 Nvme1n1 : 5.01 20132.55 157.29 0.00 0.00 6351.84 2307.41 29709.65 00:18:19.222 =================================================================================================================== 00:18:19.222 Total : 20132.55 157.29 0.00 0.00 6351.84 2307.41 29709.65 00:18:19.222 [2024-05-14 04:15:33.742285] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.742300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.750308] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.750318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.758334] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.758344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.766350] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.766359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.774369] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.774379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.782388] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.782397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.790408] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.790416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.798427] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.798436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.222 [2024-05-14 04:15:33.806448] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.222 [2024-05-14 04:15:33.806460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.482 [2024-05-14 04:15:33.814469] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.482 [2024-05-14 04:15:33.814477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.482 [2024-05-14 04:15:33.822490] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.482 [2024-05-14 04:15:33.822499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.482 [2024-05-14 04:15:33.830511] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.482 [2024-05-14 04:15:33.830520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.482 [2024-05-14 04:15:33.838530] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.482 [2024-05-14 04:15:33.838537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.482 [2024-05-14 04:15:33.846552] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.482 [2024-05-14 04:15:33.846561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.482 [2024-05-14 04:15:33.854570] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.482 [2024-05-14 04:15:33.854577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.482 [2024-05-14 04:15:33.862591] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:19.482 [2024-05-14 04:15:33.862598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:19.482 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3934676) - No such process 00:18:19.482 04:15:33 -- target/zcopy.sh@49 -- # wait 3934676 00:18:19.482 04:15:33 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:18:19.482 04:15:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:19.482 04:15:33 -- common/autotest_common.sh@10 -- # set +x 00:18:19.482 04:15:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:19.482 04:15:33 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:18:19.482 04:15:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:19.482 04:15:33 -- common/autotest_common.sh@10 -- # set +x 00:18:19.482 delay0 00:18:19.482 04:15:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:19.482 04:15:33 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:18:19.482 04:15:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:19.482 04:15:33 -- common/autotest_common.sh@10 -- # set +x 00:18:19.482 04:15:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:19.482 04:15:33 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:18:19.482 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.482 [2024-05-14 04:15:34.041421] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:18:26.076 Initializing NVMe Controllers 00:18:26.076 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:26.076 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:26.076 Initialization complete. Launching workers. 00:18:26.076 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 99 00:18:26.076 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 382, failed to submit 37 00:18:26.076 success 180, unsuccess 202, failed 0 00:18:26.076 04:15:40 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:18:26.076 04:15:40 -- target/zcopy.sh@60 -- # nvmftestfini 00:18:26.076 04:15:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:26.076 04:15:40 -- nvmf/common.sh@116 -- # sync 00:18:26.077 04:15:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:26.077 04:15:40 -- nvmf/common.sh@119 -- # set +e 00:18:26.077 04:15:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:26.077 04:15:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:26.077 rmmod nvme_tcp 00:18:26.077 rmmod nvme_fabrics 00:18:26.077 rmmod nvme_keyring 00:18:26.077 04:15:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:26.077 04:15:40 -- nvmf/common.sh@123 -- # set -e 00:18:26.077 04:15:40 -- nvmf/common.sh@124 -- # return 0 00:18:26.077 04:15:40 -- nvmf/common.sh@477 -- # '[' -n 3932545 ']' 00:18:26.077 04:15:40 -- nvmf/common.sh@478 -- # killprocess 3932545 00:18:26.077 04:15:40 -- common/autotest_common.sh@926 -- # '[' -z 3932545 ']' 00:18:26.077 04:15:40 -- common/autotest_common.sh@930 -- # kill -0 3932545 00:18:26.077 04:15:40 -- common/autotest_common.sh@931 -- # uname 00:18:26.077 04:15:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:26.077 04:15:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3932545 00:18:26.077 04:15:40 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:26.077 04:15:40 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:26.077 04:15:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3932545' 00:18:26.077 killing process with pid 3932545 00:18:26.077 04:15:40 -- common/autotest_common.sh@945 -- # kill 3932545 00:18:26.077 04:15:40 -- common/autotest_common.sh@950 -- # wait 3932545 00:18:26.077 04:15:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:26.077 04:15:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:26.077 04:15:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:26.077 04:15:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:26.077 04:15:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:26.077 04:15:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:26.077 04:15:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:26.077 04:15:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:28.664 04:15:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:28.664 00:18:28.664 real 0m33.061s 00:18:28.664 user 0m44.938s 00:18:28.664 sys 0m10.341s 00:18:28.664 04:15:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:28.664 04:15:42 -- common/autotest_common.sh@10 -- # set +x 00:18:28.664 ************************************ 00:18:28.664 END TEST nvmf_zcopy 00:18:28.664 ************************************ 00:18:28.664 04:15:42 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:28.664 04:15:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:28.664 04:15:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:28.664 04:15:42 -- common/autotest_common.sh@10 -- # set +x 00:18:28.664 ************************************ 00:18:28.664 START TEST nvmf_nmic 00:18:28.664 ************************************ 00:18:28.664 04:15:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:28.664 * Looking for test storage... 00:18:28.664 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:28.664 04:15:42 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:28.664 04:15:42 -- nvmf/common.sh@7 -- # uname -s 00:18:28.664 04:15:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:28.664 04:15:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:28.664 04:15:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:28.664 04:15:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:28.664 04:15:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:28.664 04:15:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:28.664 04:15:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:28.664 04:15:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:28.664 04:15:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:28.664 04:15:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:28.664 04:15:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:28.664 04:15:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:28.664 04:15:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:28.664 04:15:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:28.664 04:15:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:28.664 04:15:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:28.664 04:15:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:28.664 04:15:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:28.664 04:15:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:28.664 04:15:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:28.664 04:15:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:28.664 04:15:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:28.664 04:15:42 -- paths/export.sh@5 -- # export PATH 00:18:28.664 04:15:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:28.664 04:15:42 -- nvmf/common.sh@46 -- # : 0 00:18:28.664 04:15:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:28.664 04:15:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:28.664 04:15:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:28.664 04:15:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:28.665 04:15:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:28.665 04:15:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:28.665 04:15:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:28.665 04:15:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:28.665 04:15:42 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:28.665 04:15:42 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:28.665 04:15:42 -- target/nmic.sh@14 -- # nvmftestinit 00:18:28.665 04:15:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:28.665 04:15:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:28.665 04:15:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:28.665 04:15:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:28.665 04:15:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:28.665 04:15:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:28.665 04:15:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:28.665 04:15:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:28.665 04:15:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:28.665 04:15:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:28.665 04:15:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:28.665 04:15:42 -- common/autotest_common.sh@10 -- # set +x 00:18:35.256 04:15:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:35.256 04:15:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:35.256 04:15:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:35.256 04:15:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:35.256 04:15:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:35.256 04:15:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:35.256 04:15:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:35.256 04:15:49 -- nvmf/common.sh@294 -- # net_devs=() 00:18:35.256 04:15:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:35.256 04:15:49 -- nvmf/common.sh@295 -- # e810=() 00:18:35.256 04:15:49 -- nvmf/common.sh@295 -- # local -ga e810 00:18:35.256 04:15:49 -- nvmf/common.sh@296 -- # x722=() 00:18:35.256 04:15:49 -- nvmf/common.sh@296 -- # local -ga x722 00:18:35.256 04:15:49 -- nvmf/common.sh@297 -- # mlx=() 00:18:35.256 04:15:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:35.256 04:15:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:35.256 04:15:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:35.256 04:15:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:35.257 04:15:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:35.257 04:15:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:35.257 04:15:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:35.257 04:15:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:35.257 04:15:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:35.257 04:15:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:35.257 04:15:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:35.257 04:15:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:35.257 04:15:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:35.257 04:15:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:35.257 04:15:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:35.257 04:15:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:35.257 04:15:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:18:35.257 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:18:35.257 04:15:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:35.257 04:15:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:18:35.257 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:18:35.257 04:15:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:35.257 04:15:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:35.257 04:15:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.257 04:15:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:35.257 04:15:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.257 04:15:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:18:35.257 Found net devices under 0000:4b:00.0: cvl_0_0 00:18:35.257 04:15:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.257 04:15:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:35.257 04:15:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.257 04:15:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:35.257 04:15:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.257 04:15:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:18:35.257 Found net devices under 0000:4b:00.1: cvl_0_1 00:18:35.257 04:15:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.257 04:15:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:35.257 04:15:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:35.257 04:15:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:35.257 04:15:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:35.257 04:15:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:35.257 04:15:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:35.257 04:15:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:35.257 04:15:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:35.257 04:15:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:35.257 04:15:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:35.257 04:15:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:35.257 04:15:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:35.257 04:15:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:35.257 04:15:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:35.257 04:15:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:35.257 04:15:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:35.257 04:15:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:35.257 04:15:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:35.257 04:15:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:35.257 04:15:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:35.257 04:15:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:35.257 04:15:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:35.257 04:15:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:35.257 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:35.257 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.617 ms 00:18:35.257 00:18:35.257 --- 10.0.0.2 ping statistics --- 00:18:35.257 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:35.257 rtt min/avg/max/mdev = 0.617/0.617/0.617/0.000 ms 00:18:35.257 04:15:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:35.257 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:35.257 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.410 ms 00:18:35.257 00:18:35.257 --- 10.0.0.1 ping statistics --- 00:18:35.257 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:35.257 rtt min/avg/max/mdev = 0.410/0.410/0.410/0.000 ms 00:18:35.257 04:15:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:35.257 04:15:49 -- nvmf/common.sh@410 -- # return 0 00:18:35.257 04:15:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:35.257 04:15:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:35.257 04:15:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:35.257 04:15:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:35.257 04:15:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:35.257 04:15:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:35.519 04:15:49 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:18:35.519 04:15:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:35.519 04:15:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:35.519 04:15:49 -- common/autotest_common.sh@10 -- # set +x 00:18:35.519 04:15:49 -- nvmf/common.sh@469 -- # nvmfpid=3941314 00:18:35.519 04:15:49 -- nvmf/common.sh@470 -- # waitforlisten 3941314 00:18:35.519 04:15:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:35.519 04:15:49 -- common/autotest_common.sh@819 -- # '[' -z 3941314 ']' 00:18:35.519 04:15:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:35.519 04:15:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:35.519 04:15:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:35.519 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:35.519 04:15:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:35.519 04:15:49 -- common/autotest_common.sh@10 -- # set +x 00:18:35.519 [2024-05-14 04:15:49.903048] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:35.519 [2024-05-14 04:15:49.903098] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:35.519 EAL: No free 2048 kB hugepages reported on node 1 00:18:35.519 [2024-05-14 04:15:49.970005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:35.519 [2024-05-14 04:15:50.039230] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:35.519 [2024-05-14 04:15:50.039372] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:35.519 [2024-05-14 04:15:50.039382] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:35.519 [2024-05-14 04:15:50.039390] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:35.519 [2024-05-14 04:15:50.039460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:35.519 [2024-05-14 04:15:50.039541] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:35.519 [2024-05-14 04:15:50.039635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:35.519 [2024-05-14 04:15:50.039637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:36.463 04:15:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:36.463 04:15:50 -- common/autotest_common.sh@852 -- # return 0 00:18:36.463 04:15:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:36.463 04:15:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 04:15:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:36.463 04:15:50 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:36.463 04:15:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 [2024-05-14 04:15:50.724537] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:36.463 04:15:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:36.463 04:15:50 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:36.463 04:15:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 Malloc0 00:18:36.463 04:15:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:36.463 04:15:50 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:36.463 04:15:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 04:15:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:36.463 04:15:50 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:36.463 04:15:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 04:15:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:36.463 04:15:50 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:36.463 04:15:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 [2024-05-14 04:15:50.783799] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:36.463 04:15:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:36.463 04:15:50 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:18:36.463 test case1: single bdev can't be used in multiple subsystems 00:18:36.463 04:15:50 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:36.463 04:15:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 04:15:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:36.463 04:15:50 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:36.463 04:15:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 04:15:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:36.463 04:15:50 -- target/nmic.sh@28 -- # nmic_status=0 00:18:36.463 04:15:50 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:18:36.463 04:15:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 [2024-05-14 04:15:50.819728] bdev.c:7935:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:18:36.463 [2024-05-14 04:15:50.819746] subsystem.c:1779:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:18:36.463 [2024-05-14 04:15:50.819758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.463 request: 00:18:36.463 { 00:18:36.463 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:18:36.463 "namespace": { 00:18:36.463 "bdev_name": "Malloc0" 00:18:36.463 }, 00:18:36.463 "method": "nvmf_subsystem_add_ns", 00:18:36.463 "req_id": 1 00:18:36.463 } 00:18:36.463 Got JSON-RPC error response 00:18:36.463 response: 00:18:36.463 { 00:18:36.463 "code": -32602, 00:18:36.463 "message": "Invalid parameters" 00:18:36.463 } 00:18:36.463 04:15:50 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:18:36.463 04:15:50 -- target/nmic.sh@29 -- # nmic_status=1 00:18:36.463 04:15:50 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:18:36.463 04:15:50 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:18:36.463 Adding namespace failed - expected result. 00:18:36.463 04:15:50 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:18:36.463 test case2: host connect to nvmf target in multiple paths 00:18:36.463 04:15:50 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:36.463 04:15:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:36.463 04:15:50 -- common/autotest_common.sh@10 -- # set +x 00:18:36.463 [2024-05-14 04:15:50.831859] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:36.463 04:15:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:36.463 04:15:50 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:37.850 04:15:52 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:18:39.765 04:15:53 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:18:39.765 04:15:53 -- common/autotest_common.sh@1177 -- # local i=0 00:18:39.765 04:15:53 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:39.765 04:15:53 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:39.765 04:15:53 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:41.700 04:15:55 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:41.700 04:15:55 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:41.700 04:15:55 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:18:41.700 04:15:55 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:41.700 04:15:55 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:41.700 04:15:55 -- common/autotest_common.sh@1187 -- # return 0 00:18:41.700 04:15:55 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:18:41.700 [global] 00:18:41.700 thread=1 00:18:41.700 invalidate=1 00:18:41.700 rw=write 00:18:41.700 time_based=1 00:18:41.700 runtime=1 00:18:41.700 ioengine=libaio 00:18:41.700 direct=1 00:18:41.700 bs=4096 00:18:41.700 iodepth=1 00:18:41.700 norandommap=0 00:18:41.700 numjobs=1 00:18:41.700 00:18:41.700 verify_dump=1 00:18:41.700 verify_backlog=512 00:18:41.700 verify_state_save=0 00:18:41.700 do_verify=1 00:18:41.700 verify=crc32c-intel 00:18:41.700 [job0] 00:18:41.700 filename=/dev/nvme0n1 00:18:41.700 Could not set queue depth (nvme0n1) 00:18:41.961 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:41.961 fio-3.35 00:18:41.961 Starting 1 thread 00:18:42.904 00:18:42.904 job0: (groupid=0, jobs=1): err= 0: pid=3942636: Tue May 14 04:15:57 2024 00:18:42.904 read: IOPS=10, BW=44.0KiB/s (45.0kB/s)(44.0KiB/1001msec) 00:18:42.904 slat (nsec): min=26635, max=27030, avg=26826.55, stdev=140.24 00:18:42.904 clat (usec): min=41958, max=42979, avg=42506.55, stdev=497.03 00:18:42.904 lat (usec): min=41985, max=43006, avg=42533.38, stdev=497.06 00:18:42.904 clat percentiles (usec): 00:18:42.904 | 1.00th=[42206], 5.00th=[42206], 10.00th=[42206], 20.00th=[42206], 00:18:42.904 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42730], 60.00th=[42730], 00:18:42.904 | 70.00th=[42730], 80.00th=[42730], 90.00th=[42730], 95.00th=[42730], 00:18:42.904 | 99.00th=[42730], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:18:42.904 | 99.99th=[42730] 00:18:42.904 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:18:42.904 slat (usec): min=9, max=27429, avg=88.06, stdev=1210.71 00:18:42.904 clat (usec): min=624, max=1174, avg=943.36, stdev=81.42 00:18:42.904 lat (usec): min=659, max=28393, avg=1031.42, stdev=1214.39 00:18:42.904 clat percentiles (usec): 00:18:42.904 | 1.00th=[ 725], 5.00th=[ 791], 10.00th=[ 832], 20.00th=[ 889], 00:18:42.904 | 30.00th=[ 906], 40.00th=[ 922], 50.00th=[ 947], 60.00th=[ 971], 00:18:42.904 | 70.00th=[ 996], 80.00th=[ 1012], 90.00th=[ 1037], 95.00th=[ 1057], 00:18:42.904 | 99.00th=[ 1106], 99.50th=[ 1156], 99.90th=[ 1172], 99.95th=[ 1172], 00:18:42.904 | 99.99th=[ 1172] 00:18:42.904 bw ( KiB/s): min= 3832, max= 3832, per=100.00%, avg=3832.00, stdev= 0.00, samples=1 00:18:42.904 iops : min= 958, max= 958, avg=958.00, stdev= 0.00, samples=1 00:18:42.904 lat (usec) : 750=1.72%, 1000=69.02% 00:18:42.904 lat (msec) : 2=27.15%, 50=2.10% 00:18:42.904 cpu : usr=2.80%, sys=0.70%, ctx=526, majf=0, minf=1 00:18:42.904 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:42.904 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:42.904 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:42.904 issued rwts: total=11,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:42.904 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:42.904 00:18:42.904 Run status group 0 (all jobs): 00:18:42.904 READ: bw=44.0KiB/s (45.0kB/s), 44.0KiB/s-44.0KiB/s (45.0kB/s-45.0kB/s), io=44.0KiB (45.1kB), run=1001-1001msec 00:18:42.904 WRITE: bw=2046KiB/s (2095kB/s), 2046KiB/s-2046KiB/s (2095kB/s-2095kB/s), io=2048KiB (2097kB), run=1001-1001msec 00:18:42.904 00:18:42.904 Disk stats (read/write): 00:18:42.904 nvme0n1: ios=33/512, merge=0/0, ticks=1314/475, in_queue=1789, util=98.70% 00:18:42.904 04:15:57 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:18:43.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:18:43.165 04:15:57 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:18:43.165 04:15:57 -- common/autotest_common.sh@1198 -- # local i=0 00:18:43.165 04:15:57 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:18:43.165 04:15:57 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:43.165 04:15:57 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:18:43.165 04:15:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:43.165 04:15:57 -- common/autotest_common.sh@1210 -- # return 0 00:18:43.165 04:15:57 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:18:43.165 04:15:57 -- target/nmic.sh@53 -- # nvmftestfini 00:18:43.165 04:15:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:43.165 04:15:57 -- nvmf/common.sh@116 -- # sync 00:18:43.165 04:15:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:43.165 04:15:57 -- nvmf/common.sh@119 -- # set +e 00:18:43.165 04:15:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:43.165 04:15:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:43.165 rmmod nvme_tcp 00:18:43.165 rmmod nvme_fabrics 00:18:43.165 rmmod nvme_keyring 00:18:43.165 04:15:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:43.165 04:15:57 -- nvmf/common.sh@123 -- # set -e 00:18:43.165 04:15:57 -- nvmf/common.sh@124 -- # return 0 00:18:43.165 04:15:57 -- nvmf/common.sh@477 -- # '[' -n 3941314 ']' 00:18:43.165 04:15:57 -- nvmf/common.sh@478 -- # killprocess 3941314 00:18:43.165 04:15:57 -- common/autotest_common.sh@926 -- # '[' -z 3941314 ']' 00:18:43.165 04:15:57 -- common/autotest_common.sh@930 -- # kill -0 3941314 00:18:43.165 04:15:57 -- common/autotest_common.sh@931 -- # uname 00:18:43.166 04:15:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:43.166 04:15:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3941314 00:18:43.426 04:15:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:43.426 04:15:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:43.426 04:15:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3941314' 00:18:43.426 killing process with pid 3941314 00:18:43.426 04:15:57 -- common/autotest_common.sh@945 -- # kill 3941314 00:18:43.426 04:15:57 -- common/autotest_common.sh@950 -- # wait 3941314 00:18:43.426 04:15:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:43.426 04:15:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:43.426 04:15:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:43.426 04:15:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:43.426 04:15:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:43.426 04:15:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:43.426 04:15:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:43.426 04:15:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.976 04:16:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:45.976 00:18:45.976 real 0m17.348s 00:18:45.976 user 0m48.448s 00:18:45.976 sys 0m5.966s 00:18:45.976 04:16:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:45.976 04:16:00 -- common/autotest_common.sh@10 -- # set +x 00:18:45.976 ************************************ 00:18:45.976 END TEST nvmf_nmic 00:18:45.976 ************************************ 00:18:45.976 04:16:00 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:18:45.976 04:16:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:45.976 04:16:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:45.976 04:16:00 -- common/autotest_common.sh@10 -- # set +x 00:18:45.976 ************************************ 00:18:45.976 START TEST nvmf_fio_target 00:18:45.976 ************************************ 00:18:45.976 04:16:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:18:45.976 * Looking for test storage... 00:18:45.976 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:45.976 04:16:00 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:45.976 04:16:00 -- nvmf/common.sh@7 -- # uname -s 00:18:45.976 04:16:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:45.976 04:16:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:45.976 04:16:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:45.976 04:16:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:45.976 04:16:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:45.976 04:16:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:45.976 04:16:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:45.976 04:16:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:45.976 04:16:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:45.976 04:16:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:45.976 04:16:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:45.976 04:16:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:45.976 04:16:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:45.976 04:16:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:45.976 04:16:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:45.976 04:16:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:45.976 04:16:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:45.976 04:16:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:45.976 04:16:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:45.976 04:16:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.976 04:16:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.977 04:16:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.977 04:16:00 -- paths/export.sh@5 -- # export PATH 00:18:45.977 04:16:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.977 04:16:00 -- nvmf/common.sh@46 -- # : 0 00:18:45.977 04:16:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:45.977 04:16:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:45.977 04:16:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:45.977 04:16:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:45.977 04:16:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:45.977 04:16:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:45.977 04:16:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:45.977 04:16:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:45.977 04:16:00 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:45.977 04:16:00 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:45.977 04:16:00 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:45.977 04:16:00 -- target/fio.sh@16 -- # nvmftestinit 00:18:45.977 04:16:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:45.977 04:16:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:45.977 04:16:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:45.977 04:16:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:45.977 04:16:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:45.977 04:16:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.977 04:16:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.977 04:16:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.977 04:16:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:45.977 04:16:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:45.977 04:16:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:45.977 04:16:00 -- common/autotest_common.sh@10 -- # set +x 00:18:52.566 04:16:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:52.566 04:16:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:52.566 04:16:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:52.566 04:16:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:52.566 04:16:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:52.566 04:16:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:52.566 04:16:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:52.566 04:16:06 -- nvmf/common.sh@294 -- # net_devs=() 00:18:52.566 04:16:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:52.566 04:16:06 -- nvmf/common.sh@295 -- # e810=() 00:18:52.566 04:16:06 -- nvmf/common.sh@295 -- # local -ga e810 00:18:52.566 04:16:06 -- nvmf/common.sh@296 -- # x722=() 00:18:52.566 04:16:06 -- nvmf/common.sh@296 -- # local -ga x722 00:18:52.567 04:16:06 -- nvmf/common.sh@297 -- # mlx=() 00:18:52.567 04:16:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:52.567 04:16:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:52.567 04:16:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:52.567 04:16:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:52.567 04:16:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:52.567 04:16:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:52.567 04:16:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:18:52.567 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:18:52.567 04:16:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:52.567 04:16:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:18:52.567 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:18:52.567 04:16:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:52.567 04:16:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:52.567 04:16:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:52.567 04:16:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:52.567 04:16:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:52.567 04:16:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:18:52.567 Found net devices under 0000:4b:00.0: cvl_0_0 00:18:52.567 04:16:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:52.567 04:16:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:52.567 04:16:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:52.567 04:16:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:52.567 04:16:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:52.567 04:16:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:18:52.567 Found net devices under 0000:4b:00.1: cvl_0_1 00:18:52.567 04:16:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:52.567 04:16:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:52.567 04:16:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:52.567 04:16:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:52.567 04:16:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:52.567 04:16:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:52.567 04:16:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:52.567 04:16:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:52.567 04:16:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:52.567 04:16:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:52.567 04:16:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:52.567 04:16:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:52.567 04:16:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:52.567 04:16:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:52.567 04:16:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:52.567 04:16:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:52.567 04:16:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:52.567 04:16:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:52.567 04:16:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:52.567 04:16:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:52.829 04:16:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:52.829 04:16:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:52.829 04:16:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:52.829 04:16:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:52.829 04:16:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:52.829 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:52.829 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.464 ms 00:18:52.829 00:18:52.829 --- 10.0.0.2 ping statistics --- 00:18:52.829 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:52.829 rtt min/avg/max/mdev = 0.464/0.464/0.464/0.000 ms 00:18:52.829 04:16:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:52.829 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:52.829 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.350 ms 00:18:52.829 00:18:52.829 --- 10.0.0.1 ping statistics --- 00:18:52.829 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:52.829 rtt min/avg/max/mdev = 0.350/0.350/0.350/0.000 ms 00:18:52.829 04:16:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:52.829 04:16:07 -- nvmf/common.sh@410 -- # return 0 00:18:52.829 04:16:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:52.829 04:16:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:52.829 04:16:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:52.829 04:16:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:52.829 04:16:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:52.829 04:16:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:52.829 04:16:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:52.829 04:16:07 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:18:52.829 04:16:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:52.829 04:16:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:52.829 04:16:07 -- common/autotest_common.sh@10 -- # set +x 00:18:52.829 04:16:07 -- nvmf/common.sh@469 -- # nvmfpid=3947100 00:18:52.829 04:16:07 -- nvmf/common.sh@470 -- # waitforlisten 3947100 00:18:52.829 04:16:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:52.829 04:16:07 -- common/autotest_common.sh@819 -- # '[' -z 3947100 ']' 00:18:52.829 04:16:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:52.829 04:16:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:52.829 04:16:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:52.829 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:52.829 04:16:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:52.829 04:16:07 -- common/autotest_common.sh@10 -- # set +x 00:18:53.089 [2024-05-14 04:16:07.417240] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:53.089 [2024-05-14 04:16:07.417298] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:53.089 EAL: No free 2048 kB hugepages reported on node 1 00:18:53.089 [2024-05-14 04:16:07.485823] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:53.089 [2024-05-14 04:16:07.554317] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:53.089 [2024-05-14 04:16:07.554453] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:53.089 [2024-05-14 04:16:07.554461] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:53.089 [2024-05-14 04:16:07.554468] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:53.089 [2024-05-14 04:16:07.554614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:53.089 [2024-05-14 04:16:07.554748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:53.089 [2024-05-14 04:16:07.554906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:53.089 [2024-05-14 04:16:07.554908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:53.659 04:16:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:53.659 04:16:08 -- common/autotest_common.sh@852 -- # return 0 00:18:53.659 04:16:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:53.659 04:16:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:53.659 04:16:08 -- common/autotest_common.sh@10 -- # set +x 00:18:53.659 04:16:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:53.659 04:16:08 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:18:53.918 [2024-05-14 04:16:08.373892] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:53.919 04:16:08 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:54.179 04:16:08 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:18:54.179 04:16:08 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:54.179 04:16:08 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:18:54.439 04:16:08 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:54.439 04:16:08 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:18:54.439 04:16:08 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:54.700 04:16:09 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:18:54.700 04:16:09 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:18:54.700 04:16:09 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:54.960 04:16:09 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:18:54.960 04:16:09 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:55.221 04:16:09 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:18:55.221 04:16:09 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:55.221 04:16:09 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:18:55.221 04:16:09 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:18:55.482 04:16:09 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:55.743 04:16:10 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:18:55.743 04:16:10 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:55.743 04:16:10 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:18:55.743 04:16:10 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:56.044 04:16:10 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:56.044 [2024-05-14 04:16:10.611690] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:56.305 04:16:10 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:18:56.305 04:16:10 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:18:56.566 04:16:10 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:57.952 04:16:12 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:18:57.952 04:16:12 -- common/autotest_common.sh@1177 -- # local i=0 00:18:57.952 04:16:12 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:57.952 04:16:12 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:18:57.952 04:16:12 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:18:57.952 04:16:12 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:00.498 04:16:14 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:00.498 04:16:14 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:00.498 04:16:14 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:19:00.498 04:16:14 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:19:00.498 04:16:14 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:00.498 04:16:14 -- common/autotest_common.sh@1187 -- # return 0 00:19:00.498 04:16:14 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:00.498 [global] 00:19:00.498 thread=1 00:19:00.498 invalidate=1 00:19:00.498 rw=write 00:19:00.498 time_based=1 00:19:00.498 runtime=1 00:19:00.498 ioengine=libaio 00:19:00.498 direct=1 00:19:00.498 bs=4096 00:19:00.498 iodepth=1 00:19:00.498 norandommap=0 00:19:00.498 numjobs=1 00:19:00.498 00:19:00.498 verify_dump=1 00:19:00.498 verify_backlog=512 00:19:00.498 verify_state_save=0 00:19:00.498 do_verify=1 00:19:00.498 verify=crc32c-intel 00:19:00.498 [job0] 00:19:00.498 filename=/dev/nvme0n1 00:19:00.498 [job1] 00:19:00.498 filename=/dev/nvme0n2 00:19:00.498 [job2] 00:19:00.498 filename=/dev/nvme0n3 00:19:00.498 [job3] 00:19:00.498 filename=/dev/nvme0n4 00:19:00.498 Could not set queue depth (nvme0n1) 00:19:00.498 Could not set queue depth (nvme0n2) 00:19:00.498 Could not set queue depth (nvme0n3) 00:19:00.498 Could not set queue depth (nvme0n4) 00:19:00.498 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:00.498 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:00.498 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:00.498 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:00.498 fio-3.35 00:19:00.498 Starting 4 threads 00:19:01.885 00:19:01.885 job0: (groupid=0, jobs=1): err= 0: pid=3948833: Tue May 14 04:16:16 2024 00:19:01.885 read: IOPS=14, BW=59.5KiB/s (60.9kB/s)(60.0KiB/1009msec) 00:19:01.885 slat (nsec): min=25645, max=28960, avg=26291.33, stdev=914.78 00:19:01.885 clat (usec): min=1384, max=43090, avg=39527.78, stdev=10566.94 00:19:01.885 lat (usec): min=1413, max=43116, avg=39554.07, stdev=10566.20 00:19:01.885 clat percentiles (usec): 00:19:01.885 | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[41157], 20.00th=[41681], 00:19:01.885 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:19:01.885 | 70.00th=[42730], 80.00th=[42730], 90.00th=[43254], 95.00th=[43254], 00:19:01.885 | 99.00th=[43254], 99.50th=[43254], 99.90th=[43254], 99.95th=[43254], 00:19:01.885 | 99.99th=[43254] 00:19:01.885 write: IOPS=507, BW=2030KiB/s (2078kB/s)(2048KiB/1009msec); 0 zone resets 00:19:01.885 slat (nsec): min=10102, max=83711, avg=31124.43, stdev=9968.02 00:19:01.885 clat (usec): min=433, max=1061, avg=772.63, stdev=84.40 00:19:01.885 lat (usec): min=445, max=1094, avg=803.75, stdev=86.74 00:19:01.885 clat percentiles (usec): 00:19:01.885 | 1.00th=[ 586], 5.00th=[ 644], 10.00th=[ 676], 20.00th=[ 701], 00:19:01.885 | 30.00th=[ 734], 40.00th=[ 758], 50.00th=[ 775], 60.00th=[ 791], 00:19:01.885 | 70.00th=[ 807], 80.00th=[ 832], 90.00th=[ 873], 95.00th=[ 922], 00:19:01.885 | 99.00th=[ 979], 99.50th=[ 1037], 99.90th=[ 1057], 99.95th=[ 1057], 00:19:01.885 | 99.99th=[ 1057] 00:19:01.885 bw ( KiB/s): min= 4096, max= 4096, per=51.65%, avg=4096.00, stdev= 0.00, samples=1 00:19:01.885 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:01.885 lat (usec) : 500=0.19%, 750=35.48%, 1000=60.72% 00:19:01.885 lat (msec) : 2=0.95%, 50=2.66% 00:19:01.885 cpu : usr=0.69%, sys=1.59%, ctx=531, majf=0, minf=1 00:19:01.885 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:01.885 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:01.885 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:01.885 issued rwts: total=15,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:01.885 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:01.885 job1: (groupid=0, jobs=1): err= 0: pid=3948834: Tue May 14 04:16:16 2024 00:19:01.885 read: IOPS=12, BW=50.3KiB/s (51.5kB/s)(52.0KiB/1033msec) 00:19:01.885 slat (nsec): min=25204, max=26046, avg=25600.77, stdev=231.24 00:19:01.885 clat (usec): min=41524, max=43209, avg=42481.34, stdev=546.86 00:19:01.885 lat (usec): min=41550, max=43235, avg=42506.94, stdev=546.90 00:19:01.885 clat percentiles (usec): 00:19:01.885 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[42206], 00:19:01.885 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42730], 60.00th=[42730], 00:19:01.885 | 70.00th=[42730], 80.00th=[42730], 90.00th=[43254], 95.00th=[43254], 00:19:01.885 | 99.00th=[43254], 99.50th=[43254], 99.90th=[43254], 99.95th=[43254], 00:19:01.885 | 99.99th=[43254] 00:19:01.885 write: IOPS=495, BW=1983KiB/s (2030kB/s)(2048KiB/1033msec); 0 zone resets 00:19:01.885 slat (usec): min=10, max=4667, avg=43.82, stdev=204.84 00:19:01.885 clat (usec): min=505, max=1254, avg=885.85, stdev=113.40 00:19:01.885 lat (usec): min=515, max=5660, avg=929.68, stdev=238.74 00:19:01.885 clat percentiles (usec): 00:19:01.885 | 1.00th=[ 627], 5.00th=[ 693], 10.00th=[ 750], 20.00th=[ 799], 00:19:01.885 | 30.00th=[ 832], 40.00th=[ 857], 50.00th=[ 889], 60.00th=[ 922], 00:19:01.885 | 70.00th=[ 938], 80.00th=[ 971], 90.00th=[ 1004], 95.00th=[ 1074], 00:19:01.885 | 99.00th=[ 1188], 99.50th=[ 1221], 99.90th=[ 1254], 99.95th=[ 1254], 00:19:01.885 | 99.99th=[ 1254] 00:19:01.885 bw ( KiB/s): min= 4096, max= 4096, per=51.65%, avg=4096.00, stdev= 0.00, samples=1 00:19:01.885 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:01.885 lat (usec) : 750=10.48%, 1000=75.62% 00:19:01.885 lat (msec) : 2=11.43%, 50=2.48% 00:19:01.886 cpu : usr=0.78%, sys=1.65%, ctx=527, majf=0, minf=1 00:19:01.886 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:01.886 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:01.886 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:01.886 issued rwts: total=13,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:01.886 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:01.886 job2: (groupid=0, jobs=1): err= 0: pid=3948835: Tue May 14 04:16:16 2024 00:19:01.886 read: IOPS=442, BW=1770KiB/s (1813kB/s)(1772KiB/1001msec) 00:19:01.886 slat (nsec): min=24858, max=61804, avg=26498.17, stdev=4196.64 00:19:01.886 clat (usec): min=964, max=1446, avg=1309.61, stdev=57.58 00:19:01.886 lat (usec): min=990, max=1471, avg=1336.11, stdev=57.65 00:19:01.886 clat percentiles (usec): 00:19:01.886 | 1.00th=[ 1139], 5.00th=[ 1221], 10.00th=[ 1237], 20.00th=[ 1270], 00:19:01.886 | 30.00th=[ 1287], 40.00th=[ 1303], 50.00th=[ 1319], 60.00th=[ 1319], 00:19:01.886 | 70.00th=[ 1336], 80.00th=[ 1352], 90.00th=[ 1369], 95.00th=[ 1401], 00:19:01.886 | 99.00th=[ 1434], 99.50th=[ 1434], 99.90th=[ 1450], 99.95th=[ 1450], 00:19:01.886 | 99.99th=[ 1450] 00:19:01.886 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:01.886 slat (nsec): min=10154, max=66808, avg=31153.14, stdev=9107.40 00:19:01.886 clat (usec): min=443, max=967, avg=750.93, stdev=85.35 00:19:01.886 lat (usec): min=454, max=989, avg=782.08, stdev=86.52 00:19:01.886 clat percentiles (usec): 00:19:01.886 | 1.00th=[ 510], 5.00th=[ 586], 10.00th=[ 644], 20.00th=[ 685], 00:19:01.886 | 30.00th=[ 709], 40.00th=[ 742], 50.00th=[ 766], 60.00th=[ 791], 00:19:01.886 | 70.00th=[ 799], 80.00th=[ 816], 90.00th=[ 840], 95.00th=[ 873], 00:19:01.886 | 99.00th=[ 930], 99.50th=[ 955], 99.90th=[ 971], 99.95th=[ 971], 00:19:01.886 | 99.99th=[ 971] 00:19:01.886 bw ( KiB/s): min= 4096, max= 4096, per=51.65%, avg=4096.00, stdev= 0.00, samples=1 00:19:01.886 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:01.886 lat (usec) : 500=0.52%, 750=22.83%, 1000=30.37% 00:19:01.886 lat (msec) : 2=46.28% 00:19:01.886 cpu : usr=1.00%, sys=3.30%, ctx=956, majf=0, minf=1 00:19:01.886 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:01.886 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:01.886 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:01.886 issued rwts: total=443,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:01.886 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:01.886 job3: (groupid=0, jobs=1): err= 0: pid=3948836: Tue May 14 04:16:16 2024 00:19:01.886 read: IOPS=15, BW=62.0KiB/s (63.4kB/s)(64.0KiB/1033msec) 00:19:01.886 slat (nsec): min=14977, max=28124, avg=24557.38, stdev=4363.46 00:19:01.886 clat (usec): min=41894, max=42924, avg=42031.21, stdev=247.00 00:19:01.886 lat (usec): min=41921, max=42950, avg=42055.76, stdev=247.53 00:19:01.886 clat percentiles (usec): 00:19:01.886 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[41681], 00:19:01.886 | 30.00th=[41681], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:19:01.886 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42730], 00:19:01.886 | 99.00th=[42730], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:19:01.886 | 99.99th=[42730] 00:19:01.886 write: IOPS=495, BW=1983KiB/s (2030kB/s)(2048KiB/1033msec); 0 zone resets 00:19:01.886 slat (nsec): min=9343, max=57104, avg=30654.53, stdev=10162.84 00:19:01.886 clat (usec): min=242, max=1208, avg=666.24, stdev=174.56 00:19:01.886 lat (usec): min=252, max=1242, avg=696.90, stdev=179.18 00:19:01.886 clat percentiles (usec): 00:19:01.886 | 1.00th=[ 351], 5.00th=[ 412], 10.00th=[ 474], 20.00th=[ 545], 00:19:01.886 | 30.00th=[ 578], 40.00th=[ 594], 50.00th=[ 627], 60.00th=[ 676], 00:19:01.886 | 70.00th=[ 709], 80.00th=[ 783], 90.00th=[ 963], 95.00th=[ 1012], 00:19:01.886 | 99.00th=[ 1106], 99.50th=[ 1172], 99.90th=[ 1205], 99.95th=[ 1205], 00:19:01.886 | 99.99th=[ 1205] 00:19:01.886 bw ( KiB/s): min= 4096, max= 4096, per=51.65%, avg=4096.00, stdev= 0.00, samples=1 00:19:01.886 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:01.886 lat (usec) : 250=0.19%, 500=13.45%, 750=61.36%, 1000=16.10% 00:19:01.886 lat (msec) : 2=5.87%, 50=3.03% 00:19:01.886 cpu : usr=0.87%, sys=1.94%, ctx=529, majf=0, minf=1 00:19:01.886 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:01.886 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:01.886 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:01.886 issued rwts: total=16,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:01.886 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:01.886 00:19:01.886 Run status group 0 (all jobs): 00:19:01.886 READ: bw=1886KiB/s (1931kB/s), 50.3KiB/s-1770KiB/s (51.5kB/s-1813kB/s), io=1948KiB (1995kB), run=1001-1033msec 00:19:01.886 WRITE: bw=7930KiB/s (8121kB/s), 1983KiB/s-2046KiB/s (2030kB/s-2095kB/s), io=8192KiB (8389kB), run=1001-1033msec 00:19:01.886 00:19:01.886 Disk stats (read/write): 00:19:01.886 nvme0n1: ios=31/512, merge=0/0, ticks=1232/383, in_queue=1615, util=84.37% 00:19:01.886 nvme0n2: ios=51/512, merge=0/0, ticks=462/442, in_queue=904, util=90.71% 00:19:01.886 nvme0n3: ios=343/512, merge=0/0, ticks=1296/376, in_queue=1672, util=92.39% 00:19:01.886 nvme0n4: ios=34/512, merge=0/0, ticks=1358/291, in_queue=1649, util=94.44% 00:19:01.886 04:16:16 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:01.886 [global] 00:19:01.886 thread=1 00:19:01.886 invalidate=1 00:19:01.886 rw=randwrite 00:19:01.886 time_based=1 00:19:01.886 runtime=1 00:19:01.886 ioengine=libaio 00:19:01.886 direct=1 00:19:01.886 bs=4096 00:19:01.886 iodepth=1 00:19:01.886 norandommap=0 00:19:01.886 numjobs=1 00:19:01.886 00:19:01.886 verify_dump=1 00:19:01.886 verify_backlog=512 00:19:01.886 verify_state_save=0 00:19:01.886 do_verify=1 00:19:01.886 verify=crc32c-intel 00:19:01.886 [job0] 00:19:01.886 filename=/dev/nvme0n1 00:19:01.886 [job1] 00:19:01.886 filename=/dev/nvme0n2 00:19:01.886 [job2] 00:19:01.886 filename=/dev/nvme0n3 00:19:01.886 [job3] 00:19:01.886 filename=/dev/nvme0n4 00:19:01.886 Could not set queue depth (nvme0n1) 00:19:01.886 Could not set queue depth (nvme0n2) 00:19:01.886 Could not set queue depth (nvme0n3) 00:19:01.886 Could not set queue depth (nvme0n4) 00:19:02.148 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:02.148 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:02.148 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:02.148 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:02.148 fio-3.35 00:19:02.148 Starting 4 threads 00:19:03.534 00:19:03.534 job0: (groupid=0, jobs=1): err= 0: pid=3949361: Tue May 14 04:16:17 2024 00:19:03.534 read: IOPS=304, BW=1218KiB/s (1247kB/s)(1220KiB/1002msec) 00:19:03.534 slat (nsec): min=11550, max=49586, avg=25673.13, stdev=3797.06 00:19:03.534 clat (usec): min=916, max=1740, avg=1296.13, stdev=99.62 00:19:03.534 lat (usec): min=941, max=1765, avg=1321.81, stdev=99.92 00:19:03.534 clat percentiles (usec): 00:19:03.534 | 1.00th=[ 1004], 5.00th=[ 1156], 10.00th=[ 1205], 20.00th=[ 1254], 00:19:03.534 | 30.00th=[ 1270], 40.00th=[ 1287], 50.00th=[ 1303], 60.00th=[ 1319], 00:19:03.534 | 70.00th=[ 1319], 80.00th=[ 1336], 90.00th=[ 1369], 95.00th=[ 1418], 00:19:03.534 | 99.00th=[ 1680], 99.50th=[ 1713], 99.90th=[ 1745], 99.95th=[ 1745], 00:19:03.534 | 99.99th=[ 1745] 00:19:03.534 write: IOPS=510, BW=2044KiB/s (2093kB/s)(2048KiB/1002msec); 0 zone resets 00:19:03.534 slat (nsec): min=31678, max=69728, avg=33189.06, stdev=3058.05 00:19:03.534 clat (usec): min=754, max=1284, avg=1120.96, stdev=65.86 00:19:03.534 lat (usec): min=787, max=1316, avg=1154.15, stdev=65.52 00:19:03.534 clat percentiles (usec): 00:19:03.534 | 1.00th=[ 914], 5.00th=[ 1004], 10.00th=[ 1037], 20.00th=[ 1074], 00:19:03.534 | 30.00th=[ 1106], 40.00th=[ 1123], 50.00th=[ 1139], 60.00th=[ 1139], 00:19:03.534 | 70.00th=[ 1156], 80.00th=[ 1172], 90.00th=[ 1188], 95.00th=[ 1205], 00:19:03.534 | 99.00th=[ 1254], 99.50th=[ 1254], 99.90th=[ 1287], 99.95th=[ 1287], 00:19:03.534 | 99.99th=[ 1287] 00:19:03.534 bw ( KiB/s): min= 3440, max= 3440, per=42.83%, avg=3440.00, stdev= 0.00, samples=1 00:19:03.534 iops : min= 860, max= 860, avg=860.00, stdev= 0.00, samples=1 00:19:03.534 lat (usec) : 1000=3.18% 00:19:03.534 lat (msec) : 2=96.82% 00:19:03.534 cpu : usr=0.40%, sys=3.50%, ctx=820, majf=0, minf=1 00:19:03.534 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:03.534 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:03.534 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:03.534 issued rwts: total=305,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:03.534 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:03.534 job1: (groupid=0, jobs=1): err= 0: pid=3949362: Tue May 14 04:16:17 2024 00:19:03.534 read: IOPS=313, BW=1255KiB/s (1285kB/s)(1256KiB/1001msec) 00:19:03.534 slat (nsec): min=12434, max=68191, avg=27064.64, stdev=4727.61 00:19:03.534 clat (usec): min=1145, max=42119, avg=1836.26, stdev=4572.37 00:19:03.534 lat (usec): min=1171, max=42144, avg=1863.32, stdev=4572.15 00:19:03.534 clat percentiles (usec): 00:19:03.534 | 1.00th=[ 1172], 5.00th=[ 1221], 10.00th=[ 1254], 20.00th=[ 1287], 00:19:03.535 | 30.00th=[ 1303], 40.00th=[ 1303], 50.00th=[ 1319], 60.00th=[ 1336], 00:19:03.535 | 70.00th=[ 1336], 80.00th=[ 1352], 90.00th=[ 1369], 95.00th=[ 1401], 00:19:03.535 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:03.535 | 99.99th=[42206] 00:19:03.535 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:03.535 slat (nsec): min=9980, max=51361, avg=29195.19, stdev=9138.50 00:19:03.535 clat (usec): min=540, max=900, avg=769.09, stdev=56.23 00:19:03.535 lat (usec): min=554, max=933, avg=798.29, stdev=59.39 00:19:03.535 clat percentiles (usec): 00:19:03.535 | 1.00th=[ 635], 5.00th=[ 660], 10.00th=[ 676], 20.00th=[ 725], 00:19:03.535 | 30.00th=[ 758], 40.00th=[ 775], 50.00th=[ 783], 60.00th=[ 791], 00:19:03.535 | 70.00th=[ 799], 80.00th=[ 816], 90.00th=[ 824], 95.00th=[ 840], 00:19:03.535 | 99.00th=[ 865], 99.50th=[ 865], 99.90th=[ 898], 99.95th=[ 898], 00:19:03.535 | 99.99th=[ 898] 00:19:03.535 bw ( KiB/s): min= 4096, max= 4096, per=51.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:03.535 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:03.535 lat (usec) : 750=15.13%, 1000=46.85% 00:19:03.535 lat (msec) : 2=37.41%, 4=0.12%, 50=0.48% 00:19:03.535 cpu : usr=0.90%, sys=2.80%, ctx=827, majf=0, minf=1 00:19:03.535 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:03.535 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:03.535 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:03.535 issued rwts: total=314,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:03.535 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:03.535 job2: (groupid=0, jobs=1): err= 0: pid=3949363: Tue May 14 04:16:17 2024 00:19:03.535 read: IOPS=9, BW=39.2KiB/s (40.2kB/s)(40.0KiB/1020msec) 00:19:03.535 slat (nsec): min=26307, max=27092, avg=26644.30, stdev=233.62 00:19:03.535 clat (usec): min=41654, max=42837, avg=42173.35, stdev=377.33 00:19:03.535 lat (usec): min=41681, max=42863, avg=42199.99, stdev=377.35 00:19:03.535 clat percentiles (usec): 00:19:03.535 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[41681], 00:19:03.535 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:19:03.535 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42730], 95.00th=[42730], 00:19:03.535 | 99.00th=[42730], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:19:03.535 | 99.99th=[42730] 00:19:03.535 write: IOPS=501, BW=2008KiB/s (2056kB/s)(2048KiB/1020msec); 0 zone resets 00:19:03.535 slat (nsec): min=11838, max=56216, avg=33884.25, stdev=3089.75 00:19:03.535 clat (usec): min=675, max=2376, avg=1123.71, stdev=86.47 00:19:03.535 lat (usec): min=708, max=2410, avg=1157.59, stdev=86.63 00:19:03.535 clat percentiles (usec): 00:19:03.535 | 1.00th=[ 955], 5.00th=[ 1004], 10.00th=[ 1037], 20.00th=[ 1074], 00:19:03.535 | 30.00th=[ 1106], 40.00th=[ 1123], 50.00th=[ 1139], 60.00th=[ 1139], 00:19:03.535 | 70.00th=[ 1156], 80.00th=[ 1172], 90.00th=[ 1188], 95.00th=[ 1205], 00:19:03.535 | 99.00th=[ 1270], 99.50th=[ 1303], 99.90th=[ 2376], 99.95th=[ 2376], 00:19:03.535 | 99.99th=[ 2376] 00:19:03.535 bw ( KiB/s): min= 672, max= 3424, per=25.50%, avg=2048.00, stdev=1945.96, samples=2 00:19:03.535 iops : min= 168, max= 856, avg=512.00, stdev=486.49, samples=2 00:19:03.535 lat (usec) : 750=0.38%, 1000=4.21% 00:19:03.535 lat (msec) : 2=93.30%, 4=0.19%, 50=1.92% 00:19:03.535 cpu : usr=0.20%, sys=2.36%, ctx=523, majf=0, minf=1 00:19:03.535 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:03.535 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:03.535 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:03.535 issued rwts: total=10,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:03.535 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:03.535 job3: (groupid=0, jobs=1): err= 0: pid=3949364: Tue May 14 04:16:17 2024 00:19:03.535 read: IOPS=260, BW=1043KiB/s (1068kB/s)(1044KiB/1001msec) 00:19:03.535 slat (nsec): min=6835, max=63098, avg=13049.60, stdev=9017.93 00:19:03.535 clat (usec): min=638, max=42903, avg=2119.32, stdev=6576.64 00:19:03.535 lat (usec): min=646, max=42929, avg=2132.37, stdev=6579.07 00:19:03.535 clat percentiles (usec): 00:19:03.535 | 1.00th=[ 693], 5.00th=[ 857], 10.00th=[ 922], 20.00th=[ 979], 00:19:03.535 | 30.00th=[ 1012], 40.00th=[ 1020], 50.00th=[ 1037], 60.00th=[ 1057], 00:19:03.535 | 70.00th=[ 1074], 80.00th=[ 1106], 90.00th=[ 1139], 95.00th=[ 1188], 00:19:03.535 | 99.00th=[42206], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:19:03.535 | 99.99th=[42730] 00:19:03.535 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:03.535 slat (nsec): min=9669, max=51959, avg=29553.90, stdev=9296.58 00:19:03.535 clat (usec): min=455, max=1376, avg=827.08, stdev=120.18 00:19:03.535 lat (usec): min=488, max=1409, avg=856.64, stdev=122.12 00:19:03.535 clat percentiles (usec): 00:19:03.535 | 1.00th=[ 619], 5.00th=[ 676], 10.00th=[ 693], 20.00th=[ 734], 00:19:03.535 | 30.00th=[ 766], 40.00th=[ 791], 50.00th=[ 807], 60.00th=[ 824], 00:19:03.535 | 70.00th=[ 848], 80.00th=[ 906], 90.00th=[ 1004], 95.00th=[ 1029], 00:19:03.535 | 99.00th=[ 1221], 99.50th=[ 1287], 99.90th=[ 1369], 99.95th=[ 1369], 00:19:03.535 | 99.99th=[ 1369] 00:19:03.535 bw ( KiB/s): min= 4096, max= 4096, per=51.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:03.535 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:03.535 lat (usec) : 500=0.13%, 750=15.27%, 1000=52.78% 00:19:03.535 lat (msec) : 2=30.92%, 50=0.91% 00:19:03.535 cpu : usr=1.40%, sys=1.70%, ctx=774, majf=0, minf=1 00:19:03.535 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:03.535 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:03.535 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:03.535 issued rwts: total=261,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:03.535 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:03.535 00:19:03.535 Run status group 0 (all jobs): 00:19:03.535 READ: bw=3490KiB/s (3574kB/s), 39.2KiB/s-1255KiB/s (40.2kB/s-1285kB/s), io=3560KiB (3645kB), run=1001-1020msec 00:19:03.535 WRITE: bw=8031KiB/s (8224kB/s), 2008KiB/s-2046KiB/s (2056kB/s-2095kB/s), io=8192KiB (8389kB), run=1001-1020msec 00:19:03.535 00:19:03.535 Disk stats (read/write): 00:19:03.535 nvme0n1: ios=206/512, merge=0/0, ticks=1090/560, in_queue=1650, util=84.67% 00:19:03.535 nvme0n2: ios=336/512, merge=0/0, ticks=495/382, in_queue=877, util=91.03% 00:19:03.535 nvme0n3: ios=55/512, merge=0/0, ticks=356/561, in_queue=917, util=95.26% 00:19:03.535 nvme0n4: ios=126/512, merge=0/0, ticks=1282/414, in_queue=1696, util=94.46% 00:19:03.535 04:16:17 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:03.535 [global] 00:19:03.535 thread=1 00:19:03.535 invalidate=1 00:19:03.535 rw=write 00:19:03.535 time_based=1 00:19:03.535 runtime=1 00:19:03.535 ioengine=libaio 00:19:03.535 direct=1 00:19:03.535 bs=4096 00:19:03.535 iodepth=128 00:19:03.535 norandommap=0 00:19:03.535 numjobs=1 00:19:03.535 00:19:03.535 verify_dump=1 00:19:03.535 verify_backlog=512 00:19:03.535 verify_state_save=0 00:19:03.535 do_verify=1 00:19:03.535 verify=crc32c-intel 00:19:03.535 [job0] 00:19:03.535 filename=/dev/nvme0n1 00:19:03.535 [job1] 00:19:03.535 filename=/dev/nvme0n2 00:19:03.535 [job2] 00:19:03.535 filename=/dev/nvme0n3 00:19:03.535 [job3] 00:19:03.535 filename=/dev/nvme0n4 00:19:03.535 Could not set queue depth (nvme0n1) 00:19:03.535 Could not set queue depth (nvme0n2) 00:19:03.535 Could not set queue depth (nvme0n3) 00:19:03.535 Could not set queue depth (nvme0n4) 00:19:03.796 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:03.796 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:03.796 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:03.796 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:03.796 fio-3.35 00:19:03.796 Starting 4 threads 00:19:05.183 00:19:05.183 job0: (groupid=0, jobs=1): err= 0: pid=3949889: Tue May 14 04:16:19 2024 00:19:05.183 read: IOPS=5703, BW=22.3MiB/s (23.4MB/s)(23.3MiB/1045msec) 00:19:05.183 slat (nsec): min=908, max=16837k, avg=84690.17, stdev=649342.28 00:19:05.183 clat (usec): min=2999, max=92813, avg=12098.89, stdev=12450.94 00:19:05.183 lat (usec): min=3003, max=92815, avg=12183.58, stdev=12508.42 00:19:05.183 clat percentiles (usec): 00:19:05.183 | 1.00th=[ 3654], 5.00th=[ 5800], 10.00th=[ 6259], 20.00th=[ 6980], 00:19:05.183 | 30.00th=[ 7177], 40.00th=[ 7570], 50.00th=[ 7963], 60.00th=[ 8717], 00:19:05.183 | 70.00th=[10421], 80.00th=[12911], 90.00th=[18482], 95.00th=[40109], 00:19:05.183 | 99.00th=[82314], 99.50th=[92799], 99.90th=[92799], 99.95th=[92799], 00:19:05.183 | 99.99th=[92799] 00:19:05.183 write: IOPS=5879, BW=23.0MiB/s (24.1MB/s)(24.0MiB/1045msec); 0 zone resets 00:19:05.183 slat (nsec): min=1585, max=14042k, avg=76268.49, stdev=467748.12 00:19:05.183 clat (usec): min=3441, max=23292, avg=9522.93, stdev=3352.48 00:19:05.183 lat (usec): min=3445, max=23301, avg=9599.20, stdev=3378.88 00:19:05.183 clat percentiles (usec): 00:19:05.183 | 1.00th=[ 3884], 5.00th=[ 5211], 10.00th=[ 5997], 20.00th=[ 7046], 00:19:05.183 | 30.00th=[ 7701], 40.00th=[ 8094], 50.00th=[ 8717], 60.00th=[ 9503], 00:19:05.183 | 70.00th=[10290], 80.00th=[11863], 90.00th=[14353], 95.00th=[16188], 00:19:05.183 | 99.00th=[20317], 99.50th=[20841], 99.90th=[22152], 99.95th=[23200], 00:19:05.183 | 99.99th=[23200] 00:19:05.183 bw ( KiB/s): min=20480, max=28672, per=29.77%, avg=24576.00, stdev=5792.62, samples=2 00:19:05.183 iops : min= 5120, max= 7168, avg=6144.00, stdev=1448.15, samples=2 00:19:05.183 lat (msec) : 4=1.76%, 10=64.44%, 20=28.48%, 50=3.70%, 100=1.62% 00:19:05.183 cpu : usr=2.49%, sys=5.08%, ctx=673, majf=0, minf=1 00:19:05.183 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:05.183 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.183 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:05.183 issued rwts: total=5960,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.183 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:05.183 job1: (groupid=0, jobs=1): err= 0: pid=3949890: Tue May 14 04:16:19 2024 00:19:05.183 read: IOPS=3065, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1002msec) 00:19:05.183 slat (nsec): min=843, max=14322k, avg=157009.44, stdev=1001654.63 00:19:05.183 clat (usec): min=6161, max=61072, avg=20990.32, stdev=9814.48 00:19:05.183 lat (usec): min=6163, max=61102, avg=21147.33, stdev=9896.09 00:19:05.183 clat percentiles (usec): 00:19:05.183 | 1.00th=[ 6194], 5.00th=[ 9765], 10.00th=[11076], 20.00th=[13566], 00:19:05.183 | 30.00th=[16057], 40.00th=[16909], 50.00th=[17957], 60.00th=[19792], 00:19:05.183 | 70.00th=[23987], 80.00th=[28181], 90.00th=[32900], 95.00th=[42206], 00:19:05.183 | 99.00th=[52691], 99.50th=[52691], 99.90th=[55837], 99.95th=[60556], 00:19:05.183 | 99.99th=[61080] 00:19:05.183 write: IOPS=3396, BW=13.3MiB/s (13.9MB/s)(13.3MiB/1002msec); 0 zone resets 00:19:05.183 slat (nsec): min=1546, max=9754.5k, avg=146888.79, stdev=799337.21 00:19:05.183 clat (usec): min=921, max=45992, avg=18150.02, stdev=7722.33 00:19:05.183 lat (usec): min=3554, max=46581, avg=18296.91, stdev=7784.86 00:19:05.183 clat percentiles (usec): 00:19:05.183 | 1.00th=[ 6390], 5.00th=[10028], 10.00th=[10814], 20.00th=[11863], 00:19:05.183 | 30.00th=[13042], 40.00th=[14091], 50.00th=[16909], 60.00th=[19006], 00:19:05.183 | 70.00th=[20579], 80.00th=[22676], 90.00th=[28443], 95.00th=[34341], 00:19:05.183 | 99.00th=[43779], 99.50th=[44827], 99.90th=[45876], 99.95th=[45876], 00:19:05.183 | 99.99th=[45876] 00:19:05.183 bw ( KiB/s): min=12288, max=13920, per=15.87%, avg=13104.00, stdev=1154.00, samples=2 00:19:05.183 iops : min= 3072, max= 3480, avg=3276.00, stdev=288.50, samples=2 00:19:05.183 lat (usec) : 1000=0.02% 00:19:05.183 lat (msec) : 4=0.11%, 10=5.39%, 20=59.32%, 50=33.84%, 100=1.33% 00:19:05.183 cpu : usr=2.90%, sys=2.70%, ctx=261, majf=0, minf=1 00:19:05.183 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:05.183 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.183 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:05.183 issued rwts: total=3072,3403,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.183 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:05.183 job2: (groupid=0, jobs=1): err= 0: pid=3949893: Tue May 14 04:16:19 2024 00:19:05.183 read: IOPS=5609, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1004msec) 00:19:05.183 slat (nsec): min=936, max=9244.8k, avg=76231.89, stdev=456860.01 00:19:05.183 clat (usec): min=2671, max=46824, avg=10022.36, stdev=3477.81 00:19:05.183 lat (usec): min=2673, max=46825, avg=10098.59, stdev=3488.70 00:19:05.183 clat percentiles (usec): 00:19:05.183 | 1.00th=[ 4621], 5.00th=[ 5669], 10.00th=[ 6915], 20.00th=[ 7570], 00:19:05.183 | 30.00th=[ 8160], 40.00th=[ 8717], 50.00th=[ 9241], 60.00th=[10028], 00:19:05.183 | 70.00th=[10814], 80.00th=[12649], 90.00th=[14222], 95.00th=[16188], 00:19:05.183 | 99.00th=[18482], 99.50th=[19006], 99.90th=[45351], 99.95th=[45351], 00:19:05.183 | 99.99th=[46924] 00:19:05.183 write: IOPS=5672, BW=22.2MiB/s (23.2MB/s)(22.2MiB/1004msec); 0 zone resets 00:19:05.183 slat (nsec): min=1601, max=7107.8k, avg=95675.18, stdev=523615.01 00:19:05.183 clat (usec): min=628, max=32773, avg=12386.10, stdev=4847.97 00:19:05.183 lat (usec): min=2613, max=33345, avg=12481.78, stdev=4873.55 00:19:05.183 clat percentiles (usec): 00:19:05.183 | 1.00th=[ 3916], 5.00th=[ 5866], 10.00th=[ 6783], 20.00th=[ 7898], 00:19:05.183 | 30.00th=[ 9503], 40.00th=[10945], 50.00th=[11994], 60.00th=[13042], 00:19:05.183 | 70.00th=[14222], 80.00th=[15926], 90.00th=[19006], 95.00th=[20841], 00:19:05.183 | 99.00th=[28705], 99.50th=[30016], 99.90th=[32637], 99.95th=[32637], 00:19:05.183 | 99.99th=[32900] 00:19:05.183 bw ( KiB/s): min=20784, max=24272, per=27.29%, avg=22528.00, stdev=2466.39, samples=2 00:19:05.183 iops : min= 5196, max= 6068, avg=5632.00, stdev=616.60, samples=2 00:19:05.183 lat (usec) : 750=0.01% 00:19:05.183 lat (msec) : 4=0.65%, 10=46.38%, 20=49.16%, 50=3.80% 00:19:05.183 cpu : usr=3.49%, sys=4.09%, ctx=638, majf=0, minf=1 00:19:05.183 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:05.183 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.183 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:05.183 issued rwts: total=5632,5695,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.183 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:05.183 job3: (groupid=0, jobs=1): err= 0: pid=3949894: Tue May 14 04:16:19 2024 00:19:05.183 read: IOPS=6113, BW=23.9MiB/s (25.0MB/s)(24.0MiB/1005msec) 00:19:05.183 slat (nsec): min=961, max=8868.1k, avg=77975.52, stdev=511269.15 00:19:05.183 clat (usec): min=3050, max=22249, avg=9909.19, stdev=2820.63 00:19:05.183 lat (usec): min=3062, max=22258, avg=9987.17, stdev=2846.09 00:19:05.183 clat percentiles (usec): 00:19:05.183 | 1.00th=[ 5211], 5.00th=[ 6456], 10.00th=[ 6915], 20.00th=[ 7832], 00:19:05.183 | 30.00th=[ 8291], 40.00th=[ 8717], 50.00th=[ 9110], 60.00th=[10159], 00:19:05.183 | 70.00th=[10552], 80.00th=[11469], 90.00th=[14091], 95.00th=[15664], 00:19:05.183 | 99.00th=[18744], 99.50th=[19006], 99.90th=[21890], 99.95th=[22152], 00:19:05.183 | 99.99th=[22152] 00:19:05.183 write: IOPS=6291, BW=24.6MiB/s (25.8MB/s)(24.7MiB/1005msec); 0 zone resets 00:19:05.183 slat (nsec): min=1692, max=18137k, avg=76954.11, stdev=421725.07 00:19:05.183 clat (usec): min=1217, max=22735, avg=10110.66, stdev=3607.46 00:19:05.183 lat (usec): min=1227, max=22737, avg=10187.62, stdev=3624.89 00:19:05.183 clat percentiles (usec): 00:19:05.183 | 1.00th=[ 3687], 5.00th=[ 4752], 10.00th=[ 5604], 20.00th=[ 6980], 00:19:05.183 | 30.00th=[ 8455], 40.00th=[ 9110], 50.00th=[ 9896], 60.00th=[10683], 00:19:05.183 | 70.00th=[11338], 80.00th=[12649], 90.00th=[14615], 95.00th=[15664], 00:19:05.183 | 99.00th=[21890], 99.50th=[22152], 99.90th=[22676], 99.95th=[22676], 00:19:05.183 | 99.99th=[22676] 00:19:05.183 bw ( KiB/s): min=24576, max=25088, per=30.08%, avg=24832.00, stdev=362.04, samples=2 00:19:05.183 iops : min= 6144, max= 6272, avg=6208.00, stdev=90.51, samples=2 00:19:05.183 lat (msec) : 2=0.06%, 4=0.70%, 10=52.89%, 20=44.97%, 50=1.39% 00:19:05.183 cpu : usr=4.78%, sys=6.57%, ctx=682, majf=0, minf=1 00:19:05.183 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:05.183 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.183 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:05.183 issued rwts: total=6144,6323,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.183 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:05.183 00:19:05.183 Run status group 0 (all jobs): 00:19:05.183 READ: bw=77.8MiB/s (81.6MB/s), 12.0MiB/s-23.9MiB/s (12.6MB/s-25.0MB/s), io=81.3MiB (85.2MB), run=1002-1045msec 00:19:05.183 WRITE: bw=80.6MiB/s (84.5MB/s), 13.3MiB/s-24.6MiB/s (13.9MB/s-25.8MB/s), io=84.2MiB (88.3MB), run=1002-1045msec 00:19:05.183 00:19:05.183 Disk stats (read/write): 00:19:05.183 nvme0n1: ios=5469/5632, merge=0/0, ticks=26474/26397, in_queue=52871, util=87.68% 00:19:05.183 nvme0n2: ios=2610/2703, merge=0/0, ticks=19072/15697, in_queue=34769, util=93.18% 00:19:05.183 nvme0n3: ios=4422/4608, merge=0/0, ticks=22976/30636, in_queue=53612, util=96.53% 00:19:05.184 nvme0n4: ios=5141/5128, merge=0/0, ticks=49746/51239, in_queue=100985, util=99.57% 00:19:05.184 04:16:19 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:05.184 [global] 00:19:05.184 thread=1 00:19:05.184 invalidate=1 00:19:05.184 rw=randwrite 00:19:05.184 time_based=1 00:19:05.184 runtime=1 00:19:05.184 ioengine=libaio 00:19:05.184 direct=1 00:19:05.184 bs=4096 00:19:05.184 iodepth=128 00:19:05.184 norandommap=0 00:19:05.184 numjobs=1 00:19:05.184 00:19:05.184 verify_dump=1 00:19:05.184 verify_backlog=512 00:19:05.184 verify_state_save=0 00:19:05.184 do_verify=1 00:19:05.184 verify=crc32c-intel 00:19:05.184 [job0] 00:19:05.184 filename=/dev/nvme0n1 00:19:05.184 [job1] 00:19:05.184 filename=/dev/nvme0n2 00:19:05.184 [job2] 00:19:05.184 filename=/dev/nvme0n3 00:19:05.184 [job3] 00:19:05.184 filename=/dev/nvme0n4 00:19:05.184 Could not set queue depth (nvme0n1) 00:19:05.184 Could not set queue depth (nvme0n2) 00:19:05.184 Could not set queue depth (nvme0n3) 00:19:05.184 Could not set queue depth (nvme0n4) 00:19:05.444 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:05.444 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:05.444 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:05.444 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:05.444 fio-3.35 00:19:05.444 Starting 4 threads 00:19:06.830 00:19:06.830 job0: (groupid=0, jobs=1): err= 0: pid=3950423: Tue May 14 04:16:21 2024 00:19:06.830 read: IOPS=5609, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1004msec) 00:19:06.830 slat (nsec): min=860, max=9206.2k, avg=72896.56, stdev=494658.37 00:19:06.830 clat (usec): min=979, max=50937, avg=10227.49, stdev=4551.84 00:19:06.830 lat (usec): min=1179, max=51706, avg=10300.39, stdev=4560.91 00:19:06.830 clat percentiles (usec): 00:19:06.830 | 1.00th=[ 2343], 5.00th=[ 5473], 10.00th=[ 6849], 20.00th=[ 7832], 00:19:06.830 | 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9765], 60.00th=[10290], 00:19:06.830 | 70.00th=[10552], 80.00th=[12125], 90.00th=[14222], 95.00th=[16188], 00:19:06.830 | 99.00th=[18482], 99.50th=[50070], 99.90th=[51119], 99.95th=[51119], 00:19:06.830 | 99.99th=[51119] 00:19:06.830 write: IOPS=5870, BW=22.9MiB/s (24.0MB/s)(23.0MiB/1004msec); 0 zone resets 00:19:06.830 slat (nsec): min=1462, max=15219k, avg=92435.55, stdev=476798.10 00:19:06.830 clat (usec): min=1156, max=39050, avg=11644.50, stdev=6938.32 00:19:06.830 lat (usec): min=1163, max=39059, avg=11736.94, stdev=6963.53 00:19:06.830 clat percentiles (usec): 00:19:06.831 | 1.00th=[ 2933], 5.00th=[ 4424], 10.00th=[ 5276], 20.00th=[ 6915], 00:19:06.831 | 30.00th=[ 8029], 40.00th=[ 8586], 50.00th=[ 9372], 60.00th=[10290], 00:19:06.831 | 70.00th=[11994], 80.00th=[15664], 90.00th=[22414], 95.00th=[28181], 00:19:06.831 | 99.00th=[34341], 99.50th=[35390], 99.90th=[39060], 99.95th=[39060], 00:19:06.831 | 99.99th=[39060] 00:19:06.831 bw ( KiB/s): min=21552, max=24576, per=27.59%, avg=23064.00, stdev=2138.29, samples=2 00:19:06.831 iops : min= 5388, max= 6144, avg=5766.00, stdev=534.57, samples=2 00:19:06.831 lat (usec) : 1000=0.01% 00:19:06.831 lat (msec) : 2=0.75%, 4=2.65%, 10=51.61%, 20=38.44%, 50=6.30% 00:19:06.831 lat (msec) : 100=0.23% 00:19:06.831 cpu : usr=2.69%, sys=4.59%, ctx=832, majf=0, minf=1 00:19:06.831 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:06.831 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:06.831 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:06.831 issued rwts: total=5632,5894,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:06.831 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:06.831 job1: (groupid=0, jobs=1): err= 0: pid=3950424: Tue May 14 04:16:21 2024 00:19:06.831 read: IOPS=7048, BW=27.5MiB/s (28.9MB/s)(27.6MiB/1004msec) 00:19:06.831 slat (nsec): min=883, max=12421k, avg=66058.15, stdev=484101.77 00:19:06.831 clat (usec): min=1171, max=23265, avg=8920.95, stdev=2944.96 00:19:06.831 lat (usec): min=1348, max=25300, avg=8987.01, stdev=2975.79 00:19:06.831 clat percentiles (usec): 00:19:06.831 | 1.00th=[ 3720], 5.00th=[ 5407], 10.00th=[ 5866], 20.00th=[ 6587], 00:19:06.831 | 30.00th=[ 7111], 40.00th=[ 7570], 50.00th=[ 8356], 60.00th=[ 9241], 00:19:06.831 | 70.00th=[ 9896], 80.00th=[10945], 90.00th=[13173], 95.00th=[13829], 00:19:06.831 | 99.00th=[20055], 99.50th=[20055], 99.90th=[20055], 99.95th=[20317], 00:19:06.831 | 99.99th=[23200] 00:19:06.831 write: IOPS=7139, BW=27.9MiB/s (29.2MB/s)(28.0MiB/1004msec); 0 zone resets 00:19:06.831 slat (nsec): min=1517, max=7951.0k, avg=61676.67, stdev=395341.97 00:19:06.831 clat (usec): min=720, max=20314, avg=8948.77, stdev=2990.06 00:19:06.831 lat (usec): min=753, max=21501, avg=9010.45, stdev=3015.97 00:19:06.831 clat percentiles (usec): 00:19:06.831 | 1.00th=[ 2900], 5.00th=[ 4359], 10.00th=[ 5145], 20.00th=[ 6259], 00:19:06.831 | 30.00th=[ 7177], 40.00th=[ 8356], 50.00th=[ 8979], 60.00th=[ 9634], 00:19:06.831 | 70.00th=[10290], 80.00th=[11207], 90.00th=[12780], 95.00th=[13960], 00:19:06.831 | 99.00th=[16909], 99.50th=[19268], 99.90th=[20317], 99.95th=[20317], 00:19:06.831 | 99.99th=[20317] 00:19:06.831 bw ( KiB/s): min=26024, max=31320, per=34.29%, avg=28672.00, stdev=3744.84, samples=2 00:19:06.831 iops : min= 6506, max= 7830, avg=7168.00, stdev=936.21, samples=2 00:19:06.831 lat (usec) : 750=0.03% 00:19:06.831 lat (msec) : 2=0.29%, 4=2.27%, 10=66.18%, 20=30.89%, 50=0.34% 00:19:06.831 cpu : usr=4.09%, sys=6.98%, ctx=588, majf=0, minf=1 00:19:06.831 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:06.831 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:06.831 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:06.831 issued rwts: total=7077,7168,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:06.831 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:06.831 job2: (groupid=0, jobs=1): err= 0: pid=3950425: Tue May 14 04:16:21 2024 00:19:06.831 read: IOPS=4580, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1006msec) 00:19:06.831 slat (nsec): min=895, max=23016k, avg=103502.69, stdev=707258.51 00:19:06.831 clat (usec): min=2914, max=53581, avg=13366.54, stdev=8209.01 00:19:06.831 lat (usec): min=2916, max=53585, avg=13470.05, stdev=8248.17 00:19:06.831 clat percentiles (usec): 00:19:06.831 | 1.00th=[ 4883], 5.00th=[ 5800], 10.00th=[ 7046], 20.00th=[ 8160], 00:19:06.831 | 30.00th=[ 9110], 40.00th=[ 9503], 50.00th=[10290], 60.00th=[11600], 00:19:06.831 | 70.00th=[15008], 80.00th=[17171], 90.00th=[22676], 95.00th=[29230], 00:19:06.831 | 99.00th=[50594], 99.50th=[52167], 99.90th=[53740], 99.95th=[53740], 00:19:06.831 | 99.99th=[53740] 00:19:06.831 write: IOPS=4864, BW=19.0MiB/s (19.9MB/s)(19.1MiB/1006msec); 0 zone resets 00:19:06.831 slat (nsec): min=1493, max=27069k, avg=102631.90, stdev=639100.11 00:19:06.831 clat (usec): min=3770, max=38844, avg=12897.24, stdev=5592.09 00:19:06.831 lat (usec): min=3858, max=38852, avg=12999.87, stdev=5625.47 00:19:06.831 clat percentiles (usec): 00:19:06.831 | 1.00th=[ 4113], 5.00th=[ 6783], 10.00th=[ 7963], 20.00th=[ 8848], 00:19:06.831 | 30.00th=[ 9372], 40.00th=[10290], 50.00th=[11076], 60.00th=[12387], 00:19:06.831 | 70.00th=[14353], 80.00th=[16188], 90.00th=[20579], 95.00th=[25035], 00:19:06.831 | 99.00th=[29492], 99.50th=[36963], 99.90th=[39060], 99.95th=[39060], 00:19:06.831 | 99.99th=[39060] 00:19:06.831 bw ( KiB/s): min=16384, max=21744, per=22.80%, avg=19064.00, stdev=3790.09, samples=2 00:19:06.831 iops : min= 4096, max= 5436, avg=4766.00, stdev=947.52, samples=2 00:19:06.831 lat (msec) : 4=0.41%, 10=41.58%, 20=44.57%, 50=12.91%, 100=0.53% 00:19:06.831 cpu : usr=1.49%, sys=4.18%, ctx=610, majf=0, minf=1 00:19:06.831 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:06.831 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:06.831 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:06.831 issued rwts: total=4608,4894,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:06.831 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:06.831 job3: (groupid=0, jobs=1): err= 0: pid=3950426: Tue May 14 04:16:21 2024 00:19:06.831 read: IOPS=2898, BW=11.3MiB/s (11.9MB/s)(11.4MiB/1005msec) 00:19:06.831 slat (nsec): min=933, max=17283k, avg=175902.51, stdev=999303.59 00:19:06.831 clat (usec): min=1361, max=43076, avg=22613.20, stdev=7758.78 00:19:06.831 lat (usec): min=7480, max=43082, avg=22789.10, stdev=7755.30 00:19:06.831 clat percentiles (usec): 00:19:06.831 | 1.00th=[ 7635], 5.00th=[11600], 10.00th=[12649], 20.00th=[15533], 00:19:06.831 | 30.00th=[17957], 40.00th=[19530], 50.00th=[21103], 60.00th=[25560], 00:19:06.831 | 70.00th=[27657], 80.00th=[29492], 90.00th=[32637], 95.00th=[34866], 00:19:06.831 | 99.00th=[40109], 99.50th=[41681], 99.90th=[43254], 99.95th=[43254], 00:19:06.831 | 99.99th=[43254] 00:19:06.831 write: IOPS=3056, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1005msec); 0 zone resets 00:19:06.831 slat (nsec): min=1578, max=15841k, avg=154051.94, stdev=869588.35 00:19:06.831 clat (usec): min=6198, max=42516, avg=19802.79, stdev=6738.19 00:19:06.831 lat (usec): min=6213, max=42520, avg=19956.84, stdev=6749.80 00:19:06.831 clat percentiles (usec): 00:19:06.831 | 1.00th=[ 8356], 5.00th=[10552], 10.00th=[12649], 20.00th=[14484], 00:19:06.831 | 30.00th=[16188], 40.00th=[17433], 50.00th=[18482], 60.00th=[20317], 00:19:06.831 | 70.00th=[21627], 80.00th=[23462], 90.00th=[28181], 95.00th=[35914], 00:19:06.831 | 99.00th=[40633], 99.50th=[41157], 99.90th=[42730], 99.95th=[42730], 00:19:06.831 | 99.99th=[42730] 00:19:06.831 bw ( KiB/s): min=12288, max=12288, per=14.70%, avg=12288.00, stdev= 0.00, samples=2 00:19:06.831 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=2 00:19:06.831 lat (msec) : 2=0.02%, 10=2.51%, 20=47.64%, 50=49.84% 00:19:06.831 cpu : usr=1.99%, sys=3.09%, ctx=282, majf=0, minf=1 00:19:06.831 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:06.831 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:06.831 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:06.831 issued rwts: total=2913,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:06.831 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:06.831 00:19:06.831 Run status group 0 (all jobs): 00:19:06.831 READ: bw=78.6MiB/s (82.4MB/s), 11.3MiB/s-27.5MiB/s (11.9MB/s-28.9MB/s), io=79.0MiB (82.9MB), run=1004-1006msec 00:19:06.831 WRITE: bw=81.7MiB/s (85.6MB/s), 11.9MiB/s-27.9MiB/s (12.5MB/s-29.2MB/s), io=82.1MiB (86.1MB), run=1004-1006msec 00:19:06.831 00:19:06.831 Disk stats (read/write): 00:19:06.831 nvme0n1: ios=4658/4749, merge=0/0, ticks=31647/39167, in_queue=70814, util=88.28% 00:19:06.831 nvme0n2: ios=6007/6144, merge=0/0, ticks=37664/39602, in_queue=77266, util=96.02% 00:19:06.831 nvme0n3: ios=3639/3668, merge=0/0, ticks=20434/19271, in_queue=39705, util=93.14% 00:19:06.831 nvme0n4: ios=2511/2560, merge=0/0, ticks=14763/12152, in_queue=26915, util=95.94% 00:19:06.831 04:16:21 -- target/fio.sh@55 -- # sync 00:19:06.831 04:16:21 -- target/fio.sh@59 -- # fio_pid=3950697 00:19:06.831 04:16:21 -- target/fio.sh@61 -- # sleep 3 00:19:06.831 04:16:21 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:06.831 [global] 00:19:06.831 thread=1 00:19:06.831 invalidate=1 00:19:06.831 rw=read 00:19:06.831 time_based=1 00:19:06.831 runtime=10 00:19:06.831 ioengine=libaio 00:19:06.831 direct=1 00:19:06.831 bs=4096 00:19:06.831 iodepth=1 00:19:06.831 norandommap=1 00:19:06.831 numjobs=1 00:19:06.831 00:19:06.831 [job0] 00:19:06.831 filename=/dev/nvme0n1 00:19:06.831 [job1] 00:19:06.831 filename=/dev/nvme0n2 00:19:06.831 [job2] 00:19:06.831 filename=/dev/nvme0n3 00:19:06.831 [job3] 00:19:06.831 filename=/dev/nvme0n4 00:19:06.831 Could not set queue depth (nvme0n1) 00:19:06.831 Could not set queue depth (nvme0n2) 00:19:06.831 Could not set queue depth (nvme0n3) 00:19:06.831 Could not set queue depth (nvme0n4) 00:19:07.406 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:07.406 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:07.406 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:07.406 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:07.406 fio-3.35 00:19:07.406 Starting 4 threads 00:19:09.952 04:16:24 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:09.952 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=9355264, buflen=4096 00:19:09.952 fio: pid=3950947, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:09.952 04:16:24 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:10.213 04:16:24 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:10.213 04:16:24 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:10.213 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=270336, buflen=4096 00:19:10.213 fio: pid=3950946, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:10.213 04:16:24 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:10.213 04:16:24 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:10.213 fio: io_u error on file /dev/nvme0n1: Input/output error: read offset=499712, buflen=4096 00:19:10.213 fio: pid=3950944, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:19:10.474 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=10616832, buflen=4096 00:19:10.474 fio: pid=3950945, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:10.474 04:16:24 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:10.474 04:16:24 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:10.474 00:19:10.474 job0: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=3950944: Tue May 14 04:16:24 2024 00:19:10.474 read: IOPS=42, BW=168KiB/s (172kB/s)(488KiB/2913msec) 00:19:10.474 slat (usec): min=25, max=6994, avg=85.51, stdev=628.51 00:19:10.475 clat (usec): min=1157, max=43167, avg=23777.51, stdev=20445.65 00:19:10.475 lat (usec): min=1183, max=43194, avg=23806.39, stdev=20446.81 00:19:10.475 clat percentiles (usec): 00:19:10.475 | 1.00th=[ 1172], 5.00th=[ 1237], 10.00th=[ 1254], 20.00th=[ 1287], 00:19:10.475 | 30.00th=[ 1336], 40.00th=[ 1369], 50.00th=[41681], 60.00th=[42206], 00:19:10.475 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42730], 95.00th=[42730], 00:19:10.475 | 99.00th=[43254], 99.50th=[43254], 99.90th=[43254], 99.95th=[43254], 00:19:10.475 | 99.99th=[43254] 00:19:10.475 bw ( KiB/s): min= 96, max= 152, per=1.62%, avg=107.20, stdev=25.04, samples=5 00:19:10.475 iops : min= 24, max= 38, avg=26.80, stdev= 6.26, samples=5 00:19:10.475 lat (msec) : 2=44.72%, 50=54.47% 00:19:10.475 cpu : usr=0.03%, sys=0.34%, ctx=125, majf=0, minf=1 00:19:10.475 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:10.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.475 complete : 0=0.8%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.475 issued rwts: total=123,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.475 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:10.475 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3950945: Tue May 14 04:16:24 2024 00:19:10.475 read: IOPS=844, BW=3375KiB/s (3456kB/s)(10.1MiB/3072msec) 00:19:10.475 slat (usec): min=7, max=16474, avg=51.29, stdev=546.16 00:19:10.475 clat (usec): min=603, max=1620, avg=1118.79, stdev=70.77 00:19:10.475 lat (usec): min=629, max=17618, avg=1170.09, stdev=551.95 00:19:10.475 clat percentiles (usec): 00:19:10.475 | 1.00th=[ 906], 5.00th=[ 1029], 10.00th=[ 1057], 20.00th=[ 1090], 00:19:10.475 | 30.00th=[ 1090], 40.00th=[ 1106], 50.00th=[ 1123], 60.00th=[ 1139], 00:19:10.475 | 70.00th=[ 1139], 80.00th=[ 1156], 90.00th=[ 1172], 95.00th=[ 1205], 00:19:10.475 | 99.00th=[ 1369], 99.50th=[ 1483], 99.90th=[ 1582], 99.95th=[ 1598], 00:19:10.475 | 99.99th=[ 1614] 00:19:10.475 bw ( KiB/s): min= 3456, max= 3512, per=52.75%, avg=3478.40, stdev=21.47, samples=5 00:19:10.475 iops : min= 864, max= 878, avg=869.60, stdev= 5.37, samples=5 00:19:10.475 lat (usec) : 750=0.35%, 1000=2.62% 00:19:10.475 lat (msec) : 2=96.99% 00:19:10.475 cpu : usr=0.85%, sys=2.67%, ctx=2601, majf=0, minf=1 00:19:10.475 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:10.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.475 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.475 issued rwts: total=2593,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.475 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:10.475 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3950946: Tue May 14 04:16:24 2024 00:19:10.475 read: IOPS=24, BW=95.8KiB/s (98.1kB/s)(264KiB/2756msec) 00:19:10.475 slat (usec): min=23, max=231, avg=28.41, stdev=25.18 00:19:10.475 clat (usec): min=1261, max=43045, avg=41388.84, stdev=7131.54 00:19:10.475 lat (usec): min=1295, max=43070, avg=41417.29, stdev=7131.03 00:19:10.475 clat percentiles (usec): 00:19:10.475 | 1.00th=[ 1254], 5.00th=[41681], 10.00th=[42206], 20.00th=[42206], 00:19:10.475 | 30.00th=[42206], 40.00th=[42730], 50.00th=[42730], 60.00th=[42730], 00:19:10.475 | 70.00th=[42730], 80.00th=[42730], 90.00th=[43254], 95.00th=[43254], 00:19:10.475 | 99.00th=[43254], 99.50th=[43254], 99.90th=[43254], 99.95th=[43254], 00:19:10.475 | 99.99th=[43254] 00:19:10.475 bw ( KiB/s): min= 88, max= 104, per=1.46%, avg=96.00, stdev= 5.66, samples=5 00:19:10.475 iops : min= 22, max= 26, avg=24.00, stdev= 1.41, samples=5 00:19:10.475 lat (msec) : 2=2.99%, 50=95.52% 00:19:10.475 cpu : usr=0.11%, sys=0.00%, ctx=69, majf=0, minf=1 00:19:10.475 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:10.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.475 complete : 0=1.5%, 4=98.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.475 issued rwts: total=67,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.475 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:10.475 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3950947: Tue May 14 04:16:24 2024 00:19:10.475 read: IOPS=891, BW=3565KiB/s (3650kB/s)(9136KiB/2563msec) 00:19:10.475 slat (nsec): min=6884, max=62286, avg=25595.08, stdev=4183.19 00:19:10.475 clat (usec): min=527, max=1416, avg=1080.59, stdev=178.14 00:19:10.475 lat (usec): min=546, max=1441, avg=1106.18, stdev=177.72 00:19:10.475 clat percentiles (usec): 00:19:10.475 | 1.00th=[ 693], 5.00th=[ 791], 10.00th=[ 840], 20.00th=[ 898], 00:19:10.475 | 30.00th=[ 947], 40.00th=[ 1037], 50.00th=[ 1123], 60.00th=[ 1172], 00:19:10.475 | 70.00th=[ 1221], 80.00th=[ 1254], 90.00th=[ 1287], 95.00th=[ 1319], 00:19:10.475 | 99.00th=[ 1369], 99.50th=[ 1385], 99.90th=[ 1401], 99.95th=[ 1418], 00:19:10.475 | 99.99th=[ 1418] 00:19:10.475 bw ( KiB/s): min= 3368, max= 4088, per=54.69%, avg=3606.40, stdev=292.10, samples=5 00:19:10.475 iops : min= 842, max= 1022, avg=901.60, stdev=73.03, samples=5 00:19:10.475 lat (usec) : 750=2.54%, 1000=33.17% 00:19:10.475 lat (msec) : 2=64.25% 00:19:10.475 cpu : usr=1.09%, sys=2.97%, ctx=2285, majf=0, minf=2 00:19:10.475 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:10.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.475 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.475 issued rwts: total=2285,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.475 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:10.475 00:19:10.475 Run status group 0 (all jobs): 00:19:10.475 READ: bw=6594KiB/s (6752kB/s), 95.8KiB/s-3565KiB/s (98.1kB/s-3650kB/s), io=19.8MiB (20.7MB), run=2563-3072msec 00:19:10.475 00:19:10.475 Disk stats (read/write): 00:19:10.475 nvme0n1: ios=154/0, merge=0/0, ticks=3808/0, in_queue=3808, util=99.47% 00:19:10.475 nvme0n2: ios=2478/0, merge=0/0, ticks=3788/0, in_queue=3788, util=98.32% 00:19:10.475 nvme0n3: ios=103/0, merge=0/0, ticks=3510/0, in_queue=3510, util=99.11% 00:19:10.475 nvme0n4: ios=2119/0, merge=0/0, ticks=2141/0, in_queue=2141, util=96.06% 00:19:10.736 04:16:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:10.736 04:16:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:10.736 04:16:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:10.736 04:16:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:10.996 04:16:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:10.996 04:16:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:11.257 04:16:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:11.257 04:16:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:11.257 04:16:25 -- target/fio.sh@69 -- # fio_status=0 00:19:11.257 04:16:25 -- target/fio.sh@70 -- # wait 3950697 00:19:11.257 04:16:25 -- target/fio.sh@70 -- # fio_status=4 00:19:11.257 04:16:25 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:11.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:11.518 04:16:25 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:11.518 04:16:25 -- common/autotest_common.sh@1198 -- # local i=0 00:19:11.518 04:16:25 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:11.518 04:16:25 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:11.518 04:16:25 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:11.518 04:16:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:11.518 04:16:25 -- common/autotest_common.sh@1210 -- # return 0 00:19:11.518 04:16:25 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:11.518 04:16:25 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:11.518 nvmf hotplug test: fio failed as expected 00:19:11.518 04:16:25 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:11.518 04:16:26 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:11.518 04:16:26 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:11.518 04:16:26 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:11.518 04:16:26 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:11.518 04:16:26 -- target/fio.sh@91 -- # nvmftestfini 00:19:11.518 04:16:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:11.518 04:16:26 -- nvmf/common.sh@116 -- # sync 00:19:11.518 04:16:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:11.518 04:16:26 -- nvmf/common.sh@119 -- # set +e 00:19:11.518 04:16:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:11.518 04:16:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:11.518 rmmod nvme_tcp 00:19:11.518 rmmod nvme_fabrics 00:19:11.780 rmmod nvme_keyring 00:19:11.780 04:16:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:11.780 04:16:26 -- nvmf/common.sh@123 -- # set -e 00:19:11.780 04:16:26 -- nvmf/common.sh@124 -- # return 0 00:19:11.780 04:16:26 -- nvmf/common.sh@477 -- # '[' -n 3947100 ']' 00:19:11.780 04:16:26 -- nvmf/common.sh@478 -- # killprocess 3947100 00:19:11.780 04:16:26 -- common/autotest_common.sh@926 -- # '[' -z 3947100 ']' 00:19:11.780 04:16:26 -- common/autotest_common.sh@930 -- # kill -0 3947100 00:19:11.780 04:16:26 -- common/autotest_common.sh@931 -- # uname 00:19:11.780 04:16:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:11.780 04:16:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3947100 00:19:11.780 04:16:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:11.780 04:16:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:11.780 04:16:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3947100' 00:19:11.780 killing process with pid 3947100 00:19:11.780 04:16:26 -- common/autotest_common.sh@945 -- # kill 3947100 00:19:11.780 04:16:26 -- common/autotest_common.sh@950 -- # wait 3947100 00:19:11.780 04:16:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:11.780 04:16:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:11.780 04:16:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:11.780 04:16:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:11.780 04:16:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:11.780 04:16:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:11.780 04:16:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:11.780 04:16:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:14.328 04:16:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:14.328 00:19:14.328 real 0m28.333s 00:19:14.328 user 2m37.297s 00:19:14.328 sys 0m8.926s 00:19:14.328 04:16:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:14.328 04:16:28 -- common/autotest_common.sh@10 -- # set +x 00:19:14.328 ************************************ 00:19:14.328 END TEST nvmf_fio_target 00:19:14.328 ************************************ 00:19:14.328 04:16:28 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:14.328 04:16:28 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:14.328 04:16:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:14.328 04:16:28 -- common/autotest_common.sh@10 -- # set +x 00:19:14.328 ************************************ 00:19:14.328 START TEST nvmf_bdevio 00:19:14.328 ************************************ 00:19:14.328 04:16:28 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:14.328 * Looking for test storage... 00:19:14.328 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:14.328 04:16:28 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:14.328 04:16:28 -- nvmf/common.sh@7 -- # uname -s 00:19:14.328 04:16:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:14.328 04:16:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:14.328 04:16:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:14.328 04:16:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:14.328 04:16:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:14.328 04:16:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:14.328 04:16:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:14.328 04:16:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:14.328 04:16:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:14.328 04:16:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:14.328 04:16:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:14.328 04:16:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:14.328 04:16:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:14.328 04:16:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:14.328 04:16:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:14.328 04:16:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:14.328 04:16:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:14.328 04:16:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:14.328 04:16:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:14.328 04:16:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.328 04:16:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.328 04:16:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.328 04:16:28 -- paths/export.sh@5 -- # export PATH 00:19:14.328 04:16:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.328 04:16:28 -- nvmf/common.sh@46 -- # : 0 00:19:14.328 04:16:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:14.328 04:16:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:14.328 04:16:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:14.328 04:16:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:14.328 04:16:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:14.328 04:16:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:14.328 04:16:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:14.328 04:16:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:14.328 04:16:28 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:14.328 04:16:28 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:14.328 04:16:28 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:14.328 04:16:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:14.328 04:16:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:14.328 04:16:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:14.328 04:16:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:14.328 04:16:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:14.328 04:16:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:14.328 04:16:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:14.328 04:16:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:14.328 04:16:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:14.328 04:16:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:14.328 04:16:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:14.328 04:16:28 -- common/autotest_common.sh@10 -- # set +x 00:19:20.987 04:16:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:20.987 04:16:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:20.987 04:16:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:20.987 04:16:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:20.987 04:16:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:20.987 04:16:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:20.987 04:16:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:20.987 04:16:35 -- nvmf/common.sh@294 -- # net_devs=() 00:19:20.987 04:16:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:20.987 04:16:35 -- nvmf/common.sh@295 -- # e810=() 00:19:20.987 04:16:35 -- nvmf/common.sh@295 -- # local -ga e810 00:19:20.987 04:16:35 -- nvmf/common.sh@296 -- # x722=() 00:19:20.987 04:16:35 -- nvmf/common.sh@296 -- # local -ga x722 00:19:20.987 04:16:35 -- nvmf/common.sh@297 -- # mlx=() 00:19:20.987 04:16:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:20.987 04:16:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:20.987 04:16:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:20.987 04:16:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:20.987 04:16:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:20.987 04:16:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:20.987 04:16:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:19:20.987 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:19:20.987 04:16:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:20.987 04:16:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:19:20.987 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:19:20.987 04:16:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:20.987 04:16:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:20.987 04:16:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:20.987 04:16:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:20.987 04:16:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:20.987 04:16:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:19:20.987 Found net devices under 0000:4b:00.0: cvl_0_0 00:19:20.987 04:16:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:20.987 04:16:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:20.987 04:16:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:20.987 04:16:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:20.987 04:16:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:20.987 04:16:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:19:20.987 Found net devices under 0000:4b:00.1: cvl_0_1 00:19:20.987 04:16:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:20.987 04:16:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:20.987 04:16:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:20.987 04:16:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:20.987 04:16:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:20.987 04:16:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:20.987 04:16:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:20.987 04:16:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:20.987 04:16:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:20.987 04:16:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:20.987 04:16:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:20.987 04:16:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:20.987 04:16:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:20.988 04:16:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:20.988 04:16:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:20.988 04:16:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:20.988 04:16:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:20.988 04:16:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:20.988 04:16:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:20.988 04:16:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:20.988 04:16:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:20.988 04:16:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:20.988 04:16:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:20.988 04:16:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:21.249 04:16:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:21.249 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:21.249 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.470 ms 00:19:21.249 00:19:21.249 --- 10.0.0.2 ping statistics --- 00:19:21.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:21.249 rtt min/avg/max/mdev = 0.470/0.470/0.470/0.000 ms 00:19:21.249 04:16:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:21.249 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:21.249 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.461 ms 00:19:21.249 00:19:21.249 --- 10.0.0.1 ping statistics --- 00:19:21.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:21.249 rtt min/avg/max/mdev = 0.461/0.461/0.461/0.000 ms 00:19:21.249 04:16:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:21.249 04:16:35 -- nvmf/common.sh@410 -- # return 0 00:19:21.249 04:16:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:21.249 04:16:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:21.249 04:16:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:21.249 04:16:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:21.249 04:16:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:21.249 04:16:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:21.249 04:16:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:21.249 04:16:35 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:21.249 04:16:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:21.249 04:16:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:21.249 04:16:35 -- common/autotest_common.sh@10 -- # set +x 00:19:21.249 04:16:35 -- nvmf/common.sh@469 -- # nvmfpid=3955996 00:19:21.249 04:16:35 -- nvmf/common.sh@470 -- # waitforlisten 3955996 00:19:21.249 04:16:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:21.249 04:16:35 -- common/autotest_common.sh@819 -- # '[' -z 3955996 ']' 00:19:21.249 04:16:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:21.249 04:16:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:21.249 04:16:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:21.249 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:21.249 04:16:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:21.249 04:16:35 -- common/autotest_common.sh@10 -- # set +x 00:19:21.249 [2024-05-14 04:16:35.702711] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:21.249 [2024-05-14 04:16:35.702774] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:21.249 EAL: No free 2048 kB hugepages reported on node 1 00:19:21.249 [2024-05-14 04:16:35.791073] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:21.512 [2024-05-14 04:16:35.884523] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:21.512 [2024-05-14 04:16:35.884675] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:21.512 [2024-05-14 04:16:35.884685] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:21.512 [2024-05-14 04:16:35.884693] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:21.512 [2024-05-14 04:16:35.884863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:21.512 [2024-05-14 04:16:35.885232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:21.512 [2024-05-14 04:16:35.885393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:21.512 [2024-05-14 04:16:35.885393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:22.086 04:16:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:22.086 04:16:36 -- common/autotest_common.sh@852 -- # return 0 00:19:22.086 04:16:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:22.086 04:16:36 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:22.086 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:19:22.086 04:16:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:22.086 04:16:36 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:22.086 04:16:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:22.086 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:19:22.086 [2024-05-14 04:16:36.551731] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:22.086 04:16:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:22.086 04:16:36 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:22.086 04:16:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:22.086 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:19:22.086 Malloc0 00:19:22.086 04:16:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:22.086 04:16:36 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:22.086 04:16:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:22.086 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:19:22.086 04:16:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:22.086 04:16:36 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:22.086 04:16:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:22.086 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:19:22.086 04:16:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:22.086 04:16:36 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:22.086 04:16:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:22.086 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:19:22.086 [2024-05-14 04:16:36.617264] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:22.086 04:16:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:22.086 04:16:36 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:22.086 04:16:36 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:22.086 04:16:36 -- nvmf/common.sh@520 -- # config=() 00:19:22.086 04:16:36 -- nvmf/common.sh@520 -- # local subsystem config 00:19:22.086 04:16:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:22.086 04:16:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:22.086 { 00:19:22.086 "params": { 00:19:22.086 "name": "Nvme$subsystem", 00:19:22.086 "trtype": "$TEST_TRANSPORT", 00:19:22.086 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:22.086 "adrfam": "ipv4", 00:19:22.086 "trsvcid": "$NVMF_PORT", 00:19:22.086 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:22.086 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:22.086 "hdgst": ${hdgst:-false}, 00:19:22.086 "ddgst": ${ddgst:-false} 00:19:22.086 }, 00:19:22.086 "method": "bdev_nvme_attach_controller" 00:19:22.086 } 00:19:22.086 EOF 00:19:22.086 )") 00:19:22.086 04:16:36 -- nvmf/common.sh@542 -- # cat 00:19:22.086 04:16:36 -- nvmf/common.sh@544 -- # jq . 00:19:22.086 04:16:36 -- nvmf/common.sh@545 -- # IFS=, 00:19:22.086 04:16:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:22.086 "params": { 00:19:22.086 "name": "Nvme1", 00:19:22.086 "trtype": "tcp", 00:19:22.086 "traddr": "10.0.0.2", 00:19:22.086 "adrfam": "ipv4", 00:19:22.086 "trsvcid": "4420", 00:19:22.086 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:22.086 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:22.086 "hdgst": false, 00:19:22.086 "ddgst": false 00:19:22.086 }, 00:19:22.086 "method": "bdev_nvme_attach_controller" 00:19:22.086 }' 00:19:22.086 [2024-05-14 04:16:36.668346] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:22.086 [2024-05-14 04:16:36.668410] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3956039 ] 00:19:22.348 EAL: No free 2048 kB hugepages reported on node 1 00:19:22.348 [2024-05-14 04:16:36.734152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:22.348 [2024-05-14 04:16:36.808966] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:22.348 [2024-05-14 04:16:36.809092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:22.348 [2024-05-14 04:16:36.809095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:22.610 [2024-05-14 04:16:37.069375] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:22.610 [2024-05-14 04:16:37.069408] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:22.610 I/O targets: 00:19:22.610 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:22.610 00:19:22.610 00:19:22.610 CUnit - A unit testing framework for C - Version 2.1-3 00:19:22.610 http://cunit.sourceforge.net/ 00:19:22.610 00:19:22.610 00:19:22.610 Suite: bdevio tests on: Nvme1n1 00:19:22.610 Test: blockdev write read block ...passed 00:19:22.610 Test: blockdev write zeroes read block ...passed 00:19:22.610 Test: blockdev write zeroes read no split ...passed 00:19:22.871 Test: blockdev write zeroes read split ...passed 00:19:22.871 Test: blockdev write zeroes read split partial ...passed 00:19:22.871 Test: blockdev reset ...[2024-05-14 04:16:37.225626] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:22.871 [2024-05-14 04:16:37.225688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16034e0 (9): Bad file descriptor 00:19:22.871 [2024-05-14 04:16:37.237722] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:22.871 passed 00:19:22.871 Test: blockdev write read 8 blocks ...passed 00:19:22.871 Test: blockdev write read size > 128k ...passed 00:19:22.871 Test: blockdev write read invalid size ...passed 00:19:22.871 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:22.871 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:22.871 Test: blockdev write read max offset ...passed 00:19:22.871 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:22.871 Test: blockdev writev readv 8 blocks ...passed 00:19:23.133 Test: blockdev writev readv 30 x 1block ...passed 00:19:23.133 Test: blockdev writev readv block ...passed 00:19:23.133 Test: blockdev writev readv size > 128k ...passed 00:19:23.133 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:23.133 Test: blockdev comparev and writev ...[2024-05-14 04:16:37.555850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:23.133 [2024-05-14 04:16:37.555876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.555887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:23.133 [2024-05-14 04:16:37.555893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.556559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:23.133 [2024-05-14 04:16:37.556571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.556580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:23.133 [2024-05-14 04:16:37.556585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.557145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:23.133 [2024-05-14 04:16:37.557152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.557161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:23.133 [2024-05-14 04:16:37.557166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.557841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:23.133 [2024-05-14 04:16:37.557849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.557858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:23.133 [2024-05-14 04:16:37.557863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:23.133 passed 00:19:23.133 Test: blockdev nvme passthru rw ...passed 00:19:23.133 Test: blockdev nvme passthru vendor specific ...[2024-05-14 04:16:37.642486] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:23.133 [2024-05-14 04:16:37.642497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.643004] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:23.133 [2024-05-14 04:16:37.643011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.643507] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:23.133 [2024-05-14 04:16:37.643514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:23.133 [2024-05-14 04:16:37.644018] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:23.133 [2024-05-14 04:16:37.644024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:23.133 passed 00:19:23.133 Test: blockdev nvme admin passthru ...passed 00:19:23.133 Test: blockdev copy ...passed 00:19:23.133 00:19:23.133 Run Summary: Type Total Ran Passed Failed Inactive 00:19:23.133 suites 1 1 n/a 0 0 00:19:23.133 tests 23 23 23 0 0 00:19:23.133 asserts 152 152 152 0 n/a 00:19:23.133 00:19:23.133 Elapsed time = 1.266 seconds 00:19:23.395 04:16:37 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:23.395 04:16:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:23.395 04:16:37 -- common/autotest_common.sh@10 -- # set +x 00:19:23.395 04:16:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:23.395 04:16:37 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:23.395 04:16:37 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:23.395 04:16:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:23.395 04:16:37 -- nvmf/common.sh@116 -- # sync 00:19:23.395 04:16:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:23.395 04:16:37 -- nvmf/common.sh@119 -- # set +e 00:19:23.395 04:16:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:23.395 04:16:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:23.395 rmmod nvme_tcp 00:19:23.395 rmmod nvme_fabrics 00:19:23.395 rmmod nvme_keyring 00:19:23.395 04:16:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:23.395 04:16:37 -- nvmf/common.sh@123 -- # set -e 00:19:23.395 04:16:37 -- nvmf/common.sh@124 -- # return 0 00:19:23.395 04:16:37 -- nvmf/common.sh@477 -- # '[' -n 3955996 ']' 00:19:23.395 04:16:37 -- nvmf/common.sh@478 -- # killprocess 3955996 00:19:23.395 04:16:37 -- common/autotest_common.sh@926 -- # '[' -z 3955996 ']' 00:19:23.395 04:16:37 -- common/autotest_common.sh@930 -- # kill -0 3955996 00:19:23.395 04:16:37 -- common/autotest_common.sh@931 -- # uname 00:19:23.395 04:16:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:23.396 04:16:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3955996 00:19:23.396 04:16:37 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:19:23.396 04:16:37 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:19:23.396 04:16:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3955996' 00:19:23.396 killing process with pid 3955996 00:19:23.396 04:16:37 -- common/autotest_common.sh@945 -- # kill 3955996 00:19:23.396 04:16:37 -- common/autotest_common.sh@950 -- # wait 3955996 00:19:23.657 04:16:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:23.657 04:16:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:23.657 04:16:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:23.657 04:16:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:23.657 04:16:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:23.657 04:16:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:23.657 04:16:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:23.657 04:16:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:26.211 04:16:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:26.211 00:19:26.211 real 0m11.759s 00:19:26.211 user 0m13.350s 00:19:26.211 sys 0m5.765s 00:19:26.211 04:16:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:26.211 04:16:40 -- common/autotest_common.sh@10 -- # set +x 00:19:26.211 ************************************ 00:19:26.211 END TEST nvmf_bdevio 00:19:26.211 ************************************ 00:19:26.211 04:16:40 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:26.211 04:16:40 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:26.211 04:16:40 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:19:26.211 04:16:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:26.211 04:16:40 -- common/autotest_common.sh@10 -- # set +x 00:19:26.211 ************************************ 00:19:26.211 START TEST nvmf_bdevio_no_huge 00:19:26.211 ************************************ 00:19:26.211 04:16:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:26.211 * Looking for test storage... 00:19:26.211 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:26.211 04:16:40 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:26.211 04:16:40 -- nvmf/common.sh@7 -- # uname -s 00:19:26.211 04:16:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:26.211 04:16:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:26.211 04:16:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:26.211 04:16:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:26.211 04:16:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:26.211 04:16:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:26.211 04:16:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:26.211 04:16:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:26.211 04:16:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:26.211 04:16:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:26.211 04:16:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:26.211 04:16:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:26.211 04:16:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:26.211 04:16:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:26.211 04:16:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:26.211 04:16:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:26.211 04:16:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:26.211 04:16:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:26.211 04:16:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:26.211 04:16:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.211 04:16:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.211 04:16:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.211 04:16:40 -- paths/export.sh@5 -- # export PATH 00:19:26.211 04:16:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.211 04:16:40 -- nvmf/common.sh@46 -- # : 0 00:19:26.211 04:16:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:26.211 04:16:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:26.211 04:16:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:26.211 04:16:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:26.211 04:16:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:26.211 04:16:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:26.211 04:16:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:26.211 04:16:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:26.211 04:16:40 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:26.211 04:16:40 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:26.211 04:16:40 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:26.211 04:16:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:26.211 04:16:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:26.212 04:16:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:26.212 04:16:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:26.212 04:16:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:26.212 04:16:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:26.212 04:16:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:26.212 04:16:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:26.212 04:16:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:26.212 04:16:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:26.212 04:16:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:26.212 04:16:40 -- common/autotest_common.sh@10 -- # set +x 00:19:32.806 04:16:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:32.806 04:16:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:32.806 04:16:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:32.806 04:16:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:32.806 04:16:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:32.806 04:16:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:32.806 04:16:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:32.806 04:16:47 -- nvmf/common.sh@294 -- # net_devs=() 00:19:32.806 04:16:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:32.806 04:16:47 -- nvmf/common.sh@295 -- # e810=() 00:19:32.806 04:16:47 -- nvmf/common.sh@295 -- # local -ga e810 00:19:32.806 04:16:47 -- nvmf/common.sh@296 -- # x722=() 00:19:32.806 04:16:47 -- nvmf/common.sh@296 -- # local -ga x722 00:19:32.806 04:16:47 -- nvmf/common.sh@297 -- # mlx=() 00:19:32.806 04:16:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:32.806 04:16:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:32.806 04:16:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:32.806 04:16:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:32.806 04:16:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:32.806 04:16:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:32.806 04:16:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:19:32.806 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:19:32.806 04:16:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:32.806 04:16:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:19:32.806 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:19:32.806 04:16:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:32.806 04:16:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:32.806 04:16:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:32.806 04:16:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:32.806 04:16:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:32.806 04:16:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:19:32.806 Found net devices under 0000:4b:00.0: cvl_0_0 00:19:32.806 04:16:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:32.806 04:16:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:32.806 04:16:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:32.806 04:16:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:32.806 04:16:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:32.806 04:16:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:19:32.806 Found net devices under 0000:4b:00.1: cvl_0_1 00:19:32.806 04:16:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:32.806 04:16:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:32.806 04:16:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:32.806 04:16:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:32.806 04:16:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:32.806 04:16:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:32.806 04:16:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:32.806 04:16:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:32.806 04:16:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:32.806 04:16:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:32.806 04:16:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:32.806 04:16:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:32.806 04:16:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:32.806 04:16:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:32.806 04:16:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:32.806 04:16:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:32.806 04:16:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:32.806 04:16:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:32.807 04:16:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:32.807 04:16:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:32.807 04:16:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:32.807 04:16:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:33.069 04:16:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:33.069 04:16:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:33.069 04:16:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:33.069 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:33.069 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.550 ms 00:19:33.069 00:19:33.069 --- 10.0.0.2 ping statistics --- 00:19:33.069 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:33.069 rtt min/avg/max/mdev = 0.550/0.550/0.550/0.000 ms 00:19:33.069 04:16:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:33.069 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:33.069 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.478 ms 00:19:33.069 00:19:33.069 --- 10.0.0.1 ping statistics --- 00:19:33.069 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:33.069 rtt min/avg/max/mdev = 0.478/0.478/0.478/0.000 ms 00:19:33.069 04:16:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:33.069 04:16:47 -- nvmf/common.sh@410 -- # return 0 00:19:33.069 04:16:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:33.069 04:16:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:33.069 04:16:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:33.069 04:16:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:33.069 04:16:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:33.069 04:16:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:33.069 04:16:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:33.069 04:16:47 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:33.069 04:16:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:33.069 04:16:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:33.069 04:16:47 -- common/autotest_common.sh@10 -- # set +x 00:19:33.069 04:16:47 -- nvmf/common.sh@469 -- # nvmfpid=3960463 00:19:33.069 04:16:47 -- nvmf/common.sh@470 -- # waitforlisten 3960463 00:19:33.069 04:16:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:33.069 04:16:47 -- common/autotest_common.sh@819 -- # '[' -z 3960463 ']' 00:19:33.069 04:16:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:33.069 04:16:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:33.069 04:16:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:33.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:33.069 04:16:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:33.069 04:16:47 -- common/autotest_common.sh@10 -- # set +x 00:19:33.069 [2024-05-14 04:16:47.598570] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:33.069 [2024-05-14 04:16:47.598640] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:33.331 [2024-05-14 04:16:47.694830] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:33.331 [2024-05-14 04:16:47.799951] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:33.331 [2024-05-14 04:16:47.800110] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:33.331 [2024-05-14 04:16:47.800121] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:33.331 [2024-05-14 04:16:47.800129] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:33.331 [2024-05-14 04:16:47.800345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:33.331 [2024-05-14 04:16:47.800688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:33.331 [2024-05-14 04:16:47.800901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:33.331 [2024-05-14 04:16:47.800905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:33.903 04:16:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:33.903 04:16:48 -- common/autotest_common.sh@852 -- # return 0 00:19:33.903 04:16:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:33.903 04:16:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:33.903 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:19:33.903 04:16:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:33.903 04:16:48 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:33.903 04:16:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:33.903 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:19:33.903 [2024-05-14 04:16:48.445453] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:33.903 04:16:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:33.903 04:16:48 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:33.903 04:16:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:33.903 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:19:33.903 Malloc0 00:19:33.903 04:16:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:33.903 04:16:48 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:33.903 04:16:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:33.903 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:19:33.903 04:16:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:33.903 04:16:48 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:33.903 04:16:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:33.903 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:19:34.165 04:16:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:34.165 04:16:48 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:34.165 04:16:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:34.165 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:19:34.165 [2024-05-14 04:16:48.499412] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:34.166 04:16:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:34.166 04:16:48 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:34.166 04:16:48 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:34.166 04:16:48 -- nvmf/common.sh@520 -- # config=() 00:19:34.166 04:16:48 -- nvmf/common.sh@520 -- # local subsystem config 00:19:34.166 04:16:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:34.166 04:16:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:34.166 { 00:19:34.166 "params": { 00:19:34.166 "name": "Nvme$subsystem", 00:19:34.166 "trtype": "$TEST_TRANSPORT", 00:19:34.166 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:34.166 "adrfam": "ipv4", 00:19:34.166 "trsvcid": "$NVMF_PORT", 00:19:34.166 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:34.166 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:34.166 "hdgst": ${hdgst:-false}, 00:19:34.166 "ddgst": ${ddgst:-false} 00:19:34.166 }, 00:19:34.166 "method": "bdev_nvme_attach_controller" 00:19:34.166 } 00:19:34.166 EOF 00:19:34.166 )") 00:19:34.166 04:16:48 -- nvmf/common.sh@542 -- # cat 00:19:34.166 04:16:48 -- nvmf/common.sh@544 -- # jq . 00:19:34.166 04:16:48 -- nvmf/common.sh@545 -- # IFS=, 00:19:34.166 04:16:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:34.166 "params": { 00:19:34.166 "name": "Nvme1", 00:19:34.166 "trtype": "tcp", 00:19:34.166 "traddr": "10.0.0.2", 00:19:34.166 "adrfam": "ipv4", 00:19:34.166 "trsvcid": "4420", 00:19:34.166 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:34.166 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:34.166 "hdgst": false, 00:19:34.166 "ddgst": false 00:19:34.166 }, 00:19:34.166 "method": "bdev_nvme_attach_controller" 00:19:34.166 }' 00:19:34.166 [2024-05-14 04:16:48.550851] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:34.166 [2024-05-14 04:16:48.550924] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3960737 ] 00:19:34.166 [2024-05-14 04:16:48.621270] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:34.166 [2024-05-14 04:16:48.716858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:34.166 [2024-05-14 04:16:48.716975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:34.166 [2024-05-14 04:16:48.716978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:34.427 [2024-05-14 04:16:48.902297] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:34.427 [2024-05-14 04:16:48.902323] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:34.427 I/O targets: 00:19:34.427 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:34.427 00:19:34.427 00:19:34.427 CUnit - A unit testing framework for C - Version 2.1-3 00:19:34.427 http://cunit.sourceforge.net/ 00:19:34.427 00:19:34.427 00:19:34.427 Suite: bdevio tests on: Nvme1n1 00:19:34.427 Test: blockdev write read block ...passed 00:19:34.427 Test: blockdev write zeroes read block ...passed 00:19:34.427 Test: blockdev write zeroes read no split ...passed 00:19:34.688 Test: blockdev write zeroes read split ...passed 00:19:34.688 Test: blockdev write zeroes read split partial ...passed 00:19:34.688 Test: blockdev reset ...[2024-05-14 04:16:49.070822] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:34.688 [2024-05-14 04:16:49.070883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ef1b60 (9): Bad file descriptor 00:19:34.688 [2024-05-14 04:16:49.088563] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:34.688 passed 00:19:34.688 Test: blockdev write read 8 blocks ...passed 00:19:34.688 Test: blockdev write read size > 128k ...passed 00:19:34.688 Test: blockdev write read invalid size ...passed 00:19:34.688 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:34.688 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:34.688 Test: blockdev write read max offset ...passed 00:19:34.688 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:34.688 Test: blockdev writev readv 8 blocks ...passed 00:19:34.949 Test: blockdev writev readv 30 x 1block ...passed 00:19:34.949 Test: blockdev writev readv block ...passed 00:19:34.949 Test: blockdev writev readv size > 128k ...passed 00:19:34.949 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:34.949 Test: blockdev comparev and writev ...[2024-05-14 04:16:49.365207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:34.949 [2024-05-14 04:16:49.365232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:34.949 [2024-05-14 04:16:49.365243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:34.949 [2024-05-14 04:16:49.365249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:34.949 [2024-05-14 04:16:49.365936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:34.949 [2024-05-14 04:16:49.365944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:34.949 [2024-05-14 04:16:49.365954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:34.949 [2024-05-14 04:16:49.365959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:34.949 [2024-05-14 04:16:49.366594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:34.949 [2024-05-14 04:16:49.366602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:34.949 [2024-05-14 04:16:49.366612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:34.950 [2024-05-14 04:16:49.366617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:34.950 [2024-05-14 04:16:49.367254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:34.950 [2024-05-14 04:16:49.367261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:34.950 [2024-05-14 04:16:49.367270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:34.950 [2024-05-14 04:16:49.367275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:34.950 passed 00:19:34.950 Test: blockdev nvme passthru rw ...passed 00:19:34.950 Test: blockdev nvme passthru vendor specific ...[2024-05-14 04:16:49.452544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:34.950 [2024-05-14 04:16:49.452553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:34.950 [2024-05-14 04:16:49.453053] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:34.950 [2024-05-14 04:16:49.453059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:34.950 [2024-05-14 04:16:49.453598] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:34.950 [2024-05-14 04:16:49.453605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:34.950 [2024-05-14 04:16:49.454105] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:34.950 [2024-05-14 04:16:49.454112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:34.950 passed 00:19:34.950 Test: blockdev nvme admin passthru ...passed 00:19:34.950 Test: blockdev copy ...passed 00:19:34.950 00:19:34.950 Run Summary: Type Total Ran Passed Failed Inactive 00:19:34.950 suites 1 1 n/a 0 0 00:19:34.950 tests 23 23 23 0 0 00:19:34.950 asserts 152 152 152 0 n/a 00:19:34.950 00:19:34.950 Elapsed time = 1.233 seconds 00:19:35.211 04:16:49 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:35.211 04:16:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:35.211 04:16:49 -- common/autotest_common.sh@10 -- # set +x 00:19:35.211 04:16:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:35.211 04:16:49 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:35.211 04:16:49 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:35.211 04:16:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:35.211 04:16:49 -- nvmf/common.sh@116 -- # sync 00:19:35.211 04:16:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:35.211 04:16:49 -- nvmf/common.sh@119 -- # set +e 00:19:35.211 04:16:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:35.211 04:16:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:35.211 rmmod nvme_tcp 00:19:35.472 rmmod nvme_fabrics 00:19:35.472 rmmod nvme_keyring 00:19:35.472 04:16:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:35.472 04:16:49 -- nvmf/common.sh@123 -- # set -e 00:19:35.472 04:16:49 -- nvmf/common.sh@124 -- # return 0 00:19:35.472 04:16:49 -- nvmf/common.sh@477 -- # '[' -n 3960463 ']' 00:19:35.472 04:16:49 -- nvmf/common.sh@478 -- # killprocess 3960463 00:19:35.472 04:16:49 -- common/autotest_common.sh@926 -- # '[' -z 3960463 ']' 00:19:35.472 04:16:49 -- common/autotest_common.sh@930 -- # kill -0 3960463 00:19:35.472 04:16:49 -- common/autotest_common.sh@931 -- # uname 00:19:35.472 04:16:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:35.472 04:16:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3960463 00:19:35.472 04:16:49 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:19:35.472 04:16:49 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:19:35.472 04:16:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3960463' 00:19:35.472 killing process with pid 3960463 00:19:35.472 04:16:49 -- common/autotest_common.sh@945 -- # kill 3960463 00:19:35.472 04:16:49 -- common/autotest_common.sh@950 -- # wait 3960463 00:19:35.734 04:16:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:35.734 04:16:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:35.734 04:16:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:35.734 04:16:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:35.734 04:16:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:35.734 04:16:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:35.734 04:16:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:35.734 04:16:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:38.281 04:16:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:38.281 00:19:38.281 real 0m12.026s 00:19:38.281 user 0m13.633s 00:19:38.281 sys 0m6.209s 00:19:38.281 04:16:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:38.281 04:16:52 -- common/autotest_common.sh@10 -- # set +x 00:19:38.281 ************************************ 00:19:38.281 END TEST nvmf_bdevio_no_huge 00:19:38.281 ************************************ 00:19:38.281 04:16:52 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:38.281 04:16:52 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:38.281 04:16:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:38.281 04:16:52 -- common/autotest_common.sh@10 -- # set +x 00:19:38.281 ************************************ 00:19:38.281 START TEST nvmf_tls 00:19:38.281 ************************************ 00:19:38.281 04:16:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:38.281 * Looking for test storage... 00:19:38.281 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:38.281 04:16:52 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:38.281 04:16:52 -- nvmf/common.sh@7 -- # uname -s 00:19:38.281 04:16:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:38.281 04:16:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:38.281 04:16:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:38.281 04:16:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:38.281 04:16:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:38.281 04:16:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:38.281 04:16:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:38.281 04:16:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:38.281 04:16:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:38.281 04:16:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:38.281 04:16:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:38.281 04:16:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:38.281 04:16:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:38.281 04:16:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:38.281 04:16:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:38.281 04:16:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:38.281 04:16:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:38.281 04:16:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:38.281 04:16:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:38.281 04:16:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.281 04:16:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.282 04:16:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.282 04:16:52 -- paths/export.sh@5 -- # export PATH 00:19:38.282 04:16:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:38.282 04:16:52 -- nvmf/common.sh@46 -- # : 0 00:19:38.282 04:16:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:38.282 04:16:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:38.282 04:16:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:38.282 04:16:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:38.282 04:16:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:38.282 04:16:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:38.282 04:16:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:38.282 04:16:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:38.282 04:16:52 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:38.282 04:16:52 -- target/tls.sh@71 -- # nvmftestinit 00:19:38.282 04:16:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:38.282 04:16:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:38.282 04:16:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:38.282 04:16:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:38.282 04:16:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:38.282 04:16:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:38.282 04:16:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:38.282 04:16:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:38.282 04:16:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:38.282 04:16:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:38.282 04:16:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:38.282 04:16:52 -- common/autotest_common.sh@10 -- # set +x 00:19:44.876 04:16:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:44.876 04:16:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:44.876 04:16:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:44.876 04:16:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:44.876 04:16:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:44.876 04:16:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:44.876 04:16:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:44.876 04:16:59 -- nvmf/common.sh@294 -- # net_devs=() 00:19:44.876 04:16:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:44.876 04:16:59 -- nvmf/common.sh@295 -- # e810=() 00:19:44.876 04:16:59 -- nvmf/common.sh@295 -- # local -ga e810 00:19:44.876 04:16:59 -- nvmf/common.sh@296 -- # x722=() 00:19:44.876 04:16:59 -- nvmf/common.sh@296 -- # local -ga x722 00:19:44.876 04:16:59 -- nvmf/common.sh@297 -- # mlx=() 00:19:44.876 04:16:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:44.876 04:16:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:44.876 04:16:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:44.876 04:16:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:44.876 04:16:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:44.876 04:16:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:44.876 04:16:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:44.876 04:16:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:44.876 04:16:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:44.876 04:16:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:19:44.876 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:19:44.876 04:16:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:44.876 04:16:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:44.876 04:16:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:44.876 04:16:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:44.877 04:16:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:19:44.877 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:19:44.877 04:16:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:44.877 04:16:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:44.877 04:16:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:44.877 04:16:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:44.877 04:16:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:44.877 04:16:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:19:44.877 Found net devices under 0000:4b:00.0: cvl_0_0 00:19:44.877 04:16:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:44.877 04:16:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:44.877 04:16:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:44.877 04:16:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:44.877 04:16:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:44.877 04:16:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:19:44.877 Found net devices under 0000:4b:00.1: cvl_0_1 00:19:44.877 04:16:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:44.877 04:16:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:44.877 04:16:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:44.877 04:16:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:44.877 04:16:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:44.877 04:16:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:44.877 04:16:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:44.877 04:16:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:44.877 04:16:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:44.877 04:16:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:44.877 04:16:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:44.877 04:16:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:44.877 04:16:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:44.877 04:16:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:44.877 04:16:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:44.877 04:16:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:44.877 04:16:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:44.877 04:16:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:45.137 04:16:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:45.137 04:16:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:45.137 04:16:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:45.137 04:16:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:45.137 04:16:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:45.137 04:16:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:45.137 04:16:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:45.137 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:45.137 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.567 ms 00:19:45.137 00:19:45.137 --- 10.0.0.2 ping statistics --- 00:19:45.137 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:45.137 rtt min/avg/max/mdev = 0.567/0.567/0.567/0.000 ms 00:19:45.137 04:16:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:45.137 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:45.137 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.588 ms 00:19:45.137 00:19:45.137 --- 10.0.0.1 ping statistics --- 00:19:45.137 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:45.137 rtt min/avg/max/mdev = 0.588/0.588/0.588/0.000 ms 00:19:45.137 04:16:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:45.137 04:16:59 -- nvmf/common.sh@410 -- # return 0 00:19:45.137 04:16:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:45.137 04:16:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:45.137 04:16:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:45.137 04:16:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:45.137 04:16:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:45.137 04:16:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:45.137 04:16:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:45.399 04:16:59 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:45.399 04:16:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:45.399 04:16:59 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:45.399 04:16:59 -- common/autotest_common.sh@10 -- # set +x 00:19:45.399 04:16:59 -- nvmf/common.sh@469 -- # nvmfpid=3965113 00:19:45.399 04:16:59 -- nvmf/common.sh@470 -- # waitforlisten 3965113 00:19:45.399 04:16:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:45.399 04:16:59 -- common/autotest_common.sh@819 -- # '[' -z 3965113 ']' 00:19:45.399 04:16:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:45.399 04:16:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:45.399 04:16:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:45.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:45.399 04:16:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:45.399 04:16:59 -- common/autotest_common.sh@10 -- # set +x 00:19:45.399 [2024-05-14 04:16:59.822053] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:45.399 [2024-05-14 04:16:59.822117] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:45.399 EAL: No free 2048 kB hugepages reported on node 1 00:19:45.399 [2024-05-14 04:16:59.910566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:45.660 [2024-05-14 04:17:00.000674] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:45.660 [2024-05-14 04:17:00.000826] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:45.660 [2024-05-14 04:17:00.000836] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:45.660 [2024-05-14 04:17:00.000844] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:45.660 [2024-05-14 04:17:00.000878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:46.232 04:17:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:46.232 04:17:00 -- common/autotest_common.sh@852 -- # return 0 00:19:46.232 04:17:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:46.232 04:17:00 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:46.232 04:17:00 -- common/autotest_common.sh@10 -- # set +x 00:19:46.232 04:17:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:46.232 04:17:00 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:19:46.232 04:17:00 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:46.232 true 00:19:46.530 04:17:00 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:46.530 04:17:00 -- target/tls.sh@82 -- # jq -r .tls_version 00:19:46.530 04:17:00 -- target/tls.sh@82 -- # version=0 00:19:46.530 04:17:00 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:19:46.530 04:17:00 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:46.791 04:17:01 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:46.791 04:17:01 -- target/tls.sh@90 -- # jq -r .tls_version 00:19:46.791 04:17:01 -- target/tls.sh@90 -- # version=13 00:19:46.791 04:17:01 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:19:46.791 04:17:01 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:47.052 04:17:01 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:47.052 04:17:01 -- target/tls.sh@98 -- # jq -r .tls_version 00:19:47.314 04:17:01 -- target/tls.sh@98 -- # version=7 00:19:47.314 04:17:01 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:19:47.314 04:17:01 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:47.314 04:17:01 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:47.314 04:17:01 -- target/tls.sh@105 -- # ktls=false 00:19:47.314 04:17:01 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:19:47.314 04:17:01 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:47.576 04:17:02 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:47.576 04:17:02 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:47.837 04:17:02 -- target/tls.sh@113 -- # ktls=true 00:19:47.837 04:17:02 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:19:47.837 04:17:02 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:47.837 04:17:02 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:47.837 04:17:02 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:19:48.098 04:17:02 -- target/tls.sh@121 -- # ktls=false 00:19:48.098 04:17:02 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:19:48.098 04:17:02 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:19:48.098 04:17:02 -- target/tls.sh@49 -- # local key hash crc 00:19:48.098 04:17:02 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:19:48.098 04:17:02 -- target/tls.sh@51 -- # hash=01 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # gzip -1 -c 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # tail -c8 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # head -c 4 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # crc='p$H�' 00:19:48.098 04:17:02 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:48.098 04:17:02 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:19:48.098 04:17:02 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:48.098 04:17:02 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:48.098 04:17:02 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:19:48.098 04:17:02 -- target/tls.sh@49 -- # local key hash crc 00:19:48.098 04:17:02 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:19:48.098 04:17:02 -- target/tls.sh@51 -- # hash=01 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # gzip -1 -c 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # tail -c8 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # head -c 4 00:19:48.098 04:17:02 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:19:48.098 04:17:02 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:48.098 04:17:02 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:19:48.098 04:17:02 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:48.098 04:17:02 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:48.098 04:17:02 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:48.098 04:17:02 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:48.098 04:17:02 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:48.098 04:17:02 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:48.098 04:17:02 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:48.098 04:17:02 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:48.098 04:17:02 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:48.360 04:17:02 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:19:48.360 04:17:02 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:48.360 04:17:02 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:48.360 04:17:02 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:48.621 [2024-05-14 04:17:03.052958] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:48.621 04:17:03 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:48.881 04:17:03 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:48.881 [2024-05-14 04:17:03.357705] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:48.881 [2024-05-14 04:17:03.357874] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:48.881 04:17:03 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:49.149 malloc0 00:19:49.149 04:17:03 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:49.149 04:17:03 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:49.415 04:17:03 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:49.415 EAL: No free 2048 kB hugepages reported on node 1 00:19:59.421 Initializing NVMe Controllers 00:19:59.421 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:59.421 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:59.421 Initialization complete. Launching workers. 00:19:59.421 ======================================================== 00:19:59.421 Latency(us) 00:19:59.421 Device Information : IOPS MiB/s Average min max 00:19:59.421 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 19729.39 77.07 3243.85 1158.43 3926.05 00:19:59.421 ======================================================== 00:19:59.421 Total : 19729.39 77.07 3243.85 1158.43 3926.05 00:19:59.421 00:19:59.422 04:17:13 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:59.422 04:17:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:59.422 04:17:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:59.422 04:17:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:59.422 04:17:13 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:19:59.422 04:17:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:59.422 04:17:13 -- target/tls.sh@28 -- # bdevperf_pid=3967967 00:19:59.422 04:17:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:59.422 04:17:13 -- target/tls.sh@31 -- # waitforlisten 3967967 /var/tmp/bdevperf.sock 00:19:59.422 04:17:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:59.422 04:17:13 -- common/autotest_common.sh@819 -- # '[' -z 3967967 ']' 00:19:59.422 04:17:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:59.422 04:17:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:59.422 04:17:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:59.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:59.422 04:17:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:59.422 04:17:13 -- common/autotest_common.sh@10 -- # set +x 00:19:59.422 [2024-05-14 04:17:13.955542] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:59.422 [2024-05-14 04:17:13.955602] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3967967 ] 00:19:59.422 EAL: No free 2048 kB hugepages reported on node 1 00:19:59.422 [2024-05-14 04:17:14.006365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:59.682 [2024-05-14 04:17:14.056833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:00.255 04:17:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:00.255 04:17:14 -- common/autotest_common.sh@852 -- # return 0 00:20:00.255 04:17:14 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:00.515 [2024-05-14 04:17:14.869926] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:00.515 TLSTESTn1 00:20:00.515 04:17:14 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:00.515 Running I/O for 10 seconds... 00:20:12.755 00:20:12.755 Latency(us) 00:20:12.755 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:12.755 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:12.755 Verification LBA range: start 0x0 length 0x2000 00:20:12.755 TLSTESTn1 : 10.06 1441.35 5.63 0.00 0.00 88617.85 4287.15 87381.33 00:20:12.755 =================================================================================================================== 00:20:12.755 Total : 1441.35 5.63 0.00 0.00 88617.85 4287.15 87381.33 00:20:12.755 0 00:20:12.755 04:17:25 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:12.755 04:17:25 -- target/tls.sh@45 -- # killprocess 3967967 00:20:12.755 04:17:25 -- common/autotest_common.sh@926 -- # '[' -z 3967967 ']' 00:20:12.755 04:17:25 -- common/autotest_common.sh@930 -- # kill -0 3967967 00:20:12.755 04:17:25 -- common/autotest_common.sh@931 -- # uname 00:20:12.755 04:17:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:12.755 04:17:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3967967 00:20:12.755 04:17:25 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:12.755 04:17:25 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:12.755 04:17:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3967967' 00:20:12.755 killing process with pid 3967967 00:20:12.755 04:17:25 -- common/autotest_common.sh@945 -- # kill 3967967 00:20:12.755 Received shutdown signal, test time was about 10.000000 seconds 00:20:12.755 00:20:12.755 Latency(us) 00:20:12.755 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:12.755 =================================================================================================================== 00:20:12.755 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:12.755 04:17:25 -- common/autotest_common.sh@950 -- # wait 3967967 00:20:12.755 04:17:25 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:12.755 04:17:25 -- common/autotest_common.sh@640 -- # local es=0 00:20:12.755 04:17:25 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:12.755 04:17:25 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:12.755 04:17:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:12.755 04:17:25 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:12.755 04:17:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:12.755 04:17:25 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:12.755 04:17:25 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:12.755 04:17:25 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:12.755 04:17:25 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:12.755 04:17:25 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:12.755 04:17:25 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:12.755 04:17:25 -- target/tls.sh@28 -- # bdevperf_pid=3970239 00:20:12.755 04:17:25 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:12.755 04:17:25 -- target/tls.sh@31 -- # waitforlisten 3970239 /var/tmp/bdevperf.sock 00:20:12.755 04:17:25 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:12.755 04:17:25 -- common/autotest_common.sh@819 -- # '[' -z 3970239 ']' 00:20:12.755 04:17:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:12.755 04:17:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:12.755 04:17:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:12.755 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:12.755 04:17:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:12.755 04:17:25 -- common/autotest_common.sh@10 -- # set +x 00:20:12.755 [2024-05-14 04:17:25.395849] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:12.755 [2024-05-14 04:17:25.395911] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3970239 ] 00:20:12.755 EAL: No free 2048 kB hugepages reported on node 1 00:20:12.755 [2024-05-14 04:17:25.446160] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:12.755 [2024-05-14 04:17:25.496029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:12.755 04:17:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:12.755 04:17:26 -- common/autotest_common.sh@852 -- # return 0 00:20:12.755 04:17:26 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:12.755 [2024-05-14 04:17:26.301330] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:12.755 [2024-05-14 04:17:26.305992] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:12.756 [2024-05-14 04:17:26.306620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x701e10 (107): Transport endpoint is not connected 00:20:12.756 [2024-05-14 04:17:26.307614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x701e10 (9): Bad file descriptor 00:20:12.756 [2024-05-14 04:17:26.308616] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:12.756 [2024-05-14 04:17:26.308623] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:12.756 [2024-05-14 04:17:26.308630] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:12.756 request: 00:20:12.756 { 00:20:12.756 "name": "TLSTEST", 00:20:12.756 "trtype": "tcp", 00:20:12.756 "traddr": "10.0.0.2", 00:20:12.756 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:12.756 "adrfam": "ipv4", 00:20:12.756 "trsvcid": "4420", 00:20:12.756 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:12.756 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:12.756 "method": "bdev_nvme_attach_controller", 00:20:12.756 "req_id": 1 00:20:12.756 } 00:20:12.756 Got JSON-RPC error response 00:20:12.756 response: 00:20:12.756 { 00:20:12.756 "code": -32602, 00:20:12.756 "message": "Invalid parameters" 00:20:12.756 } 00:20:12.756 04:17:26 -- target/tls.sh@36 -- # killprocess 3970239 00:20:12.756 04:17:26 -- common/autotest_common.sh@926 -- # '[' -z 3970239 ']' 00:20:12.756 04:17:26 -- common/autotest_common.sh@930 -- # kill -0 3970239 00:20:12.756 04:17:26 -- common/autotest_common.sh@931 -- # uname 00:20:12.756 04:17:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:12.756 04:17:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3970239 00:20:12.756 04:17:26 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:12.756 04:17:26 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:12.756 04:17:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3970239' 00:20:12.756 killing process with pid 3970239 00:20:12.756 04:17:26 -- common/autotest_common.sh@945 -- # kill 3970239 00:20:12.756 Received shutdown signal, test time was about 10.000000 seconds 00:20:12.756 00:20:12.756 Latency(us) 00:20:12.756 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:12.756 =================================================================================================================== 00:20:12.756 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:12.756 04:17:26 -- common/autotest_common.sh@950 -- # wait 3970239 00:20:12.756 04:17:26 -- target/tls.sh@37 -- # return 1 00:20:12.756 04:17:26 -- common/autotest_common.sh@643 -- # es=1 00:20:12.756 04:17:26 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:12.756 04:17:26 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:12.756 04:17:26 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:12.756 04:17:26 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:12.756 04:17:26 -- common/autotest_common.sh@640 -- # local es=0 00:20:12.756 04:17:26 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:12.756 04:17:26 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:12.756 04:17:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:12.756 04:17:26 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:12.756 04:17:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:12.756 04:17:26 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:12.756 04:17:26 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:12.756 04:17:26 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:12.756 04:17:26 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:12.756 04:17:26 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:12.756 04:17:26 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:12.756 04:17:26 -- target/tls.sh@28 -- # bdevperf_pid=3970554 00:20:12.756 04:17:26 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:12.756 04:17:26 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:12.756 04:17:26 -- target/tls.sh@31 -- # waitforlisten 3970554 /var/tmp/bdevperf.sock 00:20:12.756 04:17:26 -- common/autotest_common.sh@819 -- # '[' -z 3970554 ']' 00:20:12.756 04:17:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:12.756 04:17:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:12.756 04:17:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:12.756 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:12.756 04:17:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:12.756 04:17:26 -- common/autotest_common.sh@10 -- # set +x 00:20:12.756 [2024-05-14 04:17:26.528835] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:12.756 [2024-05-14 04:17:26.528893] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3970554 ] 00:20:12.756 EAL: No free 2048 kB hugepages reported on node 1 00:20:12.756 [2024-05-14 04:17:26.577399] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:12.756 [2024-05-14 04:17:26.627832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:12.756 04:17:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:12.756 04:17:27 -- common/autotest_common.sh@852 -- # return 0 00:20:12.756 04:17:27 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:13.016 [2024-05-14 04:17:27.449078] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:13.016 [2024-05-14 04:17:27.457118] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:13.016 [2024-05-14 04:17:27.457136] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:13.016 [2024-05-14 04:17:27.457155] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:13.016 [2024-05-14 04:17:27.458394] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15eae10 (107): Transport endpoint is not connected 00:20:13.016 [2024-05-14 04:17:27.459389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15eae10 (9): Bad file descriptor 00:20:13.016 [2024-05-14 04:17:27.460391] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:13.016 [2024-05-14 04:17:27.460397] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:13.016 [2024-05-14 04:17:27.460404] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:13.016 request: 00:20:13.016 { 00:20:13.016 "name": "TLSTEST", 00:20:13.016 "trtype": "tcp", 00:20:13.016 "traddr": "10.0.0.2", 00:20:13.016 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:13.016 "adrfam": "ipv4", 00:20:13.016 "trsvcid": "4420", 00:20:13.016 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:13.016 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:13.016 "method": "bdev_nvme_attach_controller", 00:20:13.016 "req_id": 1 00:20:13.016 } 00:20:13.016 Got JSON-RPC error response 00:20:13.016 response: 00:20:13.016 { 00:20:13.016 "code": -32602, 00:20:13.016 "message": "Invalid parameters" 00:20:13.017 } 00:20:13.017 04:17:27 -- target/tls.sh@36 -- # killprocess 3970554 00:20:13.017 04:17:27 -- common/autotest_common.sh@926 -- # '[' -z 3970554 ']' 00:20:13.017 04:17:27 -- common/autotest_common.sh@930 -- # kill -0 3970554 00:20:13.017 04:17:27 -- common/autotest_common.sh@931 -- # uname 00:20:13.017 04:17:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:13.017 04:17:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3970554 00:20:13.017 04:17:27 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:13.017 04:17:27 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:13.017 04:17:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3970554' 00:20:13.017 killing process with pid 3970554 00:20:13.017 04:17:27 -- common/autotest_common.sh@945 -- # kill 3970554 00:20:13.017 Received shutdown signal, test time was about 10.000000 seconds 00:20:13.017 00:20:13.017 Latency(us) 00:20:13.017 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:13.017 =================================================================================================================== 00:20:13.017 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:13.017 04:17:27 -- common/autotest_common.sh@950 -- # wait 3970554 00:20:13.277 04:17:27 -- target/tls.sh@37 -- # return 1 00:20:13.277 04:17:27 -- common/autotest_common.sh@643 -- # es=1 00:20:13.277 04:17:27 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:13.277 04:17:27 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:13.277 04:17:27 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:13.277 04:17:27 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:13.277 04:17:27 -- common/autotest_common.sh@640 -- # local es=0 00:20:13.277 04:17:27 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:13.277 04:17:27 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:13.277 04:17:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:13.277 04:17:27 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:13.277 04:17:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:13.277 04:17:27 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:13.277 04:17:27 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:13.277 04:17:27 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:13.277 04:17:27 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:13.277 04:17:27 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:13.277 04:17:27 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:13.277 04:17:27 -- target/tls.sh@28 -- # bdevperf_pid=3970623 00:20:13.278 04:17:27 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:13.278 04:17:27 -- target/tls.sh@31 -- # waitforlisten 3970623 /var/tmp/bdevperf.sock 00:20:13.278 04:17:27 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:13.278 04:17:27 -- common/autotest_common.sh@819 -- # '[' -z 3970623 ']' 00:20:13.278 04:17:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:13.278 04:17:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:13.278 04:17:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:13.278 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:13.278 04:17:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:13.278 04:17:27 -- common/autotest_common.sh@10 -- # set +x 00:20:13.278 [2024-05-14 04:17:27.698730] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:13.278 [2024-05-14 04:17:27.698815] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3970623 ] 00:20:13.278 EAL: No free 2048 kB hugepages reported on node 1 00:20:13.278 [2024-05-14 04:17:27.751301] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:13.278 [2024-05-14 04:17:27.801460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:14.221 04:17:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:14.221 04:17:28 -- common/autotest_common.sh@852 -- # return 0 00:20:14.221 04:17:28 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:14.221 [2024-05-14 04:17:28.602537] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:14.221 [2024-05-14 04:17:28.609916] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:14.221 [2024-05-14 04:17:28.609935] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:14.221 [2024-05-14 04:17:28.609954] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:14.221 [2024-05-14 04:17:28.610882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1886e10 (107): Transport endpoint is not connected 00:20:14.221 [2024-05-14 04:17:28.611878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1886e10 (9): Bad file descriptor 00:20:14.221 [2024-05-14 04:17:28.612879] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:14.221 [2024-05-14 04:17:28.612886] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:14.221 [2024-05-14 04:17:28.612893] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:14.221 request: 00:20:14.221 { 00:20:14.221 "name": "TLSTEST", 00:20:14.221 "trtype": "tcp", 00:20:14.221 "traddr": "10.0.0.2", 00:20:14.221 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:14.221 "adrfam": "ipv4", 00:20:14.221 "trsvcid": "4420", 00:20:14.221 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:14.221 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:14.221 "method": "bdev_nvme_attach_controller", 00:20:14.221 "req_id": 1 00:20:14.221 } 00:20:14.221 Got JSON-RPC error response 00:20:14.221 response: 00:20:14.221 { 00:20:14.221 "code": -32602, 00:20:14.221 "message": "Invalid parameters" 00:20:14.221 } 00:20:14.221 04:17:28 -- target/tls.sh@36 -- # killprocess 3970623 00:20:14.221 04:17:28 -- common/autotest_common.sh@926 -- # '[' -z 3970623 ']' 00:20:14.221 04:17:28 -- common/autotest_common.sh@930 -- # kill -0 3970623 00:20:14.221 04:17:28 -- common/autotest_common.sh@931 -- # uname 00:20:14.221 04:17:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:14.221 04:17:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3970623 00:20:14.221 04:17:28 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:14.221 04:17:28 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:14.221 04:17:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3970623' 00:20:14.221 killing process with pid 3970623 00:20:14.221 04:17:28 -- common/autotest_common.sh@945 -- # kill 3970623 00:20:14.221 Received shutdown signal, test time was about 10.000000 seconds 00:20:14.221 00:20:14.221 Latency(us) 00:20:14.221 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:14.222 =================================================================================================================== 00:20:14.222 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:14.222 04:17:28 -- common/autotest_common.sh@950 -- # wait 3970623 00:20:14.222 04:17:28 -- target/tls.sh@37 -- # return 1 00:20:14.222 04:17:28 -- common/autotest_common.sh@643 -- # es=1 00:20:14.222 04:17:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:14.222 04:17:28 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:14.222 04:17:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:14.222 04:17:28 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:14.222 04:17:28 -- common/autotest_common.sh@640 -- # local es=0 00:20:14.222 04:17:28 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:14.222 04:17:28 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:14.222 04:17:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:14.222 04:17:28 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:14.222 04:17:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:14.222 04:17:28 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:14.222 04:17:28 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:14.222 04:17:28 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:14.222 04:17:28 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:14.222 04:17:28 -- target/tls.sh@23 -- # psk= 00:20:14.222 04:17:28 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:14.222 04:17:28 -- target/tls.sh@28 -- # bdevperf_pid=3970945 00:20:14.222 04:17:28 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:14.222 04:17:28 -- target/tls.sh@31 -- # waitforlisten 3970945 /var/tmp/bdevperf.sock 00:20:14.222 04:17:28 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:14.222 04:17:28 -- common/autotest_common.sh@819 -- # '[' -z 3970945 ']' 00:20:14.222 04:17:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:14.222 04:17:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:14.222 04:17:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:14.222 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:14.222 04:17:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:14.222 04:17:28 -- common/autotest_common.sh@10 -- # set +x 00:20:14.482 [2024-05-14 04:17:28.847081] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:14.482 [2024-05-14 04:17:28.847132] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3970945 ] 00:20:14.482 EAL: No free 2048 kB hugepages reported on node 1 00:20:14.482 [2024-05-14 04:17:28.896564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:14.482 [2024-05-14 04:17:28.946658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:15.054 04:17:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:15.054 04:17:29 -- common/autotest_common.sh@852 -- # return 0 00:20:15.054 04:17:29 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:15.315 [2024-05-14 04:17:29.762752] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:15.315 [2024-05-14 04:17:29.764522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11c5890 (9): Bad file descriptor 00:20:15.315 [2024-05-14 04:17:29.765521] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:15.315 [2024-05-14 04:17:29.765528] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:15.315 [2024-05-14 04:17:29.765535] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:15.315 request: 00:20:15.315 { 00:20:15.315 "name": "TLSTEST", 00:20:15.315 "trtype": "tcp", 00:20:15.315 "traddr": "10.0.0.2", 00:20:15.315 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:15.315 "adrfam": "ipv4", 00:20:15.315 "trsvcid": "4420", 00:20:15.315 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:15.315 "method": "bdev_nvme_attach_controller", 00:20:15.315 "req_id": 1 00:20:15.315 } 00:20:15.315 Got JSON-RPC error response 00:20:15.315 response: 00:20:15.315 { 00:20:15.315 "code": -32602, 00:20:15.315 "message": "Invalid parameters" 00:20:15.315 } 00:20:15.315 04:17:29 -- target/tls.sh@36 -- # killprocess 3970945 00:20:15.315 04:17:29 -- common/autotest_common.sh@926 -- # '[' -z 3970945 ']' 00:20:15.315 04:17:29 -- common/autotest_common.sh@930 -- # kill -0 3970945 00:20:15.315 04:17:29 -- common/autotest_common.sh@931 -- # uname 00:20:15.315 04:17:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:15.315 04:17:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3970945 00:20:15.315 04:17:29 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:15.315 04:17:29 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:15.315 04:17:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3970945' 00:20:15.315 killing process with pid 3970945 00:20:15.315 04:17:29 -- common/autotest_common.sh@945 -- # kill 3970945 00:20:15.315 Received shutdown signal, test time was about 10.000000 seconds 00:20:15.315 00:20:15.315 Latency(us) 00:20:15.315 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:15.315 =================================================================================================================== 00:20:15.315 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:15.315 04:17:29 -- common/autotest_common.sh@950 -- # wait 3970945 00:20:15.576 04:17:29 -- target/tls.sh@37 -- # return 1 00:20:15.576 04:17:29 -- common/autotest_common.sh@643 -- # es=1 00:20:15.576 04:17:29 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:15.576 04:17:29 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:15.576 04:17:29 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:15.576 04:17:29 -- target/tls.sh@167 -- # killprocess 3965113 00:20:15.576 04:17:29 -- common/autotest_common.sh@926 -- # '[' -z 3965113 ']' 00:20:15.576 04:17:29 -- common/autotest_common.sh@930 -- # kill -0 3965113 00:20:15.576 04:17:29 -- common/autotest_common.sh@931 -- # uname 00:20:15.576 04:17:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:15.576 04:17:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3965113 00:20:15.576 04:17:30 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:15.576 04:17:30 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:15.576 04:17:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3965113' 00:20:15.576 killing process with pid 3965113 00:20:15.576 04:17:30 -- common/autotest_common.sh@945 -- # kill 3965113 00:20:15.576 04:17:30 -- common/autotest_common.sh@950 -- # wait 3965113 00:20:15.576 04:17:30 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:15.576 04:17:30 -- target/tls.sh@49 -- # local key hash crc 00:20:15.577 04:17:30 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:15.577 04:17:30 -- target/tls.sh@51 -- # hash=02 00:20:15.577 04:17:30 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:15.577 04:17:30 -- target/tls.sh@52 -- # gzip -1 -c 00:20:15.577 04:17:30 -- target/tls.sh@52 -- # tail -c8 00:20:15.577 04:17:30 -- target/tls.sh@52 -- # head -c 4 00:20:15.577 04:17:30 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:15.577 04:17:30 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:15.577 04:17:30 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:15.577 04:17:30 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:15.577 04:17:30 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:15.577 04:17:30 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:15.577 04:17:30 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:15.577 04:17:30 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:15.577 04:17:30 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:15.577 04:17:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:15.577 04:17:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:15.577 04:17:30 -- common/autotest_common.sh@10 -- # set +x 00:20:15.577 04:17:30 -- nvmf/common.sh@469 -- # nvmfpid=3971306 00:20:15.577 04:17:30 -- nvmf/common.sh@470 -- # waitforlisten 3971306 00:20:15.838 04:17:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:15.838 04:17:30 -- common/autotest_common.sh@819 -- # '[' -z 3971306 ']' 00:20:15.838 04:17:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:15.838 04:17:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:15.838 04:17:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:15.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:15.838 04:17:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:15.838 04:17:30 -- common/autotest_common.sh@10 -- # set +x 00:20:15.838 [2024-05-14 04:17:30.211409] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:15.838 [2024-05-14 04:17:30.211462] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:15.838 EAL: No free 2048 kB hugepages reported on node 1 00:20:15.838 [2024-05-14 04:17:30.293649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:15.838 [2024-05-14 04:17:30.346431] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:15.838 [2024-05-14 04:17:30.346527] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:15.838 [2024-05-14 04:17:30.346532] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:15.838 [2024-05-14 04:17:30.346537] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:15.838 [2024-05-14 04:17:30.346552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:16.410 04:17:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:16.410 04:17:30 -- common/autotest_common.sh@852 -- # return 0 00:20:16.410 04:17:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:16.410 04:17:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:16.410 04:17:30 -- common/autotest_common.sh@10 -- # set +x 00:20:16.671 04:17:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:16.671 04:17:31 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:16.671 04:17:31 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:16.671 04:17:31 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:16.671 [2024-05-14 04:17:31.144874] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:16.671 04:17:31 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:16.932 04:17:31 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:16.932 [2024-05-14 04:17:31.445617] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:16.932 [2024-05-14 04:17:31.445794] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:16.932 04:17:31 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:17.193 malloc0 00:20:17.193 04:17:31 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:17.193 04:17:31 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:17.453 04:17:31 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:17.453 04:17:31 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:17.453 04:17:31 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:17.453 04:17:31 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:17.453 04:17:31 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:17.453 04:17:31 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:17.453 04:17:31 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:17.453 04:17:31 -- target/tls.sh@28 -- # bdevperf_pid=3971668 00:20:17.453 04:17:31 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:17.453 04:17:31 -- target/tls.sh@31 -- # waitforlisten 3971668 /var/tmp/bdevperf.sock 00:20:17.453 04:17:31 -- common/autotest_common.sh@819 -- # '[' -z 3971668 ']' 00:20:17.453 04:17:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:17.453 04:17:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:17.453 04:17:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:17.453 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:17.453 04:17:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:17.453 04:17:31 -- common/autotest_common.sh@10 -- # set +x 00:20:17.453 [2024-05-14 04:17:31.912507] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:17.453 [2024-05-14 04:17:31.912555] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3971668 ] 00:20:17.453 EAL: No free 2048 kB hugepages reported on node 1 00:20:17.453 [2024-05-14 04:17:31.962605] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:17.453 [2024-05-14 04:17:32.013203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:18.397 04:17:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:18.397 04:17:32 -- common/autotest_common.sh@852 -- # return 0 00:20:18.397 04:17:32 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:18.397 [2024-05-14 04:17:32.830232] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:18.397 TLSTESTn1 00:20:18.397 04:17:32 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:18.733 Running I/O for 10 seconds... 00:20:28.736 00:20:28.736 Latency(us) 00:20:28.736 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.736 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:28.736 Verification LBA range: start 0x0 length 0x2000 00:20:28.736 TLSTESTn1 : 10.06 1544.65 6.03 0.00 0.00 82684.44 10594.99 89128.96 00:20:28.736 =================================================================================================================== 00:20:28.736 Total : 1544.65 6.03 0.00 0.00 82684.44 10594.99 89128.96 00:20:28.736 0 00:20:28.736 04:17:43 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:28.736 04:17:43 -- target/tls.sh@45 -- # killprocess 3971668 00:20:28.736 04:17:43 -- common/autotest_common.sh@926 -- # '[' -z 3971668 ']' 00:20:28.736 04:17:43 -- common/autotest_common.sh@930 -- # kill -0 3971668 00:20:28.736 04:17:43 -- common/autotest_common.sh@931 -- # uname 00:20:28.736 04:17:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:28.736 04:17:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3971668 00:20:28.736 04:17:43 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:28.736 04:17:43 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:28.736 04:17:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3971668' 00:20:28.736 killing process with pid 3971668 00:20:28.736 04:17:43 -- common/autotest_common.sh@945 -- # kill 3971668 00:20:28.736 Received shutdown signal, test time was about 10.000000 seconds 00:20:28.736 00:20:28.736 Latency(us) 00:20:28.736 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.736 =================================================================================================================== 00:20:28.736 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:28.736 04:17:43 -- common/autotest_common.sh@950 -- # wait 3971668 00:20:28.736 04:17:43 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:28.736 04:17:43 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:28.736 04:17:43 -- common/autotest_common.sh@640 -- # local es=0 00:20:28.736 04:17:43 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:28.736 04:17:43 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:28.736 04:17:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:28.736 04:17:43 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:28.736 04:17:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:28.736 04:17:43 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:28.736 04:17:43 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:28.736 04:17:43 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:28.737 04:17:43 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:28.737 04:17:43 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:28.737 04:17:43 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:28.737 04:17:43 -- target/tls.sh@28 -- # bdevperf_pid=3973758 00:20:28.737 04:17:43 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:28.737 04:17:43 -- target/tls.sh@31 -- # waitforlisten 3973758 /var/tmp/bdevperf.sock 00:20:28.737 04:17:43 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:28.737 04:17:43 -- common/autotest_common.sh@819 -- # '[' -z 3973758 ']' 00:20:28.737 04:17:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:28.737 04:17:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:28.737 04:17:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:28.737 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:28.737 04:17:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:28.737 04:17:43 -- common/autotest_common.sh@10 -- # set +x 00:20:28.998 [2024-05-14 04:17:43.343916] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:28.998 [2024-05-14 04:17:43.343970] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3973758 ] 00:20:28.998 EAL: No free 2048 kB hugepages reported on node 1 00:20:28.998 [2024-05-14 04:17:43.393551] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:28.998 [2024-05-14 04:17:43.444364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:29.576 04:17:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:29.576 04:17:44 -- common/autotest_common.sh@852 -- # return 0 00:20:29.576 04:17:44 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:29.838 [2024-05-14 04:17:44.245567] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:29.838 [2024-05-14 04:17:44.245603] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:29.838 request: 00:20:29.838 { 00:20:29.838 "name": "TLSTEST", 00:20:29.838 "trtype": "tcp", 00:20:29.838 "traddr": "10.0.0.2", 00:20:29.838 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:29.838 "adrfam": "ipv4", 00:20:29.838 "trsvcid": "4420", 00:20:29.838 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:29.838 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:29.838 "method": "bdev_nvme_attach_controller", 00:20:29.838 "req_id": 1 00:20:29.838 } 00:20:29.838 Got JSON-RPC error response 00:20:29.838 response: 00:20:29.838 { 00:20:29.838 "code": -22, 00:20:29.838 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:29.838 } 00:20:29.838 04:17:44 -- target/tls.sh@36 -- # killprocess 3973758 00:20:29.838 04:17:44 -- common/autotest_common.sh@926 -- # '[' -z 3973758 ']' 00:20:29.838 04:17:44 -- common/autotest_common.sh@930 -- # kill -0 3973758 00:20:29.838 04:17:44 -- common/autotest_common.sh@931 -- # uname 00:20:29.838 04:17:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:29.838 04:17:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3973758 00:20:29.838 04:17:44 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:29.838 04:17:44 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:29.838 04:17:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3973758' 00:20:29.838 killing process with pid 3973758 00:20:29.838 04:17:44 -- common/autotest_common.sh@945 -- # kill 3973758 00:20:29.838 Received shutdown signal, test time was about 10.000000 seconds 00:20:29.838 00:20:29.838 Latency(us) 00:20:29.838 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:29.838 =================================================================================================================== 00:20:29.838 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:29.838 04:17:44 -- common/autotest_common.sh@950 -- # wait 3973758 00:20:30.098 04:17:44 -- target/tls.sh@37 -- # return 1 00:20:30.098 04:17:44 -- common/autotest_common.sh@643 -- # es=1 00:20:30.098 04:17:44 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:30.098 04:17:44 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:30.098 04:17:44 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:30.098 04:17:44 -- target/tls.sh@183 -- # killprocess 3971306 00:20:30.098 04:17:44 -- common/autotest_common.sh@926 -- # '[' -z 3971306 ']' 00:20:30.098 04:17:44 -- common/autotest_common.sh@930 -- # kill -0 3971306 00:20:30.098 04:17:44 -- common/autotest_common.sh@931 -- # uname 00:20:30.098 04:17:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:30.098 04:17:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3971306 00:20:30.098 04:17:44 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:30.098 04:17:44 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:30.098 04:17:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3971306' 00:20:30.098 killing process with pid 3971306 00:20:30.098 04:17:44 -- common/autotest_common.sh@945 -- # kill 3971306 00:20:30.098 04:17:44 -- common/autotest_common.sh@950 -- # wait 3971306 00:20:30.098 04:17:44 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:30.098 04:17:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:30.098 04:17:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:30.098 04:17:44 -- common/autotest_common.sh@10 -- # set +x 00:20:30.098 04:17:44 -- nvmf/common.sh@469 -- # nvmfpid=3974066 00:20:30.098 04:17:44 -- nvmf/common.sh@470 -- # waitforlisten 3974066 00:20:30.098 04:17:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:30.098 04:17:44 -- common/autotest_common.sh@819 -- # '[' -z 3974066 ']' 00:20:30.098 04:17:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:30.098 04:17:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:30.098 04:17:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:30.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:30.098 04:17:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:30.098 04:17:44 -- common/autotest_common.sh@10 -- # set +x 00:20:30.098 [2024-05-14 04:17:44.670984] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:30.098 [2024-05-14 04:17:44.671052] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:30.358 EAL: No free 2048 kB hugepages reported on node 1 00:20:30.358 [2024-05-14 04:17:44.754266] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:30.358 [2024-05-14 04:17:44.804894] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:30.358 [2024-05-14 04:17:44.804992] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:30.358 [2024-05-14 04:17:44.804998] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:30.358 [2024-05-14 04:17:44.805003] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:30.358 [2024-05-14 04:17:44.805021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:30.931 04:17:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:30.931 04:17:45 -- common/autotest_common.sh@852 -- # return 0 00:20:30.931 04:17:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:30.931 04:17:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:30.931 04:17:45 -- common/autotest_common.sh@10 -- # set +x 00:20:30.931 04:17:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:30.931 04:17:45 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.931 04:17:45 -- common/autotest_common.sh@640 -- # local es=0 00:20:30.931 04:17:45 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.931 04:17:45 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:20:30.931 04:17:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:30.931 04:17:45 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:20:30.931 04:17:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:30.931 04:17:45 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.931 04:17:45 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.931 04:17:45 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:31.191 [2024-05-14 04:17:45.599494] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:31.191 04:17:45 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:31.191 04:17:45 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:31.452 [2024-05-14 04:17:45.904231] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:31.452 [2024-05-14 04:17:45.904418] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:31.452 04:17:45 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:31.713 malloc0 00:20:31.713 04:17:46 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:31.713 04:17:46 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:31.973 [2024-05-14 04:17:46.326952] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:31.973 [2024-05-14 04:17:46.326976] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:31.973 [2024-05-14 04:17:46.326989] subsystem.c: 840:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:31.973 request: 00:20:31.973 { 00:20:31.973 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:31.973 "host": "nqn.2016-06.io.spdk:host1", 00:20:31.973 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:31.973 "method": "nvmf_subsystem_add_host", 00:20:31.973 "req_id": 1 00:20:31.973 } 00:20:31.973 Got JSON-RPC error response 00:20:31.973 response: 00:20:31.973 { 00:20:31.973 "code": -32603, 00:20:31.973 "message": "Internal error" 00:20:31.973 } 00:20:31.973 04:17:46 -- common/autotest_common.sh@643 -- # es=1 00:20:31.973 04:17:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:31.973 04:17:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:31.973 04:17:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:31.973 04:17:46 -- target/tls.sh@189 -- # killprocess 3974066 00:20:31.973 04:17:46 -- common/autotest_common.sh@926 -- # '[' -z 3974066 ']' 00:20:31.973 04:17:46 -- common/autotest_common.sh@930 -- # kill -0 3974066 00:20:31.973 04:17:46 -- common/autotest_common.sh@931 -- # uname 00:20:31.973 04:17:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:31.973 04:17:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3974066 00:20:31.973 04:17:46 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:31.973 04:17:46 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:31.973 04:17:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3974066' 00:20:31.973 killing process with pid 3974066 00:20:31.973 04:17:46 -- common/autotest_common.sh@945 -- # kill 3974066 00:20:31.973 04:17:46 -- common/autotest_common.sh@950 -- # wait 3974066 00:20:31.973 04:17:46 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:31.973 04:17:46 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:31.973 04:17:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:31.973 04:17:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:31.973 04:17:46 -- common/autotest_common.sh@10 -- # set +x 00:20:31.973 04:17:46 -- nvmf/common.sh@469 -- # nvmfpid=3974443 00:20:31.973 04:17:46 -- nvmf/common.sh@470 -- # waitforlisten 3974443 00:20:31.974 04:17:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:31.974 04:17:46 -- common/autotest_common.sh@819 -- # '[' -z 3974443 ']' 00:20:31.974 04:17:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:31.974 04:17:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:31.974 04:17:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:31.974 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:31.974 04:17:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:31.974 04:17:46 -- common/autotest_common.sh@10 -- # set +x 00:20:32.234 [2024-05-14 04:17:46.583054] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:32.234 [2024-05-14 04:17:46.583108] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:32.234 EAL: No free 2048 kB hugepages reported on node 1 00:20:32.234 [2024-05-14 04:17:46.663071] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:32.234 [2024-05-14 04:17:46.715745] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:32.234 [2024-05-14 04:17:46.715846] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:32.234 [2024-05-14 04:17:46.715852] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:32.234 [2024-05-14 04:17:46.715857] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:32.234 [2024-05-14 04:17:46.715872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:32.806 04:17:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:32.806 04:17:47 -- common/autotest_common.sh@852 -- # return 0 00:20:32.806 04:17:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:32.806 04:17:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:32.806 04:17:47 -- common/autotest_common.sh@10 -- # set +x 00:20:32.806 04:17:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:32.806 04:17:47 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.806 04:17:47 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.806 04:17:47 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:33.066 [2024-05-14 04:17:47.506156] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:33.066 04:17:47 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:33.327 04:17:47 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:33.327 [2024-05-14 04:17:47.794852] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:33.327 [2024-05-14 04:17:47.795030] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:33.327 04:17:47 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:33.588 malloc0 00:20:33.588 04:17:47 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:33.588 04:17:48 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:33.849 04:17:48 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:33.849 04:17:48 -- target/tls.sh@197 -- # bdevperf_pid=3974807 00:20:33.849 04:17:48 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:33.849 04:17:48 -- target/tls.sh@200 -- # waitforlisten 3974807 /var/tmp/bdevperf.sock 00:20:33.849 04:17:48 -- common/autotest_common.sh@819 -- # '[' -z 3974807 ']' 00:20:33.849 04:17:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:33.849 04:17:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:33.849 04:17:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:33.849 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:33.849 04:17:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:33.849 04:17:48 -- common/autotest_common.sh@10 -- # set +x 00:20:33.849 [2024-05-14 04:17:48.247740] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:33.849 [2024-05-14 04:17:48.247791] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3974807 ] 00:20:33.849 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.849 [2024-05-14 04:17:48.297157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:33.849 [2024-05-14 04:17:48.347131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.791 04:17:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:34.791 04:17:49 -- common/autotest_common.sh@852 -- # return 0 00:20:34.791 04:17:49 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:34.791 [2024-05-14 04:17:49.168262] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:34.791 TLSTESTn1 00:20:34.791 04:17:49 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:35.052 04:17:49 -- target/tls.sh@205 -- # tgtconf='{ 00:20:35.052 "subsystems": [ 00:20:35.052 { 00:20:35.052 "subsystem": "iobuf", 00:20:35.052 "config": [ 00:20:35.052 { 00:20:35.052 "method": "iobuf_set_options", 00:20:35.052 "params": { 00:20:35.052 "small_pool_count": 8192, 00:20:35.052 "large_pool_count": 1024, 00:20:35.052 "small_bufsize": 8192, 00:20:35.052 "large_bufsize": 135168 00:20:35.052 } 00:20:35.052 } 00:20:35.052 ] 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "subsystem": "sock", 00:20:35.052 "config": [ 00:20:35.052 { 00:20:35.052 "method": "sock_impl_set_options", 00:20:35.052 "params": { 00:20:35.052 "impl_name": "posix", 00:20:35.052 "recv_buf_size": 2097152, 00:20:35.052 "send_buf_size": 2097152, 00:20:35.052 "enable_recv_pipe": true, 00:20:35.052 "enable_quickack": false, 00:20:35.052 "enable_placement_id": 0, 00:20:35.052 "enable_zerocopy_send_server": true, 00:20:35.052 "enable_zerocopy_send_client": false, 00:20:35.052 "zerocopy_threshold": 0, 00:20:35.052 "tls_version": 0, 00:20:35.052 "enable_ktls": false 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "sock_impl_set_options", 00:20:35.052 "params": { 00:20:35.052 "impl_name": "ssl", 00:20:35.052 "recv_buf_size": 4096, 00:20:35.052 "send_buf_size": 4096, 00:20:35.052 "enable_recv_pipe": true, 00:20:35.052 "enable_quickack": false, 00:20:35.052 "enable_placement_id": 0, 00:20:35.052 "enable_zerocopy_send_server": true, 00:20:35.052 "enable_zerocopy_send_client": false, 00:20:35.052 "zerocopy_threshold": 0, 00:20:35.052 "tls_version": 0, 00:20:35.052 "enable_ktls": false 00:20:35.052 } 00:20:35.052 } 00:20:35.052 ] 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "subsystem": "vmd", 00:20:35.052 "config": [] 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "subsystem": "accel", 00:20:35.052 "config": [ 00:20:35.052 { 00:20:35.052 "method": "accel_set_options", 00:20:35.052 "params": { 00:20:35.052 "small_cache_size": 128, 00:20:35.052 "large_cache_size": 16, 00:20:35.052 "task_count": 2048, 00:20:35.052 "sequence_count": 2048, 00:20:35.052 "buf_count": 2048 00:20:35.052 } 00:20:35.052 } 00:20:35.052 ] 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "subsystem": "bdev", 00:20:35.052 "config": [ 00:20:35.052 { 00:20:35.052 "method": "bdev_set_options", 00:20:35.052 "params": { 00:20:35.052 "bdev_io_pool_size": 65535, 00:20:35.052 "bdev_io_cache_size": 256, 00:20:35.052 "bdev_auto_examine": true, 00:20:35.052 "iobuf_small_cache_size": 128, 00:20:35.052 "iobuf_large_cache_size": 16 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "bdev_raid_set_options", 00:20:35.052 "params": { 00:20:35.052 "process_window_size_kb": 1024 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "bdev_iscsi_set_options", 00:20:35.052 "params": { 00:20:35.052 "timeout_sec": 30 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "bdev_nvme_set_options", 00:20:35.052 "params": { 00:20:35.052 "action_on_timeout": "none", 00:20:35.052 "timeout_us": 0, 00:20:35.052 "timeout_admin_us": 0, 00:20:35.052 "keep_alive_timeout_ms": 10000, 00:20:35.052 "transport_retry_count": 4, 00:20:35.052 "arbitration_burst": 0, 00:20:35.052 "low_priority_weight": 0, 00:20:35.052 "medium_priority_weight": 0, 00:20:35.052 "high_priority_weight": 0, 00:20:35.052 "nvme_adminq_poll_period_us": 10000, 00:20:35.052 "nvme_ioq_poll_period_us": 0, 00:20:35.052 "io_queue_requests": 0, 00:20:35.052 "delay_cmd_submit": true, 00:20:35.052 "bdev_retry_count": 3, 00:20:35.052 "transport_ack_timeout": 0, 00:20:35.052 "ctrlr_loss_timeout_sec": 0, 00:20:35.052 "reconnect_delay_sec": 0, 00:20:35.052 "fast_io_fail_timeout_sec": 0, 00:20:35.052 "generate_uuids": false, 00:20:35.052 "transport_tos": 0, 00:20:35.052 "io_path_stat": false, 00:20:35.052 "allow_accel_sequence": false 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "bdev_nvme_set_hotplug", 00:20:35.052 "params": { 00:20:35.052 "period_us": 100000, 00:20:35.052 "enable": false 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "bdev_malloc_create", 00:20:35.052 "params": { 00:20:35.052 "name": "malloc0", 00:20:35.052 "num_blocks": 8192, 00:20:35.052 "block_size": 4096, 00:20:35.052 "physical_block_size": 4096, 00:20:35.052 "uuid": "a2066833-be61-46d3-82ac-4ef8328abb82", 00:20:35.052 "optimal_io_boundary": 0 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "bdev_wait_for_examine" 00:20:35.052 } 00:20:35.052 ] 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "subsystem": "nbd", 00:20:35.052 "config": [] 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "subsystem": "scheduler", 00:20:35.052 "config": [ 00:20:35.052 { 00:20:35.052 "method": "framework_set_scheduler", 00:20:35.052 "params": { 00:20:35.052 "name": "static" 00:20:35.052 } 00:20:35.052 } 00:20:35.052 ] 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "subsystem": "nvmf", 00:20:35.052 "config": [ 00:20:35.052 { 00:20:35.052 "method": "nvmf_set_config", 00:20:35.052 "params": { 00:20:35.052 "discovery_filter": "match_any", 00:20:35.052 "admin_cmd_passthru": { 00:20:35.052 "identify_ctrlr": false 00:20:35.052 } 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "nvmf_set_max_subsystems", 00:20:35.052 "params": { 00:20:35.052 "max_subsystems": 1024 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "nvmf_set_crdt", 00:20:35.052 "params": { 00:20:35.052 "crdt1": 0, 00:20:35.052 "crdt2": 0, 00:20:35.052 "crdt3": 0 00:20:35.052 } 00:20:35.052 }, 00:20:35.052 { 00:20:35.052 "method": "nvmf_create_transport", 00:20:35.052 "params": { 00:20:35.052 "trtype": "TCP", 00:20:35.052 "max_queue_depth": 128, 00:20:35.052 "max_io_qpairs_per_ctrlr": 127, 00:20:35.052 "in_capsule_data_size": 4096, 00:20:35.052 "max_io_size": 131072, 00:20:35.053 "io_unit_size": 131072, 00:20:35.053 "max_aq_depth": 128, 00:20:35.053 "num_shared_buffers": 511, 00:20:35.053 "buf_cache_size": 4294967295, 00:20:35.053 "dif_insert_or_strip": false, 00:20:35.053 "zcopy": false, 00:20:35.053 "c2h_success": false, 00:20:35.053 "sock_priority": 0, 00:20:35.053 "abort_timeout_sec": 1 00:20:35.053 } 00:20:35.053 }, 00:20:35.053 { 00:20:35.053 "method": "nvmf_create_subsystem", 00:20:35.053 "params": { 00:20:35.053 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.053 "allow_any_host": false, 00:20:35.053 "serial_number": "SPDK00000000000001", 00:20:35.053 "model_number": "SPDK bdev Controller", 00:20:35.053 "max_namespaces": 10, 00:20:35.053 "min_cntlid": 1, 00:20:35.053 "max_cntlid": 65519, 00:20:35.053 "ana_reporting": false 00:20:35.053 } 00:20:35.053 }, 00:20:35.053 { 00:20:35.053 "method": "nvmf_subsystem_add_host", 00:20:35.053 "params": { 00:20:35.053 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.053 "host": "nqn.2016-06.io.spdk:host1", 00:20:35.053 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:35.053 } 00:20:35.053 }, 00:20:35.053 { 00:20:35.053 "method": "nvmf_subsystem_add_ns", 00:20:35.053 "params": { 00:20:35.053 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.053 "namespace": { 00:20:35.053 "nsid": 1, 00:20:35.053 "bdev_name": "malloc0", 00:20:35.053 "nguid": "A2066833BE6146D382AC4EF8328ABB82", 00:20:35.053 "uuid": "a2066833-be61-46d3-82ac-4ef8328abb82" 00:20:35.053 } 00:20:35.053 } 00:20:35.053 }, 00:20:35.053 { 00:20:35.053 "method": "nvmf_subsystem_add_listener", 00:20:35.053 "params": { 00:20:35.053 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.053 "listen_address": { 00:20:35.053 "trtype": "TCP", 00:20:35.053 "adrfam": "IPv4", 00:20:35.053 "traddr": "10.0.0.2", 00:20:35.053 "trsvcid": "4420" 00:20:35.053 }, 00:20:35.053 "secure_channel": true 00:20:35.053 } 00:20:35.053 } 00:20:35.053 ] 00:20:35.053 } 00:20:35.053 ] 00:20:35.053 }' 00:20:35.053 04:17:49 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:35.314 04:17:49 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:35.314 "subsystems": [ 00:20:35.314 { 00:20:35.314 "subsystem": "iobuf", 00:20:35.314 "config": [ 00:20:35.314 { 00:20:35.314 "method": "iobuf_set_options", 00:20:35.314 "params": { 00:20:35.314 "small_pool_count": 8192, 00:20:35.314 "large_pool_count": 1024, 00:20:35.314 "small_bufsize": 8192, 00:20:35.314 "large_bufsize": 135168 00:20:35.314 } 00:20:35.314 } 00:20:35.314 ] 00:20:35.314 }, 00:20:35.314 { 00:20:35.314 "subsystem": "sock", 00:20:35.314 "config": [ 00:20:35.314 { 00:20:35.314 "method": "sock_impl_set_options", 00:20:35.314 "params": { 00:20:35.314 "impl_name": "posix", 00:20:35.314 "recv_buf_size": 2097152, 00:20:35.314 "send_buf_size": 2097152, 00:20:35.314 "enable_recv_pipe": true, 00:20:35.314 "enable_quickack": false, 00:20:35.314 "enable_placement_id": 0, 00:20:35.314 "enable_zerocopy_send_server": true, 00:20:35.314 "enable_zerocopy_send_client": false, 00:20:35.314 "zerocopy_threshold": 0, 00:20:35.314 "tls_version": 0, 00:20:35.314 "enable_ktls": false 00:20:35.314 } 00:20:35.314 }, 00:20:35.314 { 00:20:35.314 "method": "sock_impl_set_options", 00:20:35.314 "params": { 00:20:35.314 "impl_name": "ssl", 00:20:35.314 "recv_buf_size": 4096, 00:20:35.314 "send_buf_size": 4096, 00:20:35.314 "enable_recv_pipe": true, 00:20:35.314 "enable_quickack": false, 00:20:35.314 "enable_placement_id": 0, 00:20:35.314 "enable_zerocopy_send_server": true, 00:20:35.314 "enable_zerocopy_send_client": false, 00:20:35.314 "zerocopy_threshold": 0, 00:20:35.314 "tls_version": 0, 00:20:35.314 "enable_ktls": false 00:20:35.314 } 00:20:35.314 } 00:20:35.314 ] 00:20:35.314 }, 00:20:35.314 { 00:20:35.314 "subsystem": "vmd", 00:20:35.314 "config": [] 00:20:35.314 }, 00:20:35.314 { 00:20:35.314 "subsystem": "accel", 00:20:35.314 "config": [ 00:20:35.314 { 00:20:35.315 "method": "accel_set_options", 00:20:35.315 "params": { 00:20:35.315 "small_cache_size": 128, 00:20:35.315 "large_cache_size": 16, 00:20:35.315 "task_count": 2048, 00:20:35.315 "sequence_count": 2048, 00:20:35.315 "buf_count": 2048 00:20:35.315 } 00:20:35.315 } 00:20:35.315 ] 00:20:35.315 }, 00:20:35.315 { 00:20:35.315 "subsystem": "bdev", 00:20:35.315 "config": [ 00:20:35.315 { 00:20:35.315 "method": "bdev_set_options", 00:20:35.315 "params": { 00:20:35.315 "bdev_io_pool_size": 65535, 00:20:35.315 "bdev_io_cache_size": 256, 00:20:35.315 "bdev_auto_examine": true, 00:20:35.315 "iobuf_small_cache_size": 128, 00:20:35.315 "iobuf_large_cache_size": 16 00:20:35.315 } 00:20:35.315 }, 00:20:35.315 { 00:20:35.315 "method": "bdev_raid_set_options", 00:20:35.315 "params": { 00:20:35.315 "process_window_size_kb": 1024 00:20:35.315 } 00:20:35.315 }, 00:20:35.315 { 00:20:35.315 "method": "bdev_iscsi_set_options", 00:20:35.315 "params": { 00:20:35.315 "timeout_sec": 30 00:20:35.315 } 00:20:35.315 }, 00:20:35.315 { 00:20:35.315 "method": "bdev_nvme_set_options", 00:20:35.315 "params": { 00:20:35.315 "action_on_timeout": "none", 00:20:35.315 "timeout_us": 0, 00:20:35.315 "timeout_admin_us": 0, 00:20:35.315 "keep_alive_timeout_ms": 10000, 00:20:35.315 "transport_retry_count": 4, 00:20:35.315 "arbitration_burst": 0, 00:20:35.315 "low_priority_weight": 0, 00:20:35.315 "medium_priority_weight": 0, 00:20:35.315 "high_priority_weight": 0, 00:20:35.315 "nvme_adminq_poll_period_us": 10000, 00:20:35.315 "nvme_ioq_poll_period_us": 0, 00:20:35.315 "io_queue_requests": 512, 00:20:35.315 "delay_cmd_submit": true, 00:20:35.315 "bdev_retry_count": 3, 00:20:35.315 "transport_ack_timeout": 0, 00:20:35.315 "ctrlr_loss_timeout_sec": 0, 00:20:35.315 "reconnect_delay_sec": 0, 00:20:35.315 "fast_io_fail_timeout_sec": 0, 00:20:35.315 "generate_uuids": false, 00:20:35.315 "transport_tos": 0, 00:20:35.315 "io_path_stat": false, 00:20:35.315 "allow_accel_sequence": false 00:20:35.315 } 00:20:35.315 }, 00:20:35.315 { 00:20:35.315 "method": "bdev_nvme_attach_controller", 00:20:35.315 "params": { 00:20:35.315 "name": "TLSTEST", 00:20:35.315 "trtype": "TCP", 00:20:35.315 "adrfam": "IPv4", 00:20:35.315 "traddr": "10.0.0.2", 00:20:35.315 "trsvcid": "4420", 00:20:35.315 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.315 "prchk_reftag": false, 00:20:35.315 "prchk_guard": false, 00:20:35.315 "ctrlr_loss_timeout_sec": 0, 00:20:35.315 "reconnect_delay_sec": 0, 00:20:35.315 "fast_io_fail_timeout_sec": 0, 00:20:35.315 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:35.315 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:35.315 "hdgst": false, 00:20:35.315 "ddgst": false 00:20:35.315 } 00:20:35.315 }, 00:20:35.315 { 00:20:35.315 "method": "bdev_nvme_set_hotplug", 00:20:35.315 "params": { 00:20:35.315 "period_us": 100000, 00:20:35.315 "enable": false 00:20:35.315 } 00:20:35.315 }, 00:20:35.315 { 00:20:35.315 "method": "bdev_wait_for_examine" 00:20:35.315 } 00:20:35.315 ] 00:20:35.315 }, 00:20:35.315 { 00:20:35.315 "subsystem": "nbd", 00:20:35.315 "config": [] 00:20:35.315 } 00:20:35.315 ] 00:20:35.315 }' 00:20:35.315 04:17:49 -- target/tls.sh@208 -- # killprocess 3974807 00:20:35.315 04:17:49 -- common/autotest_common.sh@926 -- # '[' -z 3974807 ']' 00:20:35.315 04:17:49 -- common/autotest_common.sh@930 -- # kill -0 3974807 00:20:35.315 04:17:49 -- common/autotest_common.sh@931 -- # uname 00:20:35.315 04:17:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:35.315 04:17:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3974807 00:20:35.315 04:17:49 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:35.315 04:17:49 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:35.315 04:17:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3974807' 00:20:35.315 killing process with pid 3974807 00:20:35.315 04:17:49 -- common/autotest_common.sh@945 -- # kill 3974807 00:20:35.315 Received shutdown signal, test time was about 10.000000 seconds 00:20:35.315 00:20:35.315 Latency(us) 00:20:35.315 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:35.315 =================================================================================================================== 00:20:35.315 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:35.315 04:17:49 -- common/autotest_common.sh@950 -- # wait 3974807 00:20:35.315 04:17:49 -- target/tls.sh@209 -- # killprocess 3974443 00:20:35.315 04:17:49 -- common/autotest_common.sh@926 -- # '[' -z 3974443 ']' 00:20:35.315 04:17:49 -- common/autotest_common.sh@930 -- # kill -0 3974443 00:20:35.315 04:17:49 -- common/autotest_common.sh@931 -- # uname 00:20:35.315 04:17:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:35.315 04:17:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3974443 00:20:35.576 04:17:49 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:35.576 04:17:49 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:35.576 04:17:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3974443' 00:20:35.576 killing process with pid 3974443 00:20:35.576 04:17:49 -- common/autotest_common.sh@945 -- # kill 3974443 00:20:35.576 04:17:49 -- common/autotest_common.sh@950 -- # wait 3974443 00:20:35.576 04:17:50 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:35.576 04:17:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:35.576 04:17:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:35.576 04:17:50 -- common/autotest_common.sh@10 -- # set +x 00:20:35.576 04:17:50 -- target/tls.sh@212 -- # echo '{ 00:20:35.576 "subsystems": [ 00:20:35.576 { 00:20:35.576 "subsystem": "iobuf", 00:20:35.576 "config": [ 00:20:35.576 { 00:20:35.576 "method": "iobuf_set_options", 00:20:35.576 "params": { 00:20:35.576 "small_pool_count": 8192, 00:20:35.576 "large_pool_count": 1024, 00:20:35.576 "small_bufsize": 8192, 00:20:35.576 "large_bufsize": 135168 00:20:35.576 } 00:20:35.576 } 00:20:35.576 ] 00:20:35.576 }, 00:20:35.576 { 00:20:35.576 "subsystem": "sock", 00:20:35.576 "config": [ 00:20:35.576 { 00:20:35.576 "method": "sock_impl_set_options", 00:20:35.576 "params": { 00:20:35.576 "impl_name": "posix", 00:20:35.576 "recv_buf_size": 2097152, 00:20:35.576 "send_buf_size": 2097152, 00:20:35.576 "enable_recv_pipe": true, 00:20:35.576 "enable_quickack": false, 00:20:35.576 "enable_placement_id": 0, 00:20:35.576 "enable_zerocopy_send_server": true, 00:20:35.576 "enable_zerocopy_send_client": false, 00:20:35.576 "zerocopy_threshold": 0, 00:20:35.576 "tls_version": 0, 00:20:35.577 "enable_ktls": false 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "sock_impl_set_options", 00:20:35.577 "params": { 00:20:35.577 "impl_name": "ssl", 00:20:35.577 "recv_buf_size": 4096, 00:20:35.577 "send_buf_size": 4096, 00:20:35.577 "enable_recv_pipe": true, 00:20:35.577 "enable_quickack": false, 00:20:35.577 "enable_placement_id": 0, 00:20:35.577 "enable_zerocopy_send_server": true, 00:20:35.577 "enable_zerocopy_send_client": false, 00:20:35.577 "zerocopy_threshold": 0, 00:20:35.577 "tls_version": 0, 00:20:35.577 "enable_ktls": false 00:20:35.577 } 00:20:35.577 } 00:20:35.577 ] 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "subsystem": "vmd", 00:20:35.577 "config": [] 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "subsystem": "accel", 00:20:35.577 "config": [ 00:20:35.577 { 00:20:35.577 "method": "accel_set_options", 00:20:35.577 "params": { 00:20:35.577 "small_cache_size": 128, 00:20:35.577 "large_cache_size": 16, 00:20:35.577 "task_count": 2048, 00:20:35.577 "sequence_count": 2048, 00:20:35.577 "buf_count": 2048 00:20:35.577 } 00:20:35.577 } 00:20:35.577 ] 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "subsystem": "bdev", 00:20:35.577 "config": [ 00:20:35.577 { 00:20:35.577 "method": "bdev_set_options", 00:20:35.577 "params": { 00:20:35.577 "bdev_io_pool_size": 65535, 00:20:35.577 "bdev_io_cache_size": 256, 00:20:35.577 "bdev_auto_examine": true, 00:20:35.577 "iobuf_small_cache_size": 128, 00:20:35.577 "iobuf_large_cache_size": 16 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "bdev_raid_set_options", 00:20:35.577 "params": { 00:20:35.577 "process_window_size_kb": 1024 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "bdev_iscsi_set_options", 00:20:35.577 "params": { 00:20:35.577 "timeout_sec": 30 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "bdev_nvme_set_options", 00:20:35.577 "params": { 00:20:35.577 "action_on_timeout": "none", 00:20:35.577 "timeout_us": 0, 00:20:35.577 "timeout_admin_us": 0, 00:20:35.577 "keep_alive_timeout_ms": 10000, 00:20:35.577 "transport_retry_count": 4, 00:20:35.577 "arbitration_burst": 0, 00:20:35.577 "low_priority_weight": 0, 00:20:35.577 "medium_priority_weight": 0, 00:20:35.577 "high_priority_weight": 0, 00:20:35.577 "nvme_adminq_poll_period_us": 10000, 00:20:35.577 "nvme_ioq_poll_period_us": 0, 00:20:35.577 "io_queue_requests": 0, 00:20:35.577 "delay_cmd_submit": true, 00:20:35.577 "bdev_retry_count": 3, 00:20:35.577 "transport_ack_timeout": 0, 00:20:35.577 "ctrlr_loss_timeout_sec": 0, 00:20:35.577 "reconnect_delay_sec": 0, 00:20:35.577 "fast_io_fail_timeout_sec": 0, 00:20:35.577 "generate_uuids": false, 00:20:35.577 "transport_tos": 0, 00:20:35.577 "io_path_stat": false, 00:20:35.577 "allow_accel_sequence": false 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "bdev_nvme_set_hotplug", 00:20:35.577 "params": { 00:20:35.577 "period_us": 100000, 00:20:35.577 "enable": false 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "bdev_malloc_create", 00:20:35.577 "params": { 00:20:35.577 "name": "malloc0", 00:20:35.577 "num_blocks": 8192, 00:20:35.577 "block_size": 4096, 00:20:35.577 "physical_block_size": 4096, 00:20:35.577 "uuid": "a2066833-be61-46d3-82ac-4ef8328abb82", 00:20:35.577 "optimal_io_boundary": 0 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "bdev_wait_for_examine" 00:20:35.577 } 00:20:35.577 ] 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "subsystem": "nbd", 00:20:35.577 "config": [] 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "subsystem": "scheduler", 00:20:35.577 "config": [ 00:20:35.577 { 00:20:35.577 "method": "framework_set_scheduler", 00:20:35.577 "params": { 00:20:35.577 "name": "static" 00:20:35.577 } 00:20:35.577 } 00:20:35.577 ] 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "subsystem": "nvmf", 00:20:35.577 "config": [ 00:20:35.577 { 00:20:35.577 "method": "nvmf_set_config", 00:20:35.577 "params": { 00:20:35.577 "discovery_filter": "match_any", 00:20:35.577 "admin_cmd_passthru": { 00:20:35.577 "identify_ctrlr": false 00:20:35.577 } 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "nvmf_set_max_subsystems", 00:20:35.577 "params": { 00:20:35.577 "max_subsystems": 1024 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "nvmf_set_crdt", 00:20:35.577 "params": { 00:20:35.577 "crdt1": 0, 00:20:35.577 "crdt2": 0, 00:20:35.577 "crdt3": 0 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "nvmf_create_transport", 00:20:35.577 "params": { 00:20:35.577 "trtype": "TCP", 00:20:35.577 "max_queue_depth": 128, 00:20:35.577 "max_io_qpairs_per_ctrlr": 127, 00:20:35.577 "in_capsule_data_size": 4096, 00:20:35.577 "max_io_size": 131072, 00:20:35.577 "io_unit_size": 131072, 00:20:35.577 "max_aq_depth": 128, 00:20:35.577 "num_shared_buffers": 511, 00:20:35.577 "buf_cache_size": 4294967295, 00:20:35.577 "dif_insert_or_strip": false, 00:20:35.577 "zcopy": false, 00:20:35.577 "c2h_success": false, 00:20:35.577 "sock_priority": 0, 00:20:35.577 "abort_timeout_sec": 1 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "nvmf_create_subsystem", 00:20:35.577 "params": { 00:20:35.577 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.577 "allow_any_host": false, 00:20:35.577 "serial_number": "SPDK00000000000001", 00:20:35.577 "model_number": "SPDK bdev Controller", 00:20:35.577 "max_namespaces": 10, 00:20:35.577 "min_cntlid": 1, 00:20:35.577 "max_cntlid": 65519, 00:20:35.577 "ana_reporting": false 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "nvmf_subsystem_add_host", 00:20:35.577 "params": { 00:20:35.577 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.577 "host": "nqn.2016-06.io.spdk:host1", 00:20:35.577 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "nvmf_subsystem_add_ns", 00:20:35.577 "params": { 00:20:35.577 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.577 "namespace": { 00:20:35.577 "nsid": 1, 00:20:35.577 "bdev_name": "malloc0", 00:20:35.577 "nguid": "A2066833BE6146D382AC4EF8328ABB82", 00:20:35.577 "uuid": "a2066833-be61-46d3-82ac-4ef8328abb82" 00:20:35.577 } 00:20:35.577 } 00:20:35.577 }, 00:20:35.577 { 00:20:35.577 "method": "nvmf_subsystem_add_listener", 00:20:35.577 "params": { 00:20:35.577 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.577 "listen_address": { 00:20:35.577 "trtype": "TCP", 00:20:35.577 "adrfam": "IPv4", 00:20:35.577 "traddr": "10.0.0.2", 00:20:35.577 "trsvcid": "4420" 00:20:35.577 }, 00:20:35.577 "secure_channel": true 00:20:35.577 } 00:20:35.577 } 00:20:35.577 ] 00:20:35.577 } 00:20:35.577 ] 00:20:35.577 }' 00:20:35.577 04:17:50 -- nvmf/common.sh@469 -- # nvmfpid=3975175 00:20:35.577 04:17:50 -- nvmf/common.sh@470 -- # waitforlisten 3975175 00:20:35.577 04:17:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:35.577 04:17:50 -- common/autotest_common.sh@819 -- # '[' -z 3975175 ']' 00:20:35.577 04:17:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:35.577 04:17:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:35.577 04:17:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:35.577 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:35.577 04:17:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:35.577 04:17:50 -- common/autotest_common.sh@10 -- # set +x 00:20:35.578 [2024-05-14 04:17:50.133033] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:35.578 [2024-05-14 04:17:50.133099] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:35.578 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.838 [2024-05-14 04:17:50.216044] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.838 [2024-05-14 04:17:50.269115] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:35.838 [2024-05-14 04:17:50.269206] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:35.838 [2024-05-14 04:17:50.269212] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:35.838 [2024-05-14 04:17:50.269217] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:35.838 [2024-05-14 04:17:50.269233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:36.098 [2024-05-14 04:17:50.444710] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:36.098 [2024-05-14 04:17:50.476739] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:36.098 [2024-05-14 04:17:50.476916] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:36.358 04:17:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:36.358 04:17:50 -- common/autotest_common.sh@852 -- # return 0 00:20:36.358 04:17:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:36.358 04:17:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:36.358 04:17:50 -- common/autotest_common.sh@10 -- # set +x 00:20:36.358 04:17:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:36.358 04:17:50 -- target/tls.sh@216 -- # bdevperf_pid=3975519 00:20:36.358 04:17:50 -- target/tls.sh@217 -- # waitforlisten 3975519 /var/tmp/bdevperf.sock 00:20:36.358 04:17:50 -- common/autotest_common.sh@819 -- # '[' -z 3975519 ']' 00:20:36.358 04:17:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:36.358 04:17:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:36.358 04:17:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:36.358 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:36.358 04:17:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:36.358 04:17:50 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:36.358 04:17:50 -- common/autotest_common.sh@10 -- # set +x 00:20:36.358 04:17:50 -- target/tls.sh@213 -- # echo '{ 00:20:36.358 "subsystems": [ 00:20:36.358 { 00:20:36.358 "subsystem": "iobuf", 00:20:36.358 "config": [ 00:20:36.358 { 00:20:36.358 "method": "iobuf_set_options", 00:20:36.358 "params": { 00:20:36.358 "small_pool_count": 8192, 00:20:36.358 "large_pool_count": 1024, 00:20:36.358 "small_bufsize": 8192, 00:20:36.358 "large_bufsize": 135168 00:20:36.358 } 00:20:36.358 } 00:20:36.358 ] 00:20:36.358 }, 00:20:36.358 { 00:20:36.358 "subsystem": "sock", 00:20:36.358 "config": [ 00:20:36.358 { 00:20:36.358 "method": "sock_impl_set_options", 00:20:36.358 "params": { 00:20:36.358 "impl_name": "posix", 00:20:36.358 "recv_buf_size": 2097152, 00:20:36.358 "send_buf_size": 2097152, 00:20:36.358 "enable_recv_pipe": true, 00:20:36.358 "enable_quickack": false, 00:20:36.358 "enable_placement_id": 0, 00:20:36.358 "enable_zerocopy_send_server": true, 00:20:36.358 "enable_zerocopy_send_client": false, 00:20:36.359 "zerocopy_threshold": 0, 00:20:36.359 "tls_version": 0, 00:20:36.359 "enable_ktls": false 00:20:36.359 } 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "method": "sock_impl_set_options", 00:20:36.359 "params": { 00:20:36.359 "impl_name": "ssl", 00:20:36.359 "recv_buf_size": 4096, 00:20:36.359 "send_buf_size": 4096, 00:20:36.359 "enable_recv_pipe": true, 00:20:36.359 "enable_quickack": false, 00:20:36.359 "enable_placement_id": 0, 00:20:36.359 "enable_zerocopy_send_server": true, 00:20:36.359 "enable_zerocopy_send_client": false, 00:20:36.359 "zerocopy_threshold": 0, 00:20:36.359 "tls_version": 0, 00:20:36.359 "enable_ktls": false 00:20:36.359 } 00:20:36.359 } 00:20:36.359 ] 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "subsystem": "vmd", 00:20:36.359 "config": [] 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "subsystem": "accel", 00:20:36.359 "config": [ 00:20:36.359 { 00:20:36.359 "method": "accel_set_options", 00:20:36.359 "params": { 00:20:36.359 "small_cache_size": 128, 00:20:36.359 "large_cache_size": 16, 00:20:36.359 "task_count": 2048, 00:20:36.359 "sequence_count": 2048, 00:20:36.359 "buf_count": 2048 00:20:36.359 } 00:20:36.359 } 00:20:36.359 ] 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "subsystem": "bdev", 00:20:36.359 "config": [ 00:20:36.359 { 00:20:36.359 "method": "bdev_set_options", 00:20:36.359 "params": { 00:20:36.359 "bdev_io_pool_size": 65535, 00:20:36.359 "bdev_io_cache_size": 256, 00:20:36.359 "bdev_auto_examine": true, 00:20:36.359 "iobuf_small_cache_size": 128, 00:20:36.359 "iobuf_large_cache_size": 16 00:20:36.359 } 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "method": "bdev_raid_set_options", 00:20:36.359 "params": { 00:20:36.359 "process_window_size_kb": 1024 00:20:36.359 } 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "method": "bdev_iscsi_set_options", 00:20:36.359 "params": { 00:20:36.359 "timeout_sec": 30 00:20:36.359 } 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "method": "bdev_nvme_set_options", 00:20:36.359 "params": { 00:20:36.359 "action_on_timeout": "none", 00:20:36.359 "timeout_us": 0, 00:20:36.359 "timeout_admin_us": 0, 00:20:36.359 "keep_alive_timeout_ms": 10000, 00:20:36.359 "transport_retry_count": 4, 00:20:36.359 "arbitration_burst": 0, 00:20:36.359 "low_priority_weight": 0, 00:20:36.359 "medium_priority_weight": 0, 00:20:36.359 "high_priority_weight": 0, 00:20:36.359 "nvme_adminq_poll_period_us": 10000, 00:20:36.359 "nvme_ioq_poll_period_us": 0, 00:20:36.359 "io_queue_requests": 512, 00:20:36.359 "delay_cmd_submit": true, 00:20:36.359 "bdev_retry_count": 3, 00:20:36.359 "transport_ack_timeout": 0, 00:20:36.359 "ctrlr_loss_timeout_sec": 0, 00:20:36.359 "reconnect_delay_sec": 0, 00:20:36.359 "fast_io_fail_timeout_sec": 0, 00:20:36.359 "generate_uuids": false, 00:20:36.359 "transport_tos": 0, 00:20:36.359 "io_path_stat": false, 00:20:36.359 "allow_accel_sequence": false 00:20:36.359 } 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "method": "bdev_nvme_attach_controller", 00:20:36.359 "params": { 00:20:36.359 "name": "TLSTEST", 00:20:36.359 "trtype": "TCP", 00:20:36.359 "adrfam": "IPv4", 00:20:36.359 "traddr": "10.0.0.2", 00:20:36.359 "trsvcid": "4420", 00:20:36.359 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.359 "prchk_reftag": false, 00:20:36.359 "prchk_guard": false, 00:20:36.359 "ctrlr_loss_timeout_sec": 0, 00:20:36.359 "reconnect_delay_sec": 0, 00:20:36.359 "fast_io_fail_timeout_sec": 0, 00:20:36.359 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:36.359 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:36.359 "hdgst": false, 00:20:36.359 "ddgst": false 00:20:36.359 } 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "method": "bdev_nvme_set_hotplug", 00:20:36.359 "params": { 00:20:36.359 "period_us": 100000, 00:20:36.359 "enable": false 00:20:36.359 } 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "method": "bdev_wait_for_examine" 00:20:36.359 } 00:20:36.359 ] 00:20:36.359 }, 00:20:36.359 { 00:20:36.359 "subsystem": "nbd", 00:20:36.359 "config": [] 00:20:36.359 } 00:20:36.359 ] 00:20:36.359 }' 00:20:36.619 [2024-05-14 04:17:50.969499] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:36.619 [2024-05-14 04:17:50.969592] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3975519 ] 00:20:36.619 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.619 [2024-05-14 04:17:51.025977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:36.619 [2024-05-14 04:17:51.076957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:36.619 [2024-05-14 04:17:51.192922] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:37.190 04:17:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:37.190 04:17:51 -- common/autotest_common.sh@852 -- # return 0 00:20:37.190 04:17:51 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:37.451 Running I/O for 10 seconds... 00:20:47.455 00:20:47.455 Latency(us) 00:20:47.455 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:47.455 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:47.455 Verification LBA range: start 0x0 length 0x2000 00:20:47.455 TLSTESTn1 : 10.06 1489.90 5.82 0.00 0.00 85742.32 6963.20 92624.21 00:20:47.455 =================================================================================================================== 00:20:47.455 Total : 1489.90 5.82 0.00 0.00 85742.32 6963.20 92624.21 00:20:47.455 0 00:20:47.455 04:18:01 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:47.455 04:18:01 -- target/tls.sh@223 -- # killprocess 3975519 00:20:47.455 04:18:01 -- common/autotest_common.sh@926 -- # '[' -z 3975519 ']' 00:20:47.455 04:18:01 -- common/autotest_common.sh@930 -- # kill -0 3975519 00:20:47.455 04:18:01 -- common/autotest_common.sh@931 -- # uname 00:20:47.455 04:18:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:47.455 04:18:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3975519 00:20:47.455 04:18:01 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:47.455 04:18:01 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:47.455 04:18:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3975519' 00:20:47.455 killing process with pid 3975519 00:20:47.455 04:18:01 -- common/autotest_common.sh@945 -- # kill 3975519 00:20:47.455 Received shutdown signal, test time was about 10.000000 seconds 00:20:47.455 00:20:47.455 Latency(us) 00:20:47.455 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:47.455 =================================================================================================================== 00:20:47.455 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:47.455 04:18:01 -- common/autotest_common.sh@950 -- # wait 3975519 00:20:47.717 04:18:02 -- target/tls.sh@224 -- # killprocess 3975175 00:20:47.717 04:18:02 -- common/autotest_common.sh@926 -- # '[' -z 3975175 ']' 00:20:47.717 04:18:02 -- common/autotest_common.sh@930 -- # kill -0 3975175 00:20:47.717 04:18:02 -- common/autotest_common.sh@931 -- # uname 00:20:47.717 04:18:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:47.717 04:18:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3975175 00:20:47.717 04:18:02 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:47.717 04:18:02 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:47.717 04:18:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3975175' 00:20:47.717 killing process with pid 3975175 00:20:47.717 04:18:02 -- common/autotest_common.sh@945 -- # kill 3975175 00:20:47.717 04:18:02 -- common/autotest_common.sh@950 -- # wait 3975175 00:20:47.717 04:18:02 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:20:47.717 04:18:02 -- target/tls.sh@227 -- # cleanup 00:20:47.717 04:18:02 -- target/tls.sh@15 -- # process_shm --id 0 00:20:47.717 04:18:02 -- common/autotest_common.sh@796 -- # type=--id 00:20:47.717 04:18:02 -- common/autotest_common.sh@797 -- # id=0 00:20:47.717 04:18:02 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:20:47.717 04:18:02 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:47.717 04:18:02 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:20:47.717 04:18:02 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:20:47.717 04:18:02 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:20:47.717 04:18:02 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:47.717 nvmf_trace.0 00:20:47.979 04:18:02 -- common/autotest_common.sh@811 -- # return 0 00:20:47.979 04:18:02 -- target/tls.sh@16 -- # killprocess 3975519 00:20:47.979 04:18:02 -- common/autotest_common.sh@926 -- # '[' -z 3975519 ']' 00:20:47.979 04:18:02 -- common/autotest_common.sh@930 -- # kill -0 3975519 00:20:47.979 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3975519) - No such process 00:20:47.979 04:18:02 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3975519 is not found' 00:20:47.979 Process with pid 3975519 is not found 00:20:47.979 04:18:02 -- target/tls.sh@17 -- # nvmftestfini 00:20:47.979 04:18:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:47.979 04:18:02 -- nvmf/common.sh@116 -- # sync 00:20:47.979 04:18:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:47.979 04:18:02 -- nvmf/common.sh@119 -- # set +e 00:20:47.979 04:18:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:47.979 04:18:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:47.979 rmmod nvme_tcp 00:20:47.979 rmmod nvme_fabrics 00:20:47.979 rmmod nvme_keyring 00:20:47.979 04:18:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:47.979 04:18:02 -- nvmf/common.sh@123 -- # set -e 00:20:47.979 04:18:02 -- nvmf/common.sh@124 -- # return 0 00:20:47.979 04:18:02 -- nvmf/common.sh@477 -- # '[' -n 3975175 ']' 00:20:47.979 04:18:02 -- nvmf/common.sh@478 -- # killprocess 3975175 00:20:47.979 04:18:02 -- common/autotest_common.sh@926 -- # '[' -z 3975175 ']' 00:20:47.979 04:18:02 -- common/autotest_common.sh@930 -- # kill -0 3975175 00:20:47.979 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3975175) - No such process 00:20:47.979 04:18:02 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3975175 is not found' 00:20:47.979 Process with pid 3975175 is not found 00:20:47.979 04:18:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:47.979 04:18:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:47.979 04:18:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:47.979 04:18:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:47.979 04:18:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:47.979 04:18:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:47.979 04:18:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:47.979 04:18:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:49.922 04:18:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:49.922 04:18:04 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:49.922 00:20:49.922 real 1m12.141s 00:20:49.922 user 1m42.624s 00:20:49.922 sys 0m29.265s 00:20:49.922 04:18:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:49.922 04:18:04 -- common/autotest_common.sh@10 -- # set +x 00:20:49.922 ************************************ 00:20:49.922 END TEST nvmf_tls 00:20:49.922 ************************************ 00:20:50.184 04:18:04 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:50.184 04:18:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:50.184 04:18:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:50.184 04:18:04 -- common/autotest_common.sh@10 -- # set +x 00:20:50.184 ************************************ 00:20:50.184 START TEST nvmf_fips 00:20:50.184 ************************************ 00:20:50.184 04:18:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:50.184 * Looking for test storage... 00:20:50.184 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:20:50.184 04:18:04 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:50.184 04:18:04 -- nvmf/common.sh@7 -- # uname -s 00:20:50.184 04:18:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:50.184 04:18:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:50.184 04:18:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:50.184 04:18:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:50.184 04:18:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:50.184 04:18:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:50.184 04:18:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:50.184 04:18:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:50.184 04:18:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:50.184 04:18:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:50.184 04:18:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:20:50.184 04:18:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:20:50.184 04:18:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:50.184 04:18:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:50.184 04:18:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:50.184 04:18:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:50.184 04:18:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:50.184 04:18:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:50.184 04:18:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:50.185 04:18:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:50.185 04:18:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:50.185 04:18:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:50.185 04:18:04 -- paths/export.sh@5 -- # export PATH 00:20:50.185 04:18:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:50.185 04:18:04 -- nvmf/common.sh@46 -- # : 0 00:20:50.185 04:18:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:50.185 04:18:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:50.185 04:18:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:50.185 04:18:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:50.185 04:18:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:50.185 04:18:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:50.185 04:18:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:50.185 04:18:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:50.185 04:18:04 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:50.185 04:18:04 -- fips/fips.sh@89 -- # check_openssl_version 00:20:50.185 04:18:04 -- fips/fips.sh@83 -- # local target=3.0.0 00:20:50.185 04:18:04 -- fips/fips.sh@85 -- # awk '{print $2}' 00:20:50.185 04:18:04 -- fips/fips.sh@85 -- # openssl version 00:20:50.185 04:18:04 -- fips/fips.sh@85 -- # ge 3.0.9 3.0.0 00:20:50.185 04:18:04 -- scripts/common.sh@375 -- # cmp_versions 3.0.9 '>=' 3.0.0 00:20:50.185 04:18:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:50.185 04:18:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:50.185 04:18:04 -- scripts/common.sh@335 -- # IFS=.-: 00:20:50.185 04:18:04 -- scripts/common.sh@335 -- # read -ra ver1 00:20:50.185 04:18:04 -- scripts/common.sh@336 -- # IFS=.-: 00:20:50.185 04:18:04 -- scripts/common.sh@336 -- # read -ra ver2 00:20:50.185 04:18:04 -- scripts/common.sh@337 -- # local 'op=>=' 00:20:50.185 04:18:04 -- scripts/common.sh@339 -- # ver1_l=3 00:20:50.185 04:18:04 -- scripts/common.sh@340 -- # ver2_l=3 00:20:50.185 04:18:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:50.185 04:18:04 -- scripts/common.sh@343 -- # case "$op" in 00:20:50.185 04:18:04 -- scripts/common.sh@347 -- # : 1 00:20:50.185 04:18:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:50.185 04:18:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:50.185 04:18:04 -- scripts/common.sh@364 -- # decimal 3 00:20:50.185 04:18:04 -- scripts/common.sh@352 -- # local d=3 00:20:50.185 04:18:04 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:50.185 04:18:04 -- scripts/common.sh@354 -- # echo 3 00:20:50.185 04:18:04 -- scripts/common.sh@364 -- # ver1[v]=3 00:20:50.185 04:18:04 -- scripts/common.sh@365 -- # decimal 3 00:20:50.185 04:18:04 -- scripts/common.sh@352 -- # local d=3 00:20:50.185 04:18:04 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:50.185 04:18:04 -- scripts/common.sh@354 -- # echo 3 00:20:50.185 04:18:04 -- scripts/common.sh@365 -- # ver2[v]=3 00:20:50.185 04:18:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:50.185 04:18:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:50.185 04:18:04 -- scripts/common.sh@363 -- # (( v++ )) 00:20:50.185 04:18:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:50.185 04:18:04 -- scripts/common.sh@364 -- # decimal 0 00:20:50.185 04:18:04 -- scripts/common.sh@352 -- # local d=0 00:20:50.185 04:18:04 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:50.185 04:18:04 -- scripts/common.sh@354 -- # echo 0 00:20:50.185 04:18:04 -- scripts/common.sh@364 -- # ver1[v]=0 00:20:50.185 04:18:04 -- scripts/common.sh@365 -- # decimal 0 00:20:50.185 04:18:04 -- scripts/common.sh@352 -- # local d=0 00:20:50.185 04:18:04 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:50.185 04:18:04 -- scripts/common.sh@354 -- # echo 0 00:20:50.185 04:18:04 -- scripts/common.sh@365 -- # ver2[v]=0 00:20:50.185 04:18:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:50.185 04:18:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:50.185 04:18:04 -- scripts/common.sh@363 -- # (( v++ )) 00:20:50.185 04:18:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:50.185 04:18:04 -- scripts/common.sh@364 -- # decimal 9 00:20:50.185 04:18:04 -- scripts/common.sh@352 -- # local d=9 00:20:50.185 04:18:04 -- scripts/common.sh@353 -- # [[ 9 =~ ^[0-9]+$ ]] 00:20:50.185 04:18:04 -- scripts/common.sh@354 -- # echo 9 00:20:50.185 04:18:04 -- scripts/common.sh@364 -- # ver1[v]=9 00:20:50.185 04:18:04 -- scripts/common.sh@365 -- # decimal 0 00:20:50.185 04:18:04 -- scripts/common.sh@352 -- # local d=0 00:20:50.185 04:18:04 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:50.185 04:18:04 -- scripts/common.sh@354 -- # echo 0 00:20:50.185 04:18:04 -- scripts/common.sh@365 -- # ver2[v]=0 00:20:50.185 04:18:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:50.185 04:18:04 -- scripts/common.sh@366 -- # return 0 00:20:50.185 04:18:04 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:20:50.185 04:18:04 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:20:50.185 04:18:04 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:20:50.185 04:18:04 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:20:50.185 04:18:04 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:20:50.185 04:18:04 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:20:50.185 04:18:04 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:20:50.185 04:18:04 -- fips/fips.sh@105 -- # export OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:20:50.185 04:18:04 -- fips/fips.sh@105 -- # OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:20:50.185 04:18:04 -- fips/fips.sh@114 -- # build_openssl_config 00:20:50.185 04:18:04 -- fips/fips.sh@37 -- # cat 00:20:50.185 04:18:04 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:20:50.185 04:18:04 -- fips/fips.sh@58 -- # cat - 00:20:50.185 04:18:04 -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:20:50.185 04:18:04 -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:20:50.185 04:18:04 -- fips/fips.sh@117 -- # mapfile -t providers 00:20:50.185 04:18:04 -- fips/fips.sh@117 -- # OPENSSL_CONF=spdk_fips.conf 00:20:50.185 04:18:04 -- fips/fips.sh@117 -- # openssl list -providers 00:20:50.185 04:18:04 -- fips/fips.sh@117 -- # grep name 00:20:50.446 04:18:04 -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:20:50.446 04:18:04 -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:20:50.446 04:18:04 -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:20:50.446 04:18:04 -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:20:50.446 04:18:04 -- common/autotest_common.sh@640 -- # local es=0 00:20:50.446 04:18:04 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:20:50.446 04:18:04 -- fips/fips.sh@128 -- # : 00:20:50.446 04:18:04 -- common/autotest_common.sh@628 -- # local arg=openssl 00:20:50.446 04:18:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:50.446 04:18:04 -- common/autotest_common.sh@632 -- # type -t openssl 00:20:50.446 04:18:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:50.446 04:18:04 -- common/autotest_common.sh@634 -- # type -P openssl 00:20:50.446 04:18:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:50.446 04:18:04 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:20:50.446 04:18:04 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:20:50.446 04:18:04 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:20:50.446 Error setting digest 00:20:50.446 00725982C07F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:373:Global default library context, Algorithm (MD5 : 97), Properties () 00:20:50.446 00725982C07F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:254: 00:20:50.446 04:18:04 -- common/autotest_common.sh@643 -- # es=1 00:20:50.446 04:18:04 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:50.446 04:18:04 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:50.446 04:18:04 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:50.446 04:18:04 -- fips/fips.sh@131 -- # nvmftestinit 00:20:50.446 04:18:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:50.446 04:18:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:50.446 04:18:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:50.446 04:18:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:50.446 04:18:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:50.446 04:18:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:50.446 04:18:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:50.446 04:18:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:50.446 04:18:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:50.446 04:18:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:50.446 04:18:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:50.446 04:18:04 -- common/autotest_common.sh@10 -- # set +x 00:20:58.592 04:18:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:58.592 04:18:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:58.592 04:18:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:58.592 04:18:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:58.592 04:18:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:58.592 04:18:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:58.592 04:18:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:58.592 04:18:11 -- nvmf/common.sh@294 -- # net_devs=() 00:20:58.592 04:18:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:58.592 04:18:11 -- nvmf/common.sh@295 -- # e810=() 00:20:58.592 04:18:11 -- nvmf/common.sh@295 -- # local -ga e810 00:20:58.592 04:18:11 -- nvmf/common.sh@296 -- # x722=() 00:20:58.592 04:18:11 -- nvmf/common.sh@296 -- # local -ga x722 00:20:58.592 04:18:11 -- nvmf/common.sh@297 -- # mlx=() 00:20:58.592 04:18:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:58.592 04:18:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:58.592 04:18:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:58.592 04:18:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:58.592 04:18:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:58.592 04:18:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:58.592 04:18:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:58.592 04:18:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:58.592 04:18:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:58.592 04:18:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:20:58.592 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:20:58.592 04:18:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:58.592 04:18:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:58.592 04:18:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:58.593 04:18:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:20:58.593 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:20:58.593 04:18:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:58.593 04:18:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:58.593 04:18:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:58.593 04:18:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:58.593 04:18:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:58.593 04:18:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:20:58.593 Found net devices under 0000:4b:00.0: cvl_0_0 00:20:58.593 04:18:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:58.593 04:18:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:58.593 04:18:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:58.593 04:18:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:58.593 04:18:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:58.593 04:18:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:20:58.593 Found net devices under 0000:4b:00.1: cvl_0_1 00:20:58.593 04:18:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:58.593 04:18:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:58.593 04:18:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:58.593 04:18:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:58.593 04:18:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:58.593 04:18:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:58.593 04:18:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:58.593 04:18:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:58.593 04:18:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:58.593 04:18:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:58.593 04:18:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:58.593 04:18:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:58.593 04:18:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:58.593 04:18:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:58.593 04:18:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:58.593 04:18:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:58.593 04:18:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:58.593 04:18:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:58.593 04:18:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:58.593 04:18:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:58.593 04:18:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:58.593 04:18:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:58.593 04:18:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:58.593 04:18:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:58.593 04:18:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:58.593 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:58.593 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.685 ms 00:20:58.593 00:20:58.593 --- 10.0.0.2 ping statistics --- 00:20:58.593 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:58.593 rtt min/avg/max/mdev = 0.685/0.685/0.685/0.000 ms 00:20:58.593 04:18:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:58.593 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:58.593 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.443 ms 00:20:58.593 00:20:58.593 --- 10.0.0.1 ping statistics --- 00:20:58.593 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:58.593 rtt min/avg/max/mdev = 0.443/0.443/0.443/0.000 ms 00:20:58.593 04:18:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:58.593 04:18:12 -- nvmf/common.sh@410 -- # return 0 00:20:58.593 04:18:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:58.593 04:18:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:58.593 04:18:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:58.593 04:18:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:58.593 04:18:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:58.593 04:18:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:58.593 04:18:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:58.593 04:18:12 -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:20:58.593 04:18:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:58.593 04:18:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:58.593 04:18:12 -- common/autotest_common.sh@10 -- # set +x 00:20:58.593 04:18:12 -- nvmf/common.sh@469 -- # nvmfpid=3982490 00:20:58.593 04:18:12 -- nvmf/common.sh@470 -- # waitforlisten 3982490 00:20:58.593 04:18:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:58.593 04:18:12 -- common/autotest_common.sh@819 -- # '[' -z 3982490 ']' 00:20:58.593 04:18:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:58.593 04:18:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:58.593 04:18:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:58.593 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:58.593 04:18:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:58.593 04:18:12 -- common/autotest_common.sh@10 -- # set +x 00:20:58.593 [2024-05-14 04:18:12.183247] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:58.593 [2024-05-14 04:18:12.183307] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:58.593 EAL: No free 2048 kB hugepages reported on node 1 00:20:58.593 [2024-05-14 04:18:12.264660] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:58.593 [2024-05-14 04:18:12.329689] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:58.593 [2024-05-14 04:18:12.329822] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:58.593 [2024-05-14 04:18:12.329831] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:58.593 [2024-05-14 04:18:12.329839] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:58.593 [2024-05-14 04:18:12.329864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:58.593 04:18:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:58.593 04:18:12 -- common/autotest_common.sh@852 -- # return 0 00:20:58.593 04:18:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:58.593 04:18:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:58.593 04:18:12 -- common/autotest_common.sh@10 -- # set +x 00:20:58.593 04:18:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:58.593 04:18:12 -- fips/fips.sh@134 -- # trap cleanup EXIT 00:20:58.593 04:18:12 -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:58.593 04:18:12 -- fips/fips.sh@138 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:58.593 04:18:12 -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:58.593 04:18:12 -- fips/fips.sh@140 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:58.593 04:18:12 -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:58.593 04:18:12 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:58.593 04:18:12 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:58.593 [2024-05-14 04:18:13.113755] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:58.593 [2024-05-14 04:18:13.129741] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:58.593 [2024-05-14 04:18:13.130025] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:58.593 malloc0 00:20:58.854 04:18:13 -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:58.854 04:18:13 -- fips/fips.sh@148 -- # bdevperf_pid=3982639 00:20:58.854 04:18:13 -- fips/fips.sh@149 -- # waitforlisten 3982639 /var/tmp/bdevperf.sock 00:20:58.854 04:18:13 -- fips/fips.sh@146 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:58.854 04:18:13 -- common/autotest_common.sh@819 -- # '[' -z 3982639 ']' 00:20:58.854 04:18:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:58.854 04:18:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:58.854 04:18:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:58.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:58.854 04:18:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:58.854 04:18:13 -- common/autotest_common.sh@10 -- # set +x 00:20:58.854 [2024-05-14 04:18:13.248065] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:58.854 [2024-05-14 04:18:13.248137] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3982639 ] 00:20:58.854 EAL: No free 2048 kB hugepages reported on node 1 00:20:58.854 [2024-05-14 04:18:13.304767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:58.854 [2024-05-14 04:18:13.367191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:59.425 04:18:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:59.425 04:18:14 -- common/autotest_common.sh@852 -- # return 0 00:20:59.425 04:18:14 -- fips/fips.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:59.686 [2024-05-14 04:18:14.147127] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:59.686 TLSTESTn1 00:20:59.686 04:18:14 -- fips/fips.sh@155 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:59.948 Running I/O for 10 seconds... 00:21:09.948 00:21:09.948 Latency(us) 00:21:09.948 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:09.948 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:09.948 Verification LBA range: start 0x0 length 0x2000 00:21:09.948 TLSTESTn1 : 10.06 1447.36 5.65 0.00 0.00 88229.61 8465.07 91750.40 00:21:09.948 =================================================================================================================== 00:21:09.948 Total : 1447.36 5.65 0.00 0.00 88229.61 8465.07 91750.40 00:21:09.948 0 00:21:09.948 04:18:24 -- fips/fips.sh@1 -- # cleanup 00:21:09.948 04:18:24 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:09.948 04:18:24 -- common/autotest_common.sh@796 -- # type=--id 00:21:09.948 04:18:24 -- common/autotest_common.sh@797 -- # id=0 00:21:09.948 04:18:24 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:21:09.948 04:18:24 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:09.948 04:18:24 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:21:09.948 04:18:24 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:21:09.948 04:18:24 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:21:09.948 04:18:24 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:09.948 nvmf_trace.0 00:21:09.948 04:18:24 -- common/autotest_common.sh@811 -- # return 0 00:21:09.948 04:18:24 -- fips/fips.sh@16 -- # killprocess 3982639 00:21:09.948 04:18:24 -- common/autotest_common.sh@926 -- # '[' -z 3982639 ']' 00:21:09.948 04:18:24 -- common/autotest_common.sh@930 -- # kill -0 3982639 00:21:09.948 04:18:24 -- common/autotest_common.sh@931 -- # uname 00:21:09.948 04:18:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:09.948 04:18:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3982639 00:21:10.209 04:18:24 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:10.209 04:18:24 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:10.209 04:18:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3982639' 00:21:10.209 killing process with pid 3982639 00:21:10.209 04:18:24 -- common/autotest_common.sh@945 -- # kill 3982639 00:21:10.209 Received shutdown signal, test time was about 10.000000 seconds 00:21:10.209 00:21:10.209 Latency(us) 00:21:10.209 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:10.209 =================================================================================================================== 00:21:10.209 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:10.209 04:18:24 -- common/autotest_common.sh@950 -- # wait 3982639 00:21:10.209 04:18:24 -- fips/fips.sh@17 -- # nvmftestfini 00:21:10.209 04:18:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:10.209 04:18:24 -- nvmf/common.sh@116 -- # sync 00:21:10.209 04:18:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:10.209 04:18:24 -- nvmf/common.sh@119 -- # set +e 00:21:10.209 04:18:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:10.209 04:18:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:10.209 rmmod nvme_tcp 00:21:10.209 rmmod nvme_fabrics 00:21:10.209 rmmod nvme_keyring 00:21:10.209 04:18:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:10.209 04:18:24 -- nvmf/common.sh@123 -- # set -e 00:21:10.209 04:18:24 -- nvmf/common.sh@124 -- # return 0 00:21:10.209 04:18:24 -- nvmf/common.sh@477 -- # '[' -n 3982490 ']' 00:21:10.209 04:18:24 -- nvmf/common.sh@478 -- # killprocess 3982490 00:21:10.209 04:18:24 -- common/autotest_common.sh@926 -- # '[' -z 3982490 ']' 00:21:10.209 04:18:24 -- common/autotest_common.sh@930 -- # kill -0 3982490 00:21:10.209 04:18:24 -- common/autotest_common.sh@931 -- # uname 00:21:10.209 04:18:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:10.209 04:18:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3982490 00:21:10.470 04:18:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:10.470 04:18:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:10.470 04:18:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3982490' 00:21:10.470 killing process with pid 3982490 00:21:10.470 04:18:24 -- common/autotest_common.sh@945 -- # kill 3982490 00:21:10.470 04:18:24 -- common/autotest_common.sh@950 -- # wait 3982490 00:21:10.470 04:18:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:10.470 04:18:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:10.470 04:18:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:10.470 04:18:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:10.470 04:18:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:10.470 04:18:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:10.470 04:18:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:10.470 04:18:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:13.021 04:18:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:13.021 04:18:26 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:13.021 00:21:13.021 real 0m22.473s 00:21:13.021 user 0m21.917s 00:21:13.021 sys 0m11.033s 00:21:13.021 04:18:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:13.021 04:18:26 -- common/autotest_common.sh@10 -- # set +x 00:21:13.021 ************************************ 00:21:13.021 END TEST nvmf_fips 00:21:13.021 ************************************ 00:21:13.021 04:18:27 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:13.021 04:18:27 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:13.021 04:18:27 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:13.021 04:18:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:13.021 04:18:27 -- common/autotest_common.sh@10 -- # set +x 00:21:13.021 ************************************ 00:21:13.021 START TEST nvmf_fuzz 00:21:13.021 ************************************ 00:21:13.021 04:18:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:13.021 * Looking for test storage... 00:21:13.021 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:13.021 04:18:27 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:13.021 04:18:27 -- nvmf/common.sh@7 -- # uname -s 00:21:13.021 04:18:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:13.021 04:18:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:13.021 04:18:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:13.021 04:18:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:13.021 04:18:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:13.021 04:18:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:13.021 04:18:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:13.021 04:18:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:13.021 04:18:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:13.021 04:18:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:13.021 04:18:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:13.021 04:18:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:13.021 04:18:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:13.021 04:18:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:13.021 04:18:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:13.021 04:18:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:13.021 04:18:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:13.021 04:18:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:13.021 04:18:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:13.021 04:18:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:13.021 04:18:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:13.021 04:18:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:13.021 04:18:27 -- paths/export.sh@5 -- # export PATH 00:21:13.021 04:18:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:13.021 04:18:27 -- nvmf/common.sh@46 -- # : 0 00:21:13.021 04:18:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:13.021 04:18:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:13.021 04:18:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:13.021 04:18:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:13.021 04:18:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:13.021 04:18:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:13.021 04:18:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:13.021 04:18:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:13.021 04:18:27 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:13.021 04:18:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:13.021 04:18:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:13.021 04:18:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:13.021 04:18:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:13.021 04:18:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:13.021 04:18:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:13.022 04:18:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:13.022 04:18:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:13.022 04:18:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:13.022 04:18:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:13.022 04:18:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:13.022 04:18:27 -- common/autotest_common.sh@10 -- # set +x 00:21:19.614 04:18:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:19.614 04:18:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:19.614 04:18:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:19.614 04:18:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:19.614 04:18:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:19.614 04:18:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:19.614 04:18:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:19.614 04:18:33 -- nvmf/common.sh@294 -- # net_devs=() 00:21:19.614 04:18:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:19.614 04:18:33 -- nvmf/common.sh@295 -- # e810=() 00:21:19.614 04:18:33 -- nvmf/common.sh@295 -- # local -ga e810 00:21:19.614 04:18:33 -- nvmf/common.sh@296 -- # x722=() 00:21:19.614 04:18:33 -- nvmf/common.sh@296 -- # local -ga x722 00:21:19.614 04:18:33 -- nvmf/common.sh@297 -- # mlx=() 00:21:19.614 04:18:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:19.614 04:18:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:19.614 04:18:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:19.614 04:18:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:19.614 04:18:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:19.614 04:18:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:19.614 04:18:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:21:19.614 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:21:19.614 04:18:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:19.614 04:18:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:21:19.614 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:21:19.614 04:18:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:19.614 04:18:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:19.614 04:18:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:19.614 04:18:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:19.614 04:18:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:19.614 04:18:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:21:19.614 Found net devices under 0000:4b:00.0: cvl_0_0 00:21:19.614 04:18:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:19.614 04:18:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:19.614 04:18:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:19.614 04:18:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:19.614 04:18:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:19.614 04:18:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:21:19.614 Found net devices under 0000:4b:00.1: cvl_0_1 00:21:19.614 04:18:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:19.614 04:18:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:19.614 04:18:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:19.614 04:18:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:19.614 04:18:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:19.614 04:18:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:19.614 04:18:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:19.614 04:18:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:19.614 04:18:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:19.614 04:18:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:19.614 04:18:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:19.614 04:18:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:19.614 04:18:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:19.614 04:18:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:19.614 04:18:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:19.614 04:18:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:19.614 04:18:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:19.614 04:18:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:19.614 04:18:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:19.614 04:18:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:19.614 04:18:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:19.614 04:18:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:19.614 04:18:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:19.614 04:18:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:19.614 04:18:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:19.614 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:19.614 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.670 ms 00:21:19.614 00:21:19.614 --- 10.0.0.2 ping statistics --- 00:21:19.614 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:19.614 rtt min/avg/max/mdev = 0.670/0.670/0.670/0.000 ms 00:21:19.614 04:18:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:19.614 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:19.614 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.435 ms 00:21:19.614 00:21:19.614 --- 10.0.0.1 ping statistics --- 00:21:19.614 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:19.614 rtt min/avg/max/mdev = 0.435/0.435/0.435/0.000 ms 00:21:19.614 04:18:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:19.614 04:18:34 -- nvmf/common.sh@410 -- # return 0 00:21:19.614 04:18:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:19.614 04:18:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:19.614 04:18:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:19.614 04:18:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:19.614 04:18:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:19.614 04:18:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:19.614 04:18:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:19.614 04:18:34 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3989041 00:21:19.614 04:18:34 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:19.614 04:18:34 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:19.614 04:18:34 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3989041 00:21:19.614 04:18:34 -- common/autotest_common.sh@819 -- # '[' -z 3989041 ']' 00:21:19.614 04:18:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:19.614 04:18:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:19.614 04:18:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:19.614 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:19.614 04:18:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:19.614 04:18:34 -- common/autotest_common.sh@10 -- # set +x 00:21:20.557 04:18:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:20.557 04:18:35 -- common/autotest_common.sh@852 -- # return 0 00:21:20.557 04:18:35 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:20.557 04:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:20.557 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:21:20.557 04:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:20.557 04:18:35 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:20.557 04:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:20.557 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:21:20.557 Malloc0 00:21:20.557 04:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:20.557 04:18:35 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:20.557 04:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:20.557 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:21:20.557 04:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:20.557 04:18:35 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:20.557 04:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:20.557 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:21:20.557 04:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:20.557 04:18:35 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:20.557 04:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:20.557 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:21:20.557 04:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:20.557 04:18:35 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:20.557 04:18:35 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:21:52.682 Fuzzing completed. Shutting down the fuzz application 00:21:52.682 00:21:52.682 Dumping successful admin opcodes: 00:21:52.682 8, 9, 10, 24, 00:21:52.682 Dumping successful io opcodes: 00:21:52.682 0, 9, 00:21:52.682 NS: 0x200003aeff00 I/O qp, Total commands completed: 941749, total successful commands: 5491, random_seed: 3854126464 00:21:52.682 NS: 0x200003aeff00 admin qp, Total commands completed: 120988, total successful commands: 992, random_seed: 3883002560 00:21:52.682 04:19:05 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:21:52.682 Fuzzing completed. Shutting down the fuzz application 00:21:52.682 00:21:52.682 Dumping successful admin opcodes: 00:21:52.682 24, 00:21:52.682 Dumping successful io opcodes: 00:21:52.682 00:21:52.682 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 400538833 00:21:52.682 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 400625013 00:21:52.682 04:19:06 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:52.682 04:19:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.682 04:19:06 -- common/autotest_common.sh@10 -- # set +x 00:21:52.682 04:19:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.682 04:19:06 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:21:52.682 04:19:06 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:21:52.682 04:19:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:52.682 04:19:06 -- nvmf/common.sh@116 -- # sync 00:21:52.682 04:19:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:52.682 04:19:06 -- nvmf/common.sh@119 -- # set +e 00:21:52.682 04:19:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:52.682 04:19:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:52.682 rmmod nvme_tcp 00:21:52.682 rmmod nvme_fabrics 00:21:52.682 rmmod nvme_keyring 00:21:52.682 04:19:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:52.682 04:19:06 -- nvmf/common.sh@123 -- # set -e 00:21:52.682 04:19:06 -- nvmf/common.sh@124 -- # return 0 00:21:52.682 04:19:06 -- nvmf/common.sh@477 -- # '[' -n 3989041 ']' 00:21:52.683 04:19:06 -- nvmf/common.sh@478 -- # killprocess 3989041 00:21:52.683 04:19:06 -- common/autotest_common.sh@926 -- # '[' -z 3989041 ']' 00:21:52.683 04:19:06 -- common/autotest_common.sh@930 -- # kill -0 3989041 00:21:52.683 04:19:06 -- common/autotest_common.sh@931 -- # uname 00:21:52.683 04:19:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:52.683 04:19:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3989041 00:21:52.683 04:19:06 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:52.683 04:19:06 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:52.683 04:19:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3989041' 00:21:52.683 killing process with pid 3989041 00:21:52.683 04:19:06 -- common/autotest_common.sh@945 -- # kill 3989041 00:21:52.683 04:19:06 -- common/autotest_common.sh@950 -- # wait 3989041 00:21:52.683 04:19:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:52.683 04:19:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:52.683 04:19:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:52.683 04:19:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:52.683 04:19:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:52.683 04:19:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:52.683 04:19:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:52.683 04:19:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:54.597 04:19:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:54.597 04:19:09 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:21:54.597 00:21:54.597 real 0m42.045s 00:21:54.597 user 0m56.144s 00:21:54.597 sys 0m15.110s 00:21:54.597 04:19:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:54.597 04:19:09 -- common/autotest_common.sh@10 -- # set +x 00:21:54.597 ************************************ 00:21:54.597 END TEST nvmf_fuzz 00:21:54.597 ************************************ 00:21:54.597 04:19:09 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:54.597 04:19:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:54.597 04:19:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:54.597 04:19:09 -- common/autotest_common.sh@10 -- # set +x 00:21:54.598 ************************************ 00:21:54.598 START TEST nvmf_multiconnection 00:21:54.598 ************************************ 00:21:54.598 04:19:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:54.858 * Looking for test storage... 00:21:54.858 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:54.858 04:19:09 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:54.858 04:19:09 -- nvmf/common.sh@7 -- # uname -s 00:21:54.858 04:19:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:54.858 04:19:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:54.858 04:19:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:54.858 04:19:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:54.858 04:19:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:54.858 04:19:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:54.858 04:19:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:54.858 04:19:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:54.858 04:19:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:54.858 04:19:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:54.858 04:19:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:54.858 04:19:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:54.858 04:19:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:54.858 04:19:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:54.858 04:19:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:54.858 04:19:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:54.858 04:19:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:54.858 04:19:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:54.858 04:19:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:54.858 04:19:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.858 04:19:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.859 04:19:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.859 04:19:09 -- paths/export.sh@5 -- # export PATH 00:21:54.859 04:19:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.859 04:19:09 -- nvmf/common.sh@46 -- # : 0 00:21:54.859 04:19:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:54.859 04:19:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:54.859 04:19:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:54.859 04:19:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:54.859 04:19:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:54.859 04:19:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:54.859 04:19:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:54.859 04:19:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:54.859 04:19:09 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:54.859 04:19:09 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:54.859 04:19:09 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:21:54.859 04:19:09 -- target/multiconnection.sh@16 -- # nvmftestinit 00:21:54.859 04:19:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:54.859 04:19:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:54.859 04:19:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:54.859 04:19:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:54.859 04:19:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:54.859 04:19:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:54.859 04:19:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:54.859 04:19:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:54.859 04:19:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:54.859 04:19:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:54.859 04:19:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:54.859 04:19:09 -- common/autotest_common.sh@10 -- # set +x 00:22:01.449 04:19:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:01.449 04:19:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:01.449 04:19:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:01.449 04:19:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:01.449 04:19:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:01.449 04:19:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:01.449 04:19:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:01.449 04:19:15 -- nvmf/common.sh@294 -- # net_devs=() 00:22:01.449 04:19:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:01.449 04:19:15 -- nvmf/common.sh@295 -- # e810=() 00:22:01.449 04:19:15 -- nvmf/common.sh@295 -- # local -ga e810 00:22:01.449 04:19:15 -- nvmf/common.sh@296 -- # x722=() 00:22:01.449 04:19:15 -- nvmf/common.sh@296 -- # local -ga x722 00:22:01.449 04:19:15 -- nvmf/common.sh@297 -- # mlx=() 00:22:01.449 04:19:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:01.450 04:19:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:01.450 04:19:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:01.450 04:19:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:01.450 04:19:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:01.450 04:19:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:01.450 04:19:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:22:01.450 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:22:01.450 04:19:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:01.450 04:19:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:22:01.450 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:22:01.450 04:19:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:01.450 04:19:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:01.450 04:19:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:01.450 04:19:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:01.450 04:19:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:01.450 04:19:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:22:01.450 Found net devices under 0000:4b:00.0: cvl_0_0 00:22:01.450 04:19:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:01.450 04:19:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:01.450 04:19:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:01.450 04:19:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:01.450 04:19:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:01.450 04:19:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:22:01.450 Found net devices under 0000:4b:00.1: cvl_0_1 00:22:01.450 04:19:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:01.450 04:19:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:01.450 04:19:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:01.450 04:19:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:01.450 04:19:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:01.450 04:19:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:01.450 04:19:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:01.450 04:19:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:01.450 04:19:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:01.450 04:19:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:01.450 04:19:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:01.450 04:19:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:01.450 04:19:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:01.450 04:19:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:01.450 04:19:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:01.450 04:19:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:01.450 04:19:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:01.450 04:19:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:01.712 04:19:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:01.712 04:19:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:01.712 04:19:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:01.712 04:19:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:01.712 04:19:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:01.712 04:19:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:01.712 04:19:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:01.974 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:01.974 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.612 ms 00:22:01.974 00:22:01.974 --- 10.0.0.2 ping statistics --- 00:22:01.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:01.974 rtt min/avg/max/mdev = 0.612/0.612/0.612/0.000 ms 00:22:01.974 04:19:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:01.974 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:01.974 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.444 ms 00:22:01.974 00:22:01.974 --- 10.0.0.1 ping statistics --- 00:22:01.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:01.974 rtt min/avg/max/mdev = 0.444/0.444/0.444/0.000 ms 00:22:01.974 04:19:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:01.974 04:19:16 -- nvmf/common.sh@410 -- # return 0 00:22:01.974 04:19:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:01.974 04:19:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:01.974 04:19:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:01.974 04:19:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:01.974 04:19:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:01.974 04:19:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:01.974 04:19:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:01.974 04:19:16 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:01.974 04:19:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:01.974 04:19:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:01.974 04:19:16 -- common/autotest_common.sh@10 -- # set +x 00:22:01.974 04:19:16 -- nvmf/common.sh@469 -- # nvmfpid=3999644 00:22:01.974 04:19:16 -- nvmf/common.sh@470 -- # waitforlisten 3999644 00:22:01.974 04:19:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:01.974 04:19:16 -- common/autotest_common.sh@819 -- # '[' -z 3999644 ']' 00:22:01.974 04:19:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:01.974 04:19:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:01.974 04:19:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:01.974 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:01.974 04:19:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:01.974 04:19:16 -- common/autotest_common.sh@10 -- # set +x 00:22:01.974 [2024-05-14 04:19:16.409421] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:22:01.974 [2024-05-14 04:19:16.409484] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:01.974 EAL: No free 2048 kB hugepages reported on node 1 00:22:01.974 [2024-05-14 04:19:16.476167] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:01.974 [2024-05-14 04:19:16.540639] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:01.974 [2024-05-14 04:19:16.540773] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:01.974 [2024-05-14 04:19:16.540783] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:01.974 [2024-05-14 04:19:16.540791] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:01.974 [2024-05-14 04:19:16.540952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:01.974 [2024-05-14 04:19:16.541065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:01.974 [2024-05-14 04:19:16.541222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:01.974 [2024-05-14 04:19:16.541223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:02.918 04:19:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:02.918 04:19:17 -- common/autotest_common.sh@852 -- # return 0 00:22:02.918 04:19:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:02.918 04:19:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:02.918 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.918 04:19:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:02.918 04:19:17 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:02.918 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.918 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.918 [2024-05-14 04:19:17.224490] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:02.918 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.918 04:19:17 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:02.918 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.918 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:02.918 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.918 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.918 Malloc1 00:22:02.918 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.918 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 [2024-05-14 04:19:17.291912] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.919 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 Malloc2 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.919 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 Malloc3 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.919 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 Malloc4 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.919 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 Malloc5 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:02.919 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.919 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.919 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:02.919 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:02.919 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.180 Malloc6 00:22:03.180 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.180 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:03.180 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.180 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.180 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.180 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:03.180 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.180 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.180 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.180 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:03.180 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.180 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.180 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.180 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:03.180 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:03.180 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.180 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.180 Malloc7 00:22:03.180 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.180 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:03.180 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.180 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.180 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.180 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:03.180 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:03.181 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 Malloc8 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:03.181 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 Malloc9 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:03.181 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 Malloc10 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.181 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.181 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:03.181 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.181 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.442 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.442 04:19:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:03.442 04:19:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:03.442 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.442 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.442 Malloc11 00:22:03.442 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.442 04:19:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:03.442 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.442 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.442 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.442 04:19:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:03.442 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.442 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.442 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.442 04:19:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:03.442 04:19:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:03.442 04:19:17 -- common/autotest_common.sh@10 -- # set +x 00:22:03.442 04:19:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:03.442 04:19:17 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:03.442 04:19:17 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:03.442 04:19:17 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:04.828 04:19:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:04.828 04:19:19 -- common/autotest_common.sh@1177 -- # local i=0 00:22:04.828 04:19:19 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:04.828 04:19:19 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:04.828 04:19:19 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:07.374 04:19:21 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:07.374 04:19:21 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:07.374 04:19:21 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:22:07.374 04:19:21 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:07.374 04:19:21 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:07.374 04:19:21 -- common/autotest_common.sh@1187 -- # return 0 00:22:07.374 04:19:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:07.374 04:19:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:08.759 04:19:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:08.759 04:19:22 -- common/autotest_common.sh@1177 -- # local i=0 00:22:08.759 04:19:22 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:08.759 04:19:22 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:08.759 04:19:22 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:10.673 04:19:24 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:10.673 04:19:24 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:10.673 04:19:24 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:22:10.673 04:19:24 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:10.673 04:19:24 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:10.673 04:19:24 -- common/autotest_common.sh@1187 -- # return 0 00:22:10.673 04:19:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:10.673 04:19:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:12.058 04:19:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:12.058 04:19:26 -- common/autotest_common.sh@1177 -- # local i=0 00:22:12.058 04:19:26 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:12.058 04:19:26 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:12.058 04:19:26 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:14.018 04:19:28 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:14.018 04:19:28 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:14.018 04:19:28 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:22:14.018 04:19:28 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:14.018 04:19:28 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:14.018 04:19:28 -- common/autotest_common.sh@1187 -- # return 0 00:22:14.019 04:19:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.019 04:19:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:15.943 04:19:30 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:15.943 04:19:30 -- common/autotest_common.sh@1177 -- # local i=0 00:22:15.943 04:19:30 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:15.943 04:19:30 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:15.943 04:19:30 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:17.857 04:19:32 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:17.857 04:19:32 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:17.857 04:19:32 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:22:17.857 04:19:32 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:17.857 04:19:32 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:17.857 04:19:32 -- common/autotest_common.sh@1187 -- # return 0 00:22:17.857 04:19:32 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.857 04:19:32 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:19.773 04:19:33 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:19.773 04:19:33 -- common/autotest_common.sh@1177 -- # local i=0 00:22:19.773 04:19:33 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:19.773 04:19:33 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:19.773 04:19:33 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:21.687 04:19:35 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:21.687 04:19:35 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:21.687 04:19:35 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:22:21.687 04:19:35 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:21.687 04:19:35 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:21.687 04:19:35 -- common/autotest_common.sh@1187 -- # return 0 00:22:21.687 04:19:35 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:21.687 04:19:35 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:23.072 04:19:37 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:23.072 04:19:37 -- common/autotest_common.sh@1177 -- # local i=0 00:22:23.072 04:19:37 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:23.072 04:19:37 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:23.072 04:19:37 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:24.988 04:19:39 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:24.988 04:19:39 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:24.988 04:19:39 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:22:25.249 04:19:39 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:25.249 04:19:39 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:25.249 04:19:39 -- common/autotest_common.sh@1187 -- # return 0 00:22:25.249 04:19:39 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.249 04:19:39 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:27.161 04:19:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:27.161 04:19:41 -- common/autotest_common.sh@1177 -- # local i=0 00:22:27.161 04:19:41 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:27.161 04:19:41 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:27.161 04:19:41 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:29.075 04:19:43 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:29.075 04:19:43 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:29.075 04:19:43 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:22:29.075 04:19:43 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:29.075 04:19:43 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:29.075 04:19:43 -- common/autotest_common.sh@1187 -- # return 0 00:22:29.075 04:19:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.075 04:19:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:30.994 04:19:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:30.994 04:19:45 -- common/autotest_common.sh@1177 -- # local i=0 00:22:30.994 04:19:45 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:30.994 04:19:45 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:30.995 04:19:45 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:32.908 04:19:47 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:32.908 04:19:47 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:32.908 04:19:47 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:22:32.908 04:19:47 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:32.908 04:19:47 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:32.908 04:19:47 -- common/autotest_common.sh@1187 -- # return 0 00:22:32.908 04:19:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:32.908 04:19:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:34.819 04:19:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:34.819 04:19:48 -- common/autotest_common.sh@1177 -- # local i=0 00:22:34.819 04:19:48 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:34.819 04:19:48 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:34.819 04:19:48 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:36.732 04:19:50 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:36.732 04:19:50 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:36.732 04:19:50 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:22:36.732 04:19:50 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:36.732 04:19:50 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:36.732 04:19:50 -- common/autotest_common.sh@1187 -- # return 0 00:22:36.732 04:19:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:36.732 04:19:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:38.685 04:19:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:38.685 04:19:52 -- common/autotest_common.sh@1177 -- # local i=0 00:22:38.685 04:19:52 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:38.685 04:19:52 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:38.685 04:19:52 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:40.595 04:19:54 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:40.595 04:19:54 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:40.595 04:19:54 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:22:40.595 04:19:54 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:40.595 04:19:54 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:40.595 04:19:54 -- common/autotest_common.sh@1187 -- # return 0 00:22:40.595 04:19:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.595 04:19:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:42.507 04:19:56 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:42.507 04:19:56 -- common/autotest_common.sh@1177 -- # local i=0 00:22:42.507 04:19:56 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:42.507 04:19:56 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:42.507 04:19:56 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:44.418 04:19:58 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:44.418 04:19:58 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:44.418 04:19:58 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:22:44.418 04:19:58 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:44.418 04:19:58 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:44.418 04:19:58 -- common/autotest_common.sh@1187 -- # return 0 00:22:44.418 04:19:58 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:44.418 [global] 00:22:44.418 thread=1 00:22:44.418 invalidate=1 00:22:44.418 rw=read 00:22:44.418 time_based=1 00:22:44.418 runtime=10 00:22:44.418 ioengine=libaio 00:22:44.418 direct=1 00:22:44.418 bs=262144 00:22:44.418 iodepth=64 00:22:44.418 norandommap=1 00:22:44.418 numjobs=1 00:22:44.418 00:22:44.418 [job0] 00:22:44.418 filename=/dev/nvme0n1 00:22:44.418 [job1] 00:22:44.418 filename=/dev/nvme10n1 00:22:44.418 [job2] 00:22:44.418 filename=/dev/nvme1n1 00:22:44.418 [job3] 00:22:44.418 filename=/dev/nvme2n1 00:22:44.418 [job4] 00:22:44.418 filename=/dev/nvme3n1 00:22:44.418 [job5] 00:22:44.418 filename=/dev/nvme4n1 00:22:44.418 [job6] 00:22:44.418 filename=/dev/nvme5n1 00:22:44.418 [job7] 00:22:44.418 filename=/dev/nvme6n1 00:22:44.418 [job8] 00:22:44.418 filename=/dev/nvme7n1 00:22:44.418 [job9] 00:22:44.418 filename=/dev/nvme8n1 00:22:44.418 [job10] 00:22:44.418 filename=/dev/nvme9n1 00:22:44.418 Could not set queue depth (nvme0n1) 00:22:44.418 Could not set queue depth (nvme10n1) 00:22:44.418 Could not set queue depth (nvme1n1) 00:22:44.418 Could not set queue depth (nvme2n1) 00:22:44.418 Could not set queue depth (nvme3n1) 00:22:44.418 Could not set queue depth (nvme4n1) 00:22:44.418 Could not set queue depth (nvme5n1) 00:22:44.418 Could not set queue depth (nvme6n1) 00:22:44.418 Could not set queue depth (nvme7n1) 00:22:44.418 Could not set queue depth (nvme8n1) 00:22:44.418 Could not set queue depth (nvme9n1) 00:22:44.997 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.997 fio-3.35 00:22:44.997 Starting 11 threads 00:22:57.238 00:22:57.238 job0: (groupid=0, jobs=1): err= 0: pid=4008329: Tue May 14 04:20:09 2024 00:22:57.238 read: IOPS=701, BW=175MiB/s (184MB/s)(1763MiB/10049msec) 00:22:57.238 slat (usec): min=6, max=137536, avg=1025.53, stdev=5190.13 00:22:57.238 clat (msec): min=5, max=287, avg=90.06, stdev=44.68 00:22:57.238 lat (msec): min=6, max=288, avg=91.09, stdev=45.17 00:22:57.238 clat percentiles (msec): 00:22:57.238 | 1.00th=[ 22], 5.00th=[ 33], 10.00th=[ 41], 20.00th=[ 55], 00:22:57.238 | 30.00th=[ 64], 40.00th=[ 71], 50.00th=[ 80], 60.00th=[ 91], 00:22:57.238 | 70.00th=[ 106], 80.00th=[ 126], 90.00th=[ 153], 95.00th=[ 184], 00:22:57.238 | 99.00th=[ 215], 99.50th=[ 218], 99.90th=[ 241], 99.95th=[ 245], 00:22:57.238 | 99.99th=[ 288] 00:22:57.238 bw ( KiB/s): min=68096, max=270336, per=8.73%, avg=178892.80, stdev=49553.28, samples=20 00:22:57.238 iops : min= 266, max= 1056, avg=698.80, stdev=193.57, samples=20 00:22:57.238 lat (msec) : 10=0.17%, 20=0.67%, 50=16.24%, 100=48.99%, 250=33.91% 00:22:57.238 lat (msec) : 500=0.03% 00:22:57.238 cpu : usr=0.32%, sys=2.38%, ctx=1947, majf=0, minf=4097 00:22:57.238 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:57.238 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.238 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.238 issued rwts: total=7051,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.238 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.238 job1: (groupid=0, jobs=1): err= 0: pid=4008348: Tue May 14 04:20:09 2024 00:22:57.238 read: IOPS=841, BW=210MiB/s (221MB/s)(2124MiB/10099msec) 00:22:57.238 slat (usec): min=6, max=87432, avg=1167.20, stdev=3787.51 00:22:57.238 clat (msec): min=9, max=246, avg=74.80, stdev=41.58 00:22:57.238 lat (msec): min=9, max=246, avg=75.96, stdev=42.24 00:22:57.238 clat percentiles (msec): 00:22:57.238 | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 37], 00:22:57.238 | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 64], 60.00th=[ 78], 00:22:57.238 | 70.00th=[ 94], 80.00th=[ 110], 90.00th=[ 138], 95.00th=[ 159], 00:22:57.238 | 99.00th=[ 194], 99.50th=[ 207], 99.90th=[ 222], 99.95th=[ 222], 00:22:57.238 | 99.99th=[ 247] 00:22:57.238 bw ( KiB/s): min=95232, max=503296, per=10.54%, avg=215884.80, stdev=108739.86, samples=20 00:22:57.238 iops : min= 372, max= 1966, avg=843.30, stdev=424.77, samples=20 00:22:57.238 lat (msec) : 10=0.01%, 20=0.34%, 50=37.31%, 100=35.35%, 250=26.99% 00:22:57.238 cpu : usr=0.27%, sys=2.83%, ctx=1870, majf=0, minf=3535 00:22:57.239 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:22:57.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.239 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.239 issued rwts: total=8497,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.239 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.239 job2: (groupid=0, jobs=1): err= 0: pid=4008373: Tue May 14 04:20:09 2024 00:22:57.239 read: IOPS=670, BW=168MiB/s (176MB/s)(1689MiB/10069msec) 00:22:57.239 slat (usec): min=5, max=183643, avg=1187.72, stdev=5076.75 00:22:57.239 clat (msec): min=10, max=286, avg=94.15, stdev=44.35 00:22:57.239 lat (msec): min=10, max=287, avg=95.34, stdev=44.76 00:22:57.239 clat percentiles (msec): 00:22:57.239 | 1.00th=[ 25], 5.00th=[ 37], 10.00th=[ 45], 20.00th=[ 57], 00:22:57.239 | 30.00th=[ 68], 40.00th=[ 78], 50.00th=[ 86], 60.00th=[ 97], 00:22:57.239 | 70.00th=[ 111], 80.00th=[ 129], 90.00th=[ 150], 95.00th=[ 178], 00:22:57.239 | 99.00th=[ 228], 99.50th=[ 275], 99.90th=[ 279], 99.95th=[ 279], 00:22:57.239 | 99.99th=[ 288] 00:22:57.239 bw ( KiB/s): min=99328, max=333312, per=8.36%, avg=171289.60, stdev=56669.59, samples=20 00:22:57.239 iops : min= 388, max= 1302, avg=669.10, stdev=221.37, samples=20 00:22:57.239 lat (msec) : 20=0.50%, 50=12.85%, 100=49.29%, 250=36.47%, 500=0.89% 00:22:57.239 cpu : usr=0.31%, sys=2.00%, ctx=1649, majf=0, minf=4097 00:22:57.239 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:57.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.239 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.239 issued rwts: total=6754,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.239 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.239 job3: (groupid=0, jobs=1): err= 0: pid=4008385: Tue May 14 04:20:09 2024 00:22:57.239 read: IOPS=677, BW=169MiB/s (178MB/s)(1699MiB/10030msec) 00:22:57.239 slat (usec): min=6, max=116721, avg=1346.41, stdev=4305.41 00:22:57.239 clat (msec): min=7, max=262, avg=92.96, stdev=38.66 00:22:57.239 lat (msec): min=7, max=264, avg=94.31, stdev=39.22 00:22:57.239 clat percentiles (msec): 00:22:57.239 | 1.00th=[ 32], 5.00th=[ 45], 10.00th=[ 53], 20.00th=[ 62], 00:22:57.239 | 30.00th=[ 70], 40.00th=[ 77], 50.00th=[ 85], 60.00th=[ 93], 00:22:57.239 | 70.00th=[ 107], 80.00th=[ 126], 90.00th=[ 146], 95.00th=[ 171], 00:22:57.239 | 99.00th=[ 211], 99.50th=[ 218], 99.90th=[ 228], 99.95th=[ 239], 00:22:57.239 | 99.99th=[ 262] 00:22:57.239 bw ( KiB/s): min=96256, max=264192, per=8.41%, avg=172364.80, stdev=46424.92, samples=20 00:22:57.239 iops : min= 376, max= 1032, avg=673.30, stdev=181.35, samples=20 00:22:57.239 lat (msec) : 10=0.13%, 20=0.47%, 50=7.86%, 100=57.21%, 250=34.30% 00:22:57.239 lat (msec) : 500=0.03% 00:22:57.239 cpu : usr=0.30%, sys=2.49%, ctx=1636, majf=0, minf=4097 00:22:57.239 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:57.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.239 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.239 issued rwts: total=6796,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.239 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.239 job4: (groupid=0, jobs=1): err= 0: pid=4008386: Tue May 14 04:20:09 2024 00:22:57.239 read: IOPS=698, BW=175MiB/s (183MB/s)(1760MiB/10077msec) 00:22:57.239 slat (usec): min=6, max=132416, avg=1103.41, stdev=4853.06 00:22:57.239 clat (msec): min=2, max=302, avg=90.38, stdev=49.12 00:22:57.239 lat (msec): min=2, max=302, avg=91.49, stdev=49.75 00:22:57.239 clat percentiles (msec): 00:22:57.239 | 1.00th=[ 5], 5.00th=[ 16], 10.00th=[ 30], 20.00th=[ 45], 00:22:57.239 | 30.00th=[ 61], 40.00th=[ 77], 50.00th=[ 86], 60.00th=[ 100], 00:22:57.239 | 70.00th=[ 115], 80.00th=[ 130], 90.00th=[ 157], 95.00th=[ 176], 00:22:57.239 | 99.00th=[ 205], 99.50th=[ 262], 99.90th=[ 284], 99.95th=[ 300], 00:22:57.239 | 99.99th=[ 305] 00:22:57.239 bw ( KiB/s): min=71680, max=299008, per=8.71%, avg=178560.00, stdev=66081.28, samples=20 00:22:57.239 iops : min= 280, max= 1168, avg=697.50, stdev=258.13, samples=20 00:22:57.239 lat (msec) : 4=0.67%, 10=2.43%, 20=2.87%, 50=17.92%, 100=37.30% 00:22:57.239 lat (msec) : 250=37.98%, 500=0.84% 00:22:57.239 cpu : usr=0.25%, sys=2.29%, ctx=1980, majf=0, minf=4097 00:22:57.239 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:57.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.239 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.239 issued rwts: total=7038,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.239 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.239 job5: (groupid=0, jobs=1): err= 0: pid=4008404: Tue May 14 04:20:09 2024 00:22:57.239 read: IOPS=1012, BW=253MiB/s (265MB/s)(2550MiB/10076msec) 00:22:57.239 slat (usec): min=5, max=191709, avg=753.67, stdev=4279.30 00:22:57.239 clat (usec): min=1680, max=360041, avg=62410.01, stdev=44192.78 00:22:57.239 lat (usec): min=1742, max=360172, avg=63163.68, stdev=44710.38 00:22:57.239 clat percentiles (msec): 00:22:57.239 | 1.00th=[ 8], 5.00th=[ 18], 10.00th=[ 26], 20.00th=[ 32], 00:22:57.239 | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 57], 00:22:57.239 | 70.00th=[ 71], 80.00th=[ 89], 90.00th=[ 130], 95.00th=[ 161], 00:22:57.239 | 99.00th=[ 218], 99.50th=[ 230], 99.90th=[ 239], 99.95th=[ 241], 00:22:57.239 | 99.99th=[ 359] 00:22:57.239 bw ( KiB/s): min=62976, max=465920, per=12.66%, avg=259481.60, stdev=110233.94, samples=20 00:22:57.239 iops : min= 246, max= 1820, avg=1013.60, stdev=430.60, samples=20 00:22:57.239 lat (msec) : 2=0.04%, 4=0.26%, 10=1.52%, 20=4.30%, 50=48.12% 00:22:57.239 lat (msec) : 100=29.61%, 250=16.11%, 500=0.03% 00:22:57.239 cpu : usr=0.43%, sys=2.87%, ctx=2622, majf=0, minf=4097 00:22:57.239 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:22:57.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.239 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.239 issued rwts: total=10199,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.239 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.239 job6: (groupid=0, jobs=1): err= 0: pid=4008416: Tue May 14 04:20:09 2024 00:22:57.239 read: IOPS=765, BW=191MiB/s (201MB/s)(1928MiB/10075msec) 00:22:57.239 slat (usec): min=5, max=103439, avg=1035.47, stdev=4108.51 00:22:57.239 clat (msec): min=3, max=260, avg=82.49, stdev=42.67 00:22:57.239 lat (msec): min=3, max=298, avg=83.53, stdev=43.30 00:22:57.239 clat percentiles (msec): 00:22:57.239 | 1.00th=[ 13], 5.00th=[ 22], 10.00th=[ 32], 20.00th=[ 48], 00:22:57.239 | 30.00th=[ 58], 40.00th=[ 66], 50.00th=[ 75], 60.00th=[ 85], 00:22:57.239 | 70.00th=[ 100], 80.00th=[ 118], 90.00th=[ 142], 95.00th=[ 161], 00:22:57.239 | 99.00th=[ 205], 99.50th=[ 220], 99.90th=[ 245], 99.95th=[ 247], 00:22:57.239 | 99.99th=[ 262] 00:22:57.239 bw ( KiB/s): min=98816, max=407040, per=9.56%, avg=195814.40, stdev=75739.48, samples=20 00:22:57.239 iops : min= 386, max= 1590, avg=764.90, stdev=295.86, samples=20 00:22:57.239 lat (msec) : 4=0.05%, 10=0.41%, 20=3.71%, 50=17.31%, 100=48.65% 00:22:57.239 lat (msec) : 250=29.82%, 500=0.04% 00:22:57.239 cpu : usr=0.26%, sys=2.44%, ctx=2130, majf=0, minf=4097 00:22:57.239 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:57.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.239 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.239 issued rwts: total=7712,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.239 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.239 job7: (groupid=0, jobs=1): err= 0: pid=4008425: Tue May 14 04:20:09 2024 00:22:57.239 read: IOPS=779, BW=195MiB/s (204MB/s)(1956MiB/10030msec) 00:22:57.239 slat (usec): min=6, max=190990, avg=1045.86, stdev=5017.71 00:22:57.239 clat (msec): min=2, max=397, avg=80.90, stdev=56.00 00:22:57.239 lat (msec): min=2, max=427, avg=81.94, stdev=56.62 00:22:57.239 clat percentiles (msec): 00:22:57.239 | 1.00th=[ 4], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 40], 00:22:57.239 | 30.00th=[ 45], 40.00th=[ 52], 50.00th=[ 62], 60.00th=[ 78], 00:22:57.239 | 70.00th=[ 97], 80.00th=[ 125], 90.00th=[ 148], 95.00th=[ 186], 00:22:57.239 | 99.00th=[ 266], 99.50th=[ 372], 99.90th=[ 388], 99.95th=[ 397], 00:22:57.239 | 99.99th=[ 397] 00:22:57.239 bw ( KiB/s): min=83456, max=402944, per=9.70%, avg=198670.60, stdev=90090.32, samples=20 00:22:57.239 iops : min= 326, max= 1574, avg=776.05, stdev=351.92, samples=20 00:22:57.239 lat (msec) : 4=1.19%, 10=1.52%, 20=1.42%, 50=33.70%, 100=33.09% 00:22:57.239 lat (msec) : 250=27.85%, 500=1.23% 00:22:57.239 cpu : usr=0.30%, sys=2.61%, ctx=2049, majf=0, minf=4097 00:22:57.239 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:57.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.239 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.239 issued rwts: total=7823,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.239 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.239 job8: (groupid=0, jobs=1): err= 0: pid=4008452: Tue May 14 04:20:09 2024 00:22:57.239 read: IOPS=724, BW=181MiB/s (190MB/s)(1825MiB/10080msec) 00:22:57.239 slat (usec): min=5, max=182693, avg=1115.72, stdev=5522.50 00:22:57.239 clat (msec): min=4, max=389, avg=87.17, stdev=58.36 00:22:57.239 lat (msec): min=4, max=389, avg=88.29, stdev=58.99 00:22:57.239 clat percentiles (msec): 00:22:57.239 | 1.00th=[ 10], 5.00th=[ 28], 10.00th=[ 35], 20.00th=[ 46], 00:22:57.239 | 30.00th=[ 57], 40.00th=[ 64], 50.00th=[ 72], 60.00th=[ 84], 00:22:57.239 | 70.00th=[ 97], 80.00th=[ 113], 90.00th=[ 157], 95.00th=[ 213], 00:22:57.239 | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 388], 99.95th=[ 388], 00:22:57.239 | 99.99th=[ 388] 00:22:57.239 bw ( KiB/s): min=48128, max=269824, per=9.04%, avg=185292.80, stdev=62507.03, samples=20 00:22:57.239 iops : min= 188, max= 1054, avg=723.80, stdev=244.17, samples=20 00:22:57.239 lat (msec) : 10=1.23%, 20=1.63%, 50=21.01%, 100=47.80%, 250=26.46% 00:22:57.239 lat (msec) : 500=1.86% 00:22:57.239 cpu : usr=0.27%, sys=2.32%, ctx=1756, majf=0, minf=4097 00:22:57.239 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:22:57.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.240 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.240 issued rwts: total=7301,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.240 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.240 job9: (groupid=0, jobs=1): err= 0: pid=4008465: Tue May 14 04:20:09 2024 00:22:57.240 read: IOPS=609, BW=152MiB/s (160MB/s)(1538MiB/10088msec) 00:22:57.240 slat (usec): min=6, max=256391, avg=1319.32, stdev=6066.85 00:22:57.240 clat (msec): min=4, max=296, avg=103.49, stdev=49.57 00:22:57.240 lat (msec): min=5, max=325, avg=104.80, stdev=50.15 00:22:57.240 clat percentiles (msec): 00:22:57.240 | 1.00th=[ 18], 5.00th=[ 37], 10.00th=[ 47], 20.00th=[ 63], 00:22:57.240 | 30.00th=[ 74], 40.00th=[ 87], 50.00th=[ 95], 60.00th=[ 108], 00:22:57.240 | 70.00th=[ 125], 80.00th=[ 140], 90.00th=[ 171], 95.00th=[ 190], 00:22:57.240 | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 296], 00:22:57.240 | 99.99th=[ 296] 00:22:57.240 bw ( KiB/s): min=89088, max=291840, per=7.61%, avg=155904.00, stdev=48266.12, samples=20 00:22:57.240 iops : min= 348, max= 1140, avg=609.00, stdev=188.54, samples=20 00:22:57.240 lat (msec) : 10=0.08%, 20=1.40%, 50=10.55%, 100=42.76%, 250=43.43% 00:22:57.240 lat (msec) : 500=1.79% 00:22:57.240 cpu : usr=0.34%, sys=1.87%, ctx=1601, majf=0, minf=4097 00:22:57.240 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:57.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.240 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.240 issued rwts: total=6153,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.240 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.240 job10: (groupid=0, jobs=1): err= 0: pid=4008475: Tue May 14 04:20:09 2024 00:22:57.240 read: IOPS=546, BW=137MiB/s (143MB/s)(1379MiB/10096msec) 00:22:57.240 slat (usec): min=5, max=182546, avg=1597.73, stdev=6694.81 00:22:57.240 clat (msec): min=14, max=340, avg=115.43, stdev=53.29 00:22:57.240 lat (msec): min=15, max=417, avg=117.03, stdev=53.87 00:22:57.240 clat percentiles (msec): 00:22:57.240 | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 72], 00:22:57.240 | 30.00th=[ 81], 40.00th=[ 89], 50.00th=[ 102], 60.00th=[ 116], 00:22:57.240 | 70.00th=[ 136], 80.00th=[ 157], 90.00th=[ 188], 95.00th=[ 220], 00:22:57.240 | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 338], 99.95th=[ 338], 00:22:57.240 | 99.99th=[ 342] 00:22:57.240 bw ( KiB/s): min=66560, max=237568, per=6.81%, avg=139520.00, stdev=46739.24, samples=20 00:22:57.240 iops : min= 260, max= 928, avg=545.00, stdev=182.58, samples=20 00:22:57.240 lat (msec) : 20=0.22%, 50=3.21%, 100=46.10%, 250=47.86%, 500=2.61% 00:22:57.240 cpu : usr=0.20%, sys=1.68%, ctx=1232, majf=0, minf=4097 00:22:57.240 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:57.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.240 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.240 issued rwts: total=5514,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.240 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.240 00:22:57.240 Run status group 0 (all jobs): 00:22:57.240 READ: bw=2001MiB/s (2098MB/s), 137MiB/s-253MiB/s (143MB/s-265MB/s), io=19.7GiB (21.2GB), run=10030-10099msec 00:22:57.240 00:22:57.240 Disk stats (read/write): 00:22:57.240 nvme0n1: ios=13669/0, merge=0/0, ticks=1225180/0, in_queue=1225180, util=96.35% 00:22:57.240 nvme10n1: ios=16750/0, merge=0/0, ticks=1206212/0, in_queue=1206212, util=96.63% 00:22:57.240 nvme1n1: ios=13246/0, merge=0/0, ticks=1210702/0, in_queue=1210702, util=96.91% 00:22:57.240 nvme2n1: ios=13161/0, merge=0/0, ticks=1217080/0, in_queue=1217080, util=97.20% 00:22:57.240 nvme3n1: ios=13738/0, merge=0/0, ticks=1219506/0, in_queue=1219506, util=97.29% 00:22:57.240 nvme4n1: ios=20150/0, merge=0/0, ticks=1216596/0, in_queue=1216596, util=97.69% 00:22:57.240 nvme5n1: ios=15124/0, merge=0/0, ticks=1211544/0, in_queue=1211544, util=97.94% 00:22:57.240 nvme6n1: ios=15023/0, merge=0/0, ticks=1222035/0, in_queue=1222035, util=98.12% 00:22:57.240 nvme7n1: ios=14307/0, merge=0/0, ticks=1220015/0, in_queue=1220015, util=98.62% 00:22:57.240 nvme8n1: ios=11997/0, merge=0/0, ticks=1220887/0, in_queue=1220887, util=98.93% 00:22:57.240 nvme9n1: ios=10780/0, merge=0/0, ticks=1212942/0, in_queue=1212942, util=99.07% 00:22:57.240 04:20:09 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:57.240 [global] 00:22:57.240 thread=1 00:22:57.240 invalidate=1 00:22:57.240 rw=randwrite 00:22:57.240 time_based=1 00:22:57.240 runtime=10 00:22:57.240 ioengine=libaio 00:22:57.240 direct=1 00:22:57.240 bs=262144 00:22:57.240 iodepth=64 00:22:57.240 norandommap=1 00:22:57.240 numjobs=1 00:22:57.240 00:22:57.240 [job0] 00:22:57.240 filename=/dev/nvme0n1 00:22:57.240 [job1] 00:22:57.240 filename=/dev/nvme10n1 00:22:57.240 [job2] 00:22:57.240 filename=/dev/nvme1n1 00:22:57.240 [job3] 00:22:57.240 filename=/dev/nvme2n1 00:22:57.240 [job4] 00:22:57.240 filename=/dev/nvme3n1 00:22:57.240 [job5] 00:22:57.240 filename=/dev/nvme4n1 00:22:57.240 [job6] 00:22:57.240 filename=/dev/nvme5n1 00:22:57.240 [job7] 00:22:57.240 filename=/dev/nvme6n1 00:22:57.240 [job8] 00:22:57.240 filename=/dev/nvme7n1 00:22:57.240 [job9] 00:22:57.240 filename=/dev/nvme8n1 00:22:57.240 [job10] 00:22:57.240 filename=/dev/nvme9n1 00:22:57.240 Could not set queue depth (nvme0n1) 00:22:57.240 Could not set queue depth (nvme10n1) 00:22:57.240 Could not set queue depth (nvme1n1) 00:22:57.240 Could not set queue depth (nvme2n1) 00:22:57.240 Could not set queue depth (nvme3n1) 00:22:57.240 Could not set queue depth (nvme4n1) 00:22:57.240 Could not set queue depth (nvme5n1) 00:22:57.240 Could not set queue depth (nvme6n1) 00:22:57.240 Could not set queue depth (nvme7n1) 00:22:57.240 Could not set queue depth (nvme8n1) 00:22:57.240 Could not set queue depth (nvme9n1) 00:22:57.240 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.240 fio-3.35 00:22:57.240 Starting 11 threads 00:23:07.248 00:23:07.248 job0: (groupid=0, jobs=1): err= 0: pid=4010645: Tue May 14 04:20:21 2024 00:23:07.248 write: IOPS=476, BW=119MiB/s (125MB/s)(1205MiB/10122msec); 0 zone resets 00:23:07.248 slat (usec): min=19, max=108610, avg=1861.86, stdev=4217.51 00:23:07.248 clat (msec): min=13, max=257, avg=132.51, stdev=37.21 00:23:07.248 lat (msec): min=13, max=257, avg=134.38, stdev=37.74 00:23:07.248 clat percentiles (msec): 00:23:07.248 | 1.00th=[ 39], 5.00th=[ 64], 10.00th=[ 90], 20.00th=[ 109], 00:23:07.248 | 30.00th=[ 122], 40.00th=[ 129], 50.00th=[ 136], 60.00th=[ 140], 00:23:07.248 | 70.00th=[ 146], 80.00th=[ 148], 90.00th=[ 178], 95.00th=[ 205], 00:23:07.248 | 99.00th=[ 239], 99.50th=[ 249], 99.90th=[ 257], 99.95th=[ 257], 00:23:07.248 | 99.99th=[ 257] 00:23:07.248 bw ( KiB/s): min=79872, max=179712, per=8.56%, avg=121762.20, stdev=24255.71, samples=20 00:23:07.248 iops : min= 312, max= 702, avg=475.60, stdev=94.80, samples=20 00:23:07.248 lat (msec) : 20=0.06%, 50=2.91%, 100=11.25%, 250=85.33%, 500=0.46% 00:23:07.248 cpu : usr=1.11%, sys=1.48%, ctx=1808, majf=0, minf=1 00:23:07.248 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:07.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.248 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.248 issued rwts: total=0,4819,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.248 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.248 job1: (groupid=0, jobs=1): err= 0: pid=4010646: Tue May 14 04:20:21 2024 00:23:07.248 write: IOPS=666, BW=167MiB/s (175MB/s)(1676MiB/10063msec); 0 zone resets 00:23:07.248 slat (usec): min=21, max=68256, avg=1313.18, stdev=2902.40 00:23:07.248 clat (msec): min=2, max=241, avg=94.75, stdev=40.65 00:23:07.248 lat (msec): min=3, max=241, avg=96.07, stdev=41.13 00:23:07.248 clat percentiles (msec): 00:23:07.248 | 1.00th=[ 18], 5.00th=[ 48], 10.00th=[ 62], 20.00th=[ 66], 00:23:07.248 | 30.00th=[ 68], 40.00th=[ 69], 50.00th=[ 75], 60.00th=[ 88], 00:23:07.248 | 70.00th=[ 123], 80.00th=[ 142], 90.00th=[ 155], 95.00th=[ 167], 00:23:07.248 | 99.00th=[ 182], 99.50th=[ 220], 99.90th=[ 234], 99.95th=[ 239], 00:23:07.248 | 99.99th=[ 243] 00:23:07.248 bw ( KiB/s): min=98304, max=270336, per=11.94%, avg=169958.40, stdev=62119.91, samples=20 00:23:07.248 iops : min= 384, max= 1056, avg=663.90, stdev=242.66, samples=20 00:23:07.248 lat (msec) : 4=0.03%, 10=0.22%, 20=1.00%, 50=4.19%, 100=59.55% 00:23:07.249 lat (msec) : 250=35.00% 00:23:07.249 cpu : usr=1.49%, sys=2.11%, ctx=2445, majf=0, minf=1 00:23:07.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:07.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.249 issued rwts: total=0,6702,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.249 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.249 job2: (groupid=0, jobs=1): err= 0: pid=4010648: Tue May 14 04:20:21 2024 00:23:07.249 write: IOPS=497, BW=124MiB/s (131MB/s)(1273MiB/10225msec); 0 zone resets 00:23:07.249 slat (usec): min=27, max=86918, avg=1808.27, stdev=4405.36 00:23:07.249 clat (msec): min=9, max=443, avg=126.62, stdev=50.74 00:23:07.249 lat (msec): min=9, max=443, avg=128.43, stdev=51.37 00:23:07.249 clat percentiles (msec): 00:23:07.249 | 1.00th=[ 32], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 83], 00:23:07.249 | 30.00th=[ 95], 40.00th=[ 106], 50.00th=[ 116], 60.00th=[ 142], 00:23:07.249 | 70.00th=[ 153], 80.00th=[ 165], 90.00th=[ 192], 95.00th=[ 213], 00:23:07.249 | 99.00th=[ 249], 99.50th=[ 330], 99.90th=[ 435], 99.95th=[ 435], 00:23:07.249 | 99.99th=[ 443] 00:23:07.249 bw ( KiB/s): min=75776, max=200704, per=9.04%, avg=128716.80, stdev=38011.39, samples=20 00:23:07.249 iops : min= 296, max= 784, avg=502.80, stdev=148.48, samples=20 00:23:07.249 lat (msec) : 10=0.08%, 20=0.37%, 50=2.06%, 100=31.70%, 250=64.81% 00:23:07.249 lat (msec) : 500=0.98% 00:23:07.249 cpu : usr=1.22%, sys=1.39%, ctx=1695, majf=0, minf=1 00:23:07.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:07.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.249 issued rwts: total=0,5092,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.249 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.249 job3: (groupid=0, jobs=1): err= 0: pid=4010663: Tue May 14 04:20:21 2024 00:23:07.249 write: IOPS=531, BW=133MiB/s (139MB/s)(1360MiB/10232msec); 0 zone resets 00:23:07.249 slat (usec): min=23, max=169072, avg=1542.26, stdev=4224.49 00:23:07.249 clat (msec): min=4, max=439, avg=118.72, stdev=50.05 00:23:07.249 lat (msec): min=4, max=439, avg=120.26, stdev=50.59 00:23:07.249 clat percentiles (msec): 00:23:07.249 | 1.00th=[ 33], 5.00th=[ 71], 10.00th=[ 78], 20.00th=[ 87], 00:23:07.249 | 30.00th=[ 93], 40.00th=[ 100], 50.00th=[ 107], 60.00th=[ 115], 00:23:07.249 | 70.00th=[ 126], 80.00th=[ 142], 90.00th=[ 176], 95.00th=[ 215], 00:23:07.249 | 99.00th=[ 313], 99.50th=[ 355], 99.90th=[ 422], 99.95th=[ 422], 00:23:07.249 | 99.99th=[ 439] 00:23:07.249 bw ( KiB/s): min=63488, max=201216, per=9.67%, avg=137651.20, stdev=38077.71, samples=20 00:23:07.249 iops : min= 248, max= 786, avg=537.70, stdev=148.74, samples=20 00:23:07.249 lat (msec) : 10=0.13%, 20=0.22%, 50=1.95%, 100=38.50%, 250=55.74% 00:23:07.249 lat (msec) : 500=3.46% 00:23:07.249 cpu : usr=1.20%, sys=1.70%, ctx=2186, majf=0, minf=1 00:23:07.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:07.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.249 issued rwts: total=0,5441,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.249 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.249 job4: (groupid=0, jobs=1): err= 0: pid=4010664: Tue May 14 04:20:21 2024 00:23:07.249 write: IOPS=461, BW=115MiB/s (121MB/s)(1169MiB/10131msec); 0 zone resets 00:23:07.249 slat (usec): min=24, max=39181, avg=2114.85, stdev=4040.37 00:23:07.249 clat (msec): min=16, max=319, avg=136.43, stdev=29.73 00:23:07.249 lat (msec): min=16, max=319, avg=138.55, stdev=29.95 00:23:07.249 clat percentiles (msec): 00:23:07.249 | 1.00th=[ 63], 5.00th=[ 89], 10.00th=[ 97], 20.00th=[ 115], 00:23:07.249 | 30.00th=[ 125], 40.00th=[ 131], 50.00th=[ 138], 60.00th=[ 144], 00:23:07.249 | 70.00th=[ 150], 80.00th=[ 157], 90.00th=[ 167], 95.00th=[ 182], 00:23:07.249 | 99.00th=[ 230], 99.50th=[ 232], 99.90th=[ 305], 99.95th=[ 305], 00:23:07.249 | 99.99th=[ 321] 00:23:07.249 bw ( KiB/s): min=92672, max=178176, per=8.30%, avg=118133.60, stdev=19016.79, samples=20 00:23:07.249 iops : min= 362, max= 696, avg=461.45, stdev=74.27, samples=20 00:23:07.249 lat (msec) : 20=0.09%, 50=0.49%, 100=10.86%, 250=88.26%, 500=0.30% 00:23:07.249 cpu : usr=1.07%, sys=1.23%, ctx=1272, majf=0, minf=1 00:23:07.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:07.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.249 issued rwts: total=0,4677,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.249 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.249 job5: (groupid=0, jobs=1): err= 0: pid=4010665: Tue May 14 04:20:21 2024 00:23:07.249 write: IOPS=472, BW=118MiB/s (124MB/s)(1198MiB/10135msec); 0 zone resets 00:23:07.249 slat (usec): min=24, max=57228, avg=2029.08, stdev=4114.90 00:23:07.249 clat (msec): min=21, max=354, avg=133.25, stdev=35.94 00:23:07.249 lat (msec): min=21, max=354, avg=135.27, stdev=36.19 00:23:07.249 clat percentiles (msec): 00:23:07.249 | 1.00th=[ 70], 5.00th=[ 81], 10.00th=[ 91], 20.00th=[ 105], 00:23:07.249 | 30.00th=[ 114], 40.00th=[ 123], 50.00th=[ 132], 60.00th=[ 140], 00:23:07.249 | 70.00th=[ 148], 80.00th=[ 159], 90.00th=[ 176], 95.00th=[ 192], 00:23:07.249 | 99.00th=[ 226], 99.50th=[ 305], 99.90th=[ 347], 99.95th=[ 347], 00:23:07.249 | 99.99th=[ 355] 00:23:07.249 bw ( KiB/s): min=86528, max=179712, per=8.50%, avg=121011.20, stdev=25665.28, samples=20 00:23:07.249 iops : min= 338, max= 702, avg=472.70, stdev=100.25, samples=20 00:23:07.249 lat (msec) : 50=0.17%, 100=15.53%, 250=83.51%, 500=0.79% 00:23:07.249 cpu : usr=1.03%, sys=1.68%, ctx=1357, majf=0, minf=1 00:23:07.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:07.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.249 issued rwts: total=0,4790,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.249 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.249 job6: (groupid=0, jobs=1): err= 0: pid=4010672: Tue May 14 04:20:21 2024 00:23:07.249 write: IOPS=489, BW=122MiB/s (128MB/s)(1237MiB/10107msec); 0 zone resets 00:23:07.249 slat (usec): min=27, max=121325, avg=2017.19, stdev=3934.21 00:23:07.249 clat (msec): min=82, max=343, avg=128.62, stdev=24.94 00:23:07.249 lat (msec): min=86, max=343, avg=130.64, stdev=24.99 00:23:07.249 clat percentiles (msec): 00:23:07.249 | 1.00th=[ 89], 5.00th=[ 99], 10.00th=[ 105], 20.00th=[ 111], 00:23:07.249 | 30.00th=[ 116], 40.00th=[ 121], 50.00th=[ 126], 60.00th=[ 132], 00:23:07.249 | 70.00th=[ 140], 80.00th=[ 146], 90.00th=[ 150], 95.00th=[ 159], 00:23:07.249 | 99.00th=[ 236], 99.50th=[ 268], 99.90th=[ 334], 99.95th=[ 342], 00:23:07.249 | 99.99th=[ 342] 00:23:07.249 bw ( KiB/s): min=65536, max=161792, per=8.79%, avg=125056.00, stdev=21093.22, samples=20 00:23:07.249 iops : min= 256, max= 632, avg=488.50, stdev=82.40, samples=20 00:23:07.249 lat (msec) : 100=6.26%, 250=93.09%, 500=0.65% 00:23:07.249 cpu : usr=1.03%, sys=1.39%, ctx=1283, majf=0, minf=1 00:23:07.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:07.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.249 issued rwts: total=0,4949,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.249 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.249 job7: (groupid=0, jobs=1): err= 0: pid=4010675: Tue May 14 04:20:21 2024 00:23:07.249 write: IOPS=449, BW=112MiB/s (118MB/s)(1139MiB/10125msec); 0 zone resets 00:23:07.249 slat (usec): min=23, max=147385, avg=1962.90, stdev=5202.20 00:23:07.249 clat (msec): min=12, max=351, avg=140.22, stdev=44.47 00:23:07.249 lat (msec): min=12, max=351, avg=142.18, stdev=44.92 00:23:07.249 clat percentiles (msec): 00:23:07.249 | 1.00th=[ 50], 5.00th=[ 78], 10.00th=[ 108], 20.00th=[ 116], 00:23:07.249 | 30.00th=[ 121], 40.00th=[ 126], 50.00th=[ 136], 60.00th=[ 144], 00:23:07.249 | 70.00th=[ 146], 80.00th=[ 157], 90.00th=[ 174], 95.00th=[ 247], 00:23:07.249 | 99.00th=[ 309], 99.50th=[ 317], 99.90th=[ 334], 99.95th=[ 351], 00:23:07.249 | 99.99th=[ 351] 00:23:07.249 bw ( KiB/s): min=66048, max=150528, per=8.08%, avg=115020.80, stdev=22015.86, samples=20 00:23:07.249 iops : min= 258, max= 588, avg=449.30, stdev=86.00, samples=20 00:23:07.249 lat (msec) : 20=0.15%, 50=0.90%, 100=6.98%, 250=87.14%, 500=4.83% 00:23:07.249 cpu : usr=1.11%, sys=1.25%, ctx=1607, majf=0, minf=1 00:23:07.249 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:07.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.249 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.249 issued rwts: total=0,4556,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.249 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.249 job8: (groupid=0, jobs=1): err= 0: pid=4010677: Tue May 14 04:20:21 2024 00:23:07.249 write: IOPS=419, BW=105MiB/s (110MB/s)(1069MiB/10189msec); 0 zone resets 00:23:07.249 slat (usec): min=23, max=113722, avg=2181.59, stdev=5207.73 00:23:07.250 clat (msec): min=22, max=402, avg=150.25, stdev=47.72 00:23:07.250 lat (msec): min=22, max=402, avg=152.43, stdev=48.19 00:23:07.250 clat percentiles (msec): 00:23:07.250 | 1.00th=[ 44], 5.00th=[ 108], 10.00th=[ 121], 20.00th=[ 129], 00:23:07.250 | 30.00th=[ 134], 40.00th=[ 138], 50.00th=[ 140], 60.00th=[ 144], 00:23:07.250 | 70.00th=[ 146], 80.00th=[ 150], 90.00th=[ 218], 95.00th=[ 257], 00:23:07.250 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 393], 99.95th=[ 393], 00:23:07.250 | 99.99th=[ 405] 00:23:07.250 bw ( KiB/s): min=40960, max=131072, per=7.58%, avg=107852.80, stdev=22709.94, samples=20 00:23:07.250 iops : min= 160, max= 512, avg=421.30, stdev=88.71, samples=20 00:23:07.250 lat (msec) : 50=1.26%, 100=2.90%, 250=90.04%, 500=5.80% 00:23:07.250 cpu : usr=0.97%, sys=1.49%, ctx=1386, majf=0, minf=1 00:23:07.250 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:23:07.250 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.250 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.250 issued rwts: total=0,4276,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.250 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.250 job9: (groupid=0, jobs=1): err= 0: pid=4010678: Tue May 14 04:20:21 2024 00:23:07.250 write: IOPS=517, BW=129MiB/s (136MB/s)(1311MiB/10123msec); 0 zone resets 00:23:07.250 slat (usec): min=24, max=46201, avg=1718.52, stdev=3575.85 00:23:07.250 clat (msec): min=5, max=243, avg=121.80, stdev=31.64 00:23:07.250 lat (msec): min=5, max=245, avg=123.52, stdev=31.98 00:23:07.250 clat percentiles (msec): 00:23:07.250 | 1.00th=[ 44], 5.00th=[ 74], 10.00th=[ 82], 20.00th=[ 96], 00:23:07.250 | 30.00th=[ 107], 40.00th=[ 115], 50.00th=[ 122], 60.00th=[ 129], 00:23:07.250 | 70.00th=[ 138], 80.00th=[ 146], 90.00th=[ 159], 95.00th=[ 176], 00:23:07.250 | 99.00th=[ 213], 99.50th=[ 220], 99.90th=[ 234], 99.95th=[ 243], 00:23:07.250 | 99.99th=[ 243] 00:23:07.250 bw ( KiB/s): min=104448, max=180224, per=9.31%, avg=132556.80, stdev=24911.62, samples=20 00:23:07.250 iops : min= 408, max= 704, avg=517.80, stdev=97.31, samples=20 00:23:07.250 lat (msec) : 10=0.06%, 20=0.21%, 50=1.09%, 100=22.47%, 250=76.17% 00:23:07.250 cpu : usr=1.15%, sys=1.56%, ctx=1784, majf=0, minf=1 00:23:07.250 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:07.250 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.250 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.250 issued rwts: total=0,5242,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.250 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.250 job10: (groupid=0, jobs=1): err= 0: pid=4010683: Tue May 14 04:20:21 2024 00:23:07.250 write: IOPS=628, BW=157MiB/s (165MB/s)(1585MiB/10084msec); 0 zone resets 00:23:07.250 slat (usec): min=27, max=30946, avg=1573.35, stdev=2853.74 00:23:07.250 clat (msec): min=19, max=171, avg=100.22, stdev=15.31 00:23:07.250 lat (msec): min=19, max=171, avg=101.79, stdev=15.36 00:23:07.250 clat percentiles (msec): 00:23:07.250 | 1.00th=[ 75], 5.00th=[ 81], 10.00th=[ 85], 20.00th=[ 88], 00:23:07.250 | 30.00th=[ 92], 40.00th=[ 95], 50.00th=[ 99], 60.00th=[ 103], 00:23:07.250 | 70.00th=[ 107], 80.00th=[ 111], 90.00th=[ 120], 95.00th=[ 127], 00:23:07.250 | 99.00th=[ 153], 99.50th=[ 165], 99.90th=[ 171], 99.95th=[ 171], 00:23:07.250 | 99.99th=[ 171] 00:23:07.250 bw ( KiB/s): min=131072, max=182272, per=11.29%, avg=160640.00, stdev=15213.67, samples=20 00:23:07.250 iops : min= 512, max= 712, avg=627.50, stdev=59.43, samples=20 00:23:07.250 lat (msec) : 20=0.06%, 50=0.19%, 100=54.73%, 250=45.01% 00:23:07.250 cpu : usr=1.52%, sys=2.06%, ctx=1618, majf=0, minf=1 00:23:07.250 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:07.250 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.250 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.250 issued rwts: total=0,6338,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.250 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.250 00:23:07.250 Run status group 0 (all jobs): 00:23:07.250 WRITE: bw=1390MiB/s (1457MB/s), 105MiB/s-167MiB/s (110MB/s-175MB/s), io=13.9GiB (14.9GB), run=10063-10232msec 00:23:07.250 00:23:07.250 Disk stats (read/write): 00:23:07.250 nvme0n1: ios=49/9601, merge=0/0, ticks=111/1230453, in_queue=1230564, util=96.96% 00:23:07.250 nvme10n1: ios=49/12978, merge=0/0, ticks=86/1204672, in_queue=1204758, util=96.96% 00:23:07.250 nvme1n1: ios=52/10104, merge=0/0, ticks=2805/1209607, in_queue=1212412, util=99.91% 00:23:07.250 nvme2n1: ios=49/10777, merge=0/0, ticks=2004/1222125, in_queue=1224129, util=99.94% 00:23:07.250 nvme3n1: ios=47/9309, merge=0/0, ticks=2046/1225305, in_queue=1227351, util=99.94% 00:23:07.250 nvme4n1: ios=48/9532, merge=0/0, ticks=1336/1223976, in_queue=1225312, util=99.89% 00:23:07.250 nvme5n1: ios=43/9871, merge=0/0, ticks=1225/1227642, in_queue=1228867, util=99.98% 00:23:07.250 nvme6n1: ios=0/9067, merge=0/0, ticks=0/1231703, in_queue=1231703, util=98.08% 00:23:07.250 nvme7n1: ios=0/8481, merge=0/0, ticks=0/1224632, in_queue=1224632, util=98.66% 00:23:07.250 nvme8n1: ios=42/10443, merge=0/0, ticks=1413/1230244, in_queue=1231657, util=100.00% 00:23:07.250 nvme9n1: ios=0/12327, merge=0/0, ticks=0/1197542, in_queue=1197542, util=99.06% 00:23:07.250 04:20:21 -- target/multiconnection.sh@36 -- # sync 00:23:07.250 04:20:21 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:07.250 04:20:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.250 04:20:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:07.250 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:07.250 04:20:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:07.250 04:20:21 -- common/autotest_common.sh@1198 -- # local i=0 00:23:07.250 04:20:21 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:07.250 04:20:21 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:23:07.250 04:20:21 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:07.250 04:20:21 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:23:07.250 04:20:21 -- common/autotest_common.sh@1210 -- # return 0 00:23:07.250 04:20:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:07.250 04:20:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.250 04:20:21 -- common/autotest_common.sh@10 -- # set +x 00:23:07.250 04:20:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.250 04:20:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.250 04:20:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:07.511 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:07.511 04:20:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:07.511 04:20:21 -- common/autotest_common.sh@1198 -- # local i=0 00:23:07.511 04:20:21 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:07.511 04:20:21 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:23:07.511 04:20:21 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:07.511 04:20:21 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:23:07.511 04:20:21 -- common/autotest_common.sh@1210 -- # return 0 00:23:07.511 04:20:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:07.511 04:20:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.511 04:20:21 -- common/autotest_common.sh@10 -- # set +x 00:23:07.511 04:20:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.511 04:20:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.511 04:20:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:07.772 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:07.772 04:20:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:07.772 04:20:22 -- common/autotest_common.sh@1198 -- # local i=0 00:23:07.772 04:20:22 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:07.772 04:20:22 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:23:07.772 04:20:22 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:07.772 04:20:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:23:07.772 04:20:22 -- common/autotest_common.sh@1210 -- # return 0 00:23:07.772 04:20:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:07.772 04:20:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.772 04:20:22 -- common/autotest_common.sh@10 -- # set +x 00:23:07.772 04:20:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.772 04:20:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.772 04:20:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:08.033 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:08.033 04:20:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:08.033 04:20:22 -- common/autotest_common.sh@1198 -- # local i=0 00:23:08.033 04:20:22 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:08.033 04:20:22 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:23:08.033 04:20:22 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:08.033 04:20:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:23:08.033 04:20:22 -- common/autotest_common.sh@1210 -- # return 0 00:23:08.033 04:20:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:08.033 04:20:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.033 04:20:22 -- common/autotest_common.sh@10 -- # set +x 00:23:08.033 04:20:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.033 04:20:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.033 04:20:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:08.293 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:08.293 04:20:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:08.293 04:20:22 -- common/autotest_common.sh@1198 -- # local i=0 00:23:08.293 04:20:22 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:08.293 04:20:22 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:23:08.293 04:20:22 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:08.293 04:20:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:23:08.293 04:20:22 -- common/autotest_common.sh@1210 -- # return 0 00:23:08.293 04:20:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:08.293 04:20:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.293 04:20:22 -- common/autotest_common.sh@10 -- # set +x 00:23:08.293 04:20:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.294 04:20:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.294 04:20:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:08.555 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:08.555 04:20:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:08.555 04:20:23 -- common/autotest_common.sh@1198 -- # local i=0 00:23:08.555 04:20:23 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:08.555 04:20:23 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:23:08.555 04:20:23 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:08.555 04:20:23 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:23:08.555 04:20:23 -- common/autotest_common.sh@1210 -- # return 0 00:23:08.555 04:20:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:08.555 04:20:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.555 04:20:23 -- common/autotest_common.sh@10 -- # set +x 00:23:08.555 04:20:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.555 04:20:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.555 04:20:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:08.819 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:08.819 04:20:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:08.819 04:20:23 -- common/autotest_common.sh@1198 -- # local i=0 00:23:08.819 04:20:23 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:08.819 04:20:23 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:23:08.819 04:20:23 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:08.819 04:20:23 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:23:08.819 04:20:23 -- common/autotest_common.sh@1210 -- # return 0 00:23:08.819 04:20:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:08.819 04:20:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.819 04:20:23 -- common/autotest_common.sh@10 -- # set +x 00:23:08.819 04:20:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.819 04:20:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.819 04:20:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:09.084 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:09.084 04:20:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:09.084 04:20:23 -- common/autotest_common.sh@1198 -- # local i=0 00:23:09.084 04:20:23 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:09.084 04:20:23 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:23:09.084 04:20:23 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:09.084 04:20:23 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:23:09.084 04:20:23 -- common/autotest_common.sh@1210 -- # return 0 00:23:09.084 04:20:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:09.084 04:20:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:09.084 04:20:23 -- common/autotest_common.sh@10 -- # set +x 00:23:09.084 04:20:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:09.084 04:20:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:09.084 04:20:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:09.344 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:09.344 04:20:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:09.344 04:20:23 -- common/autotest_common.sh@1198 -- # local i=0 00:23:09.345 04:20:23 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:09.345 04:20:23 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:23:09.345 04:20:23 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:09.345 04:20:23 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:23:09.345 04:20:23 -- common/autotest_common.sh@1210 -- # return 0 00:23:09.345 04:20:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:09.345 04:20:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:09.345 04:20:23 -- common/autotest_common.sh@10 -- # set +x 00:23:09.345 04:20:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:09.345 04:20:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:09.345 04:20:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:09.605 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:09.605 04:20:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:09.605 04:20:23 -- common/autotest_common.sh@1198 -- # local i=0 00:23:09.605 04:20:23 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:09.605 04:20:23 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:23:09.605 04:20:23 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:09.605 04:20:23 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:23:09.605 04:20:23 -- common/autotest_common.sh@1210 -- # return 0 00:23:09.605 04:20:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:09.605 04:20:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:09.605 04:20:23 -- common/autotest_common.sh@10 -- # set +x 00:23:09.605 04:20:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:09.605 04:20:24 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:09.605 04:20:24 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:09.605 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:09.605 04:20:24 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:09.605 04:20:24 -- common/autotest_common.sh@1198 -- # local i=0 00:23:09.605 04:20:24 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:09.605 04:20:24 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:23:09.605 04:20:24 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:09.605 04:20:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:23:09.605 04:20:24 -- common/autotest_common.sh@1210 -- # return 0 00:23:09.605 04:20:24 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:09.605 04:20:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:09.605 04:20:24 -- common/autotest_common.sh@10 -- # set +x 00:23:09.605 04:20:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:09.605 04:20:24 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:09.605 04:20:24 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:09.605 04:20:24 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:09.605 04:20:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:09.605 04:20:24 -- nvmf/common.sh@116 -- # sync 00:23:09.605 04:20:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:09.605 04:20:24 -- nvmf/common.sh@119 -- # set +e 00:23:09.605 04:20:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:09.605 04:20:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:09.605 rmmod nvme_tcp 00:23:09.605 rmmod nvme_fabrics 00:23:09.865 rmmod nvme_keyring 00:23:09.865 04:20:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:09.865 04:20:24 -- nvmf/common.sh@123 -- # set -e 00:23:09.865 04:20:24 -- nvmf/common.sh@124 -- # return 0 00:23:09.865 04:20:24 -- nvmf/common.sh@477 -- # '[' -n 3999644 ']' 00:23:09.865 04:20:24 -- nvmf/common.sh@478 -- # killprocess 3999644 00:23:09.865 04:20:24 -- common/autotest_common.sh@926 -- # '[' -z 3999644 ']' 00:23:09.865 04:20:24 -- common/autotest_common.sh@930 -- # kill -0 3999644 00:23:09.865 04:20:24 -- common/autotest_common.sh@931 -- # uname 00:23:09.865 04:20:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:09.865 04:20:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3999644 00:23:09.865 04:20:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:09.865 04:20:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:09.865 04:20:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3999644' 00:23:09.865 killing process with pid 3999644 00:23:09.865 04:20:24 -- common/autotest_common.sh@945 -- # kill 3999644 00:23:09.865 04:20:24 -- common/autotest_common.sh@950 -- # wait 3999644 00:23:10.126 04:20:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:10.126 04:20:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:10.126 04:20:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:10.126 04:20:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:10.126 04:20:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:10.126 04:20:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:10.126 04:20:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:10.126 04:20:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:12.673 04:20:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:12.673 00:23:12.673 real 1m17.499s 00:23:12.673 user 4m54.348s 00:23:12.673 sys 0m21.879s 00:23:12.673 04:20:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:12.673 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:23:12.673 ************************************ 00:23:12.673 END TEST nvmf_multiconnection 00:23:12.673 ************************************ 00:23:12.673 04:20:26 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:12.673 04:20:26 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:12.673 04:20:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:12.673 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:23:12.673 ************************************ 00:23:12.673 START TEST nvmf_initiator_timeout 00:23:12.673 ************************************ 00:23:12.673 04:20:26 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:12.673 * Looking for test storage... 00:23:12.673 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:12.673 04:20:26 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:12.673 04:20:26 -- nvmf/common.sh@7 -- # uname -s 00:23:12.673 04:20:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:12.673 04:20:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:12.673 04:20:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:12.673 04:20:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:12.673 04:20:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:12.673 04:20:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:12.673 04:20:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:12.673 04:20:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:12.673 04:20:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:12.673 04:20:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:12.673 04:20:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:12.673 04:20:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:12.673 04:20:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:12.673 04:20:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:12.673 04:20:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:12.673 04:20:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:12.673 04:20:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:12.673 04:20:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:12.673 04:20:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:12.673 04:20:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:12.673 04:20:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:12.673 04:20:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:12.673 04:20:26 -- paths/export.sh@5 -- # export PATH 00:23:12.673 04:20:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:12.673 04:20:26 -- nvmf/common.sh@46 -- # : 0 00:23:12.673 04:20:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:12.673 04:20:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:12.673 04:20:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:12.673 04:20:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:12.673 04:20:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:12.673 04:20:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:12.673 04:20:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:12.673 04:20:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:12.673 04:20:26 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:12.673 04:20:26 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:12.673 04:20:26 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:12.673 04:20:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:12.673 04:20:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:12.673 04:20:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:12.673 04:20:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:12.673 04:20:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:12.673 04:20:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:12.673 04:20:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:12.673 04:20:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:12.673 04:20:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:12.673 04:20:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:12.673 04:20:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:12.673 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:23:19.348 04:20:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:19.348 04:20:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:19.348 04:20:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:19.348 04:20:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:19.348 04:20:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:19.348 04:20:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:19.348 04:20:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:19.348 04:20:33 -- nvmf/common.sh@294 -- # net_devs=() 00:23:19.348 04:20:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:19.348 04:20:33 -- nvmf/common.sh@295 -- # e810=() 00:23:19.348 04:20:33 -- nvmf/common.sh@295 -- # local -ga e810 00:23:19.348 04:20:33 -- nvmf/common.sh@296 -- # x722=() 00:23:19.348 04:20:33 -- nvmf/common.sh@296 -- # local -ga x722 00:23:19.348 04:20:33 -- nvmf/common.sh@297 -- # mlx=() 00:23:19.348 04:20:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:19.348 04:20:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:19.348 04:20:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:19.348 04:20:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:19.348 04:20:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:19.348 04:20:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:19.348 04:20:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:19.349 04:20:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:19.349 04:20:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.349 04:20:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:23:19.349 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:23:19.349 04:20:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.349 04:20:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:23:19.349 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:23:19.349 04:20:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:19.349 04:20:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.349 04:20:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.349 04:20:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.349 04:20:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.349 04:20:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:23:19.349 Found net devices under 0000:4b:00.0: cvl_0_0 00:23:19.349 04:20:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.349 04:20:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.349 04:20:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.349 04:20:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.349 04:20:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.349 04:20:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:23:19.349 Found net devices under 0000:4b:00.1: cvl_0_1 00:23:19.349 04:20:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.349 04:20:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:19.349 04:20:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:19.349 04:20:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:19.349 04:20:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:19.349 04:20:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:19.349 04:20:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:19.349 04:20:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:19.349 04:20:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:19.349 04:20:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:19.349 04:20:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:19.349 04:20:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:19.349 04:20:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:19.349 04:20:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:19.349 04:20:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:19.349 04:20:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:19.349 04:20:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:19.349 04:20:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:19.349 04:20:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:19.349 04:20:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:19.349 04:20:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:19.349 04:20:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:19.349 04:20:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:19.349 04:20:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:19.349 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:19.349 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.574 ms 00:23:19.349 00:23:19.349 --- 10.0.0.2 ping statistics --- 00:23:19.349 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.349 rtt min/avg/max/mdev = 0.574/0.574/0.574/0.000 ms 00:23:19.349 04:20:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:19.349 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:19.349 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.415 ms 00:23:19.349 00:23:19.349 --- 10.0.0.1 ping statistics --- 00:23:19.349 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.349 rtt min/avg/max/mdev = 0.415/0.415/0.415/0.000 ms 00:23:19.349 04:20:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:19.349 04:20:33 -- nvmf/common.sh@410 -- # return 0 00:23:19.349 04:20:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:19.349 04:20:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:19.349 04:20:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:19.349 04:20:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:19.349 04:20:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:19.349 04:20:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:19.349 04:20:33 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:19.349 04:20:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:19.349 04:20:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:19.349 04:20:33 -- common/autotest_common.sh@10 -- # set +x 00:23:19.349 04:20:33 -- nvmf/common.sh@469 -- # nvmfpid=4017336 00:23:19.349 04:20:33 -- nvmf/common.sh@470 -- # waitforlisten 4017336 00:23:19.349 04:20:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:19.349 04:20:33 -- common/autotest_common.sh@819 -- # '[' -z 4017336 ']' 00:23:19.349 04:20:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:19.349 04:20:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:19.349 04:20:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:19.349 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:19.349 04:20:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:19.349 04:20:33 -- common/autotest_common.sh@10 -- # set +x 00:23:19.349 [2024-05-14 04:20:33.920720] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:23:19.349 [2024-05-14 04:20:33.920767] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:19.610 EAL: No free 2048 kB hugepages reported on node 1 00:23:19.610 [2024-05-14 04:20:33.988702] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:19.610 [2024-05-14 04:20:34.051438] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:19.610 [2024-05-14 04:20:34.051573] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:19.610 [2024-05-14 04:20:34.051583] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:19.610 [2024-05-14 04:20:34.051591] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:19.610 [2024-05-14 04:20:34.051629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:19.610 [2024-05-14 04:20:34.051763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:19.610 [2024-05-14 04:20:34.051918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:19.610 [2024-05-14 04:20:34.051920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:20.182 04:20:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:20.182 04:20:34 -- common/autotest_common.sh@852 -- # return 0 00:23:20.182 04:20:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:20.182 04:20:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:20.182 04:20:34 -- common/autotest_common.sh@10 -- # set +x 00:23:20.182 04:20:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:20.182 04:20:34 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:20.182 04:20:34 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:20.182 04:20:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.182 04:20:34 -- common/autotest_common.sh@10 -- # set +x 00:23:20.182 Malloc0 00:23:20.182 04:20:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.182 04:20:34 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:20.182 04:20:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.182 04:20:34 -- common/autotest_common.sh@10 -- # set +x 00:23:20.182 Delay0 00:23:20.182 04:20:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.182 04:20:34 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:20.182 04:20:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.182 04:20:34 -- common/autotest_common.sh@10 -- # set +x 00:23:20.182 [2024-05-14 04:20:34.766856] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:20.443 04:20:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.443 04:20:34 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:20.443 04:20:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.443 04:20:34 -- common/autotest_common.sh@10 -- # set +x 00:23:20.443 04:20:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.443 04:20:34 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:20.443 04:20:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.443 04:20:34 -- common/autotest_common.sh@10 -- # set +x 00:23:20.443 04:20:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.443 04:20:34 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:20.443 04:20:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.443 04:20:34 -- common/autotest_common.sh@10 -- # set +x 00:23:20.443 [2024-05-14 04:20:34.803817] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:20.443 04:20:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.443 04:20:34 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:21.830 04:20:36 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:21.830 04:20:36 -- common/autotest_common.sh@1177 -- # local i=0 00:23:21.830 04:20:36 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:23:21.830 04:20:36 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:23:21.830 04:20:36 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:23.748 04:20:38 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:23.748 04:20:38 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:23.748 04:20:38 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:23:23.748 04:20:38 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:23.748 04:20:38 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:23.748 04:20:38 -- common/autotest_common.sh@1187 -- # return 0 00:23:23.748 04:20:38 -- target/initiator_timeout.sh@35 -- # fio_pid=4018344 00:23:23.748 04:20:38 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:23.748 04:20:38 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:24.040 [global] 00:23:24.040 thread=1 00:23:24.040 invalidate=1 00:23:24.040 rw=write 00:23:24.040 time_based=1 00:23:24.040 runtime=60 00:23:24.040 ioengine=libaio 00:23:24.040 direct=1 00:23:24.040 bs=4096 00:23:24.040 iodepth=1 00:23:24.040 norandommap=0 00:23:24.040 numjobs=1 00:23:24.040 00:23:24.040 verify_dump=1 00:23:24.040 verify_backlog=512 00:23:24.040 verify_state_save=0 00:23:24.040 do_verify=1 00:23:24.040 verify=crc32c-intel 00:23:24.040 [job0] 00:23:24.040 filename=/dev/nvme0n1 00:23:24.040 Could not set queue depth (nvme0n1) 00:23:24.307 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:24.307 fio-3.35 00:23:24.307 Starting 1 thread 00:23:26.845 04:20:41 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:26.845 04:20:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:26.845 04:20:41 -- common/autotest_common.sh@10 -- # set +x 00:23:26.845 true 00:23:26.845 04:20:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:26.845 04:20:41 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:26.845 04:20:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:26.845 04:20:41 -- common/autotest_common.sh@10 -- # set +x 00:23:26.845 true 00:23:26.845 04:20:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:26.845 04:20:41 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:26.845 04:20:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:26.845 04:20:41 -- common/autotest_common.sh@10 -- # set +x 00:23:26.846 true 00:23:26.846 04:20:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:26.846 04:20:41 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:26.846 04:20:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:26.846 04:20:41 -- common/autotest_common.sh@10 -- # set +x 00:23:26.846 true 00:23:26.846 04:20:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:26.846 04:20:41 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:30.131 04:20:44 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:30.131 04:20:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:30.131 04:20:44 -- common/autotest_common.sh@10 -- # set +x 00:23:30.131 true 00:23:30.131 04:20:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:30.131 04:20:44 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:30.131 04:20:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:30.131 04:20:44 -- common/autotest_common.sh@10 -- # set +x 00:23:30.131 true 00:23:30.131 04:20:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:30.131 04:20:44 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:30.131 04:20:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:30.131 04:20:44 -- common/autotest_common.sh@10 -- # set +x 00:23:30.131 true 00:23:30.131 04:20:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:30.131 04:20:44 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:30.131 04:20:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:30.131 04:20:44 -- common/autotest_common.sh@10 -- # set +x 00:23:30.131 true 00:23:30.131 04:20:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:30.131 04:20:44 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:30.131 04:20:44 -- target/initiator_timeout.sh@54 -- # wait 4018344 00:24:26.372 00:24:26.372 job0: (groupid=0, jobs=1): err= 0: pid=4018543: Tue May 14 04:21:38 2024 00:24:26.372 read: IOPS=24, BW=96.3KiB/s (98.7kB/s)(5784KiB/60036msec) 00:24:26.372 slat (usec): min=6, max=7194, avg=33.10, stdev=253.47 00:24:26.372 clat (usec): min=423, max=42044k, avg=40630.79, stdev=1105494.56 00:24:26.372 lat (usec): min=448, max=42044k, avg=40663.89, stdev=1105494.52 00:24:26.372 clat percentiles (usec): 00:24:26.372 | 1.00th=[ 627], 5.00th=[ 750], 10.00th=[ 807], 00:24:26.372 | 20.00th=[ 881], 30.00th=[ 938], 40.00th=[ 979], 00:24:26.372 | 50.00th=[ 1020], 60.00th=[ 1221], 70.00th=[ 1549], 00:24:26.372 | 80.00th=[ 41681], 90.00th=[ 42206], 95.00th=[ 42206], 00:24:26.372 | 99.00th=[ 42730], 99.50th=[ 42730], 99.90th=[ 43254], 00:24:26.372 | 99.95th=[17112761], 99.99th=[17112761] 00:24:26.372 write: IOPS=25, BW=102KiB/s (105kB/s)(6144KiB/60036msec); 0 zone resets 00:24:26.372 slat (nsec): min=9452, max=64552, avg=27978.47, stdev=8367.74 00:24:26.372 clat (usec): min=191, max=2265, avg=761.19, stdev=192.23 00:24:26.372 lat (usec): min=204, max=2297, avg=789.17, stdev=196.03 00:24:26.372 clat percentiles (usec): 00:24:26.372 | 1.00th=[ 330], 5.00th=[ 433], 10.00th=[ 478], 20.00th=[ 570], 00:24:26.372 | 30.00th=[ 660], 40.00th=[ 742], 50.00th=[ 799], 60.00th=[ 840], 00:24:26.372 | 70.00th=[ 881], 80.00th=[ 938], 90.00th=[ 996], 95.00th=[ 1012], 00:24:26.372 | 99.00th=[ 1057], 99.50th=[ 1090], 99.90th=[ 1123], 99.95th=[ 2278], 00:24:26.372 | 99.99th=[ 2278] 00:24:26.372 bw ( KiB/s): min= 48, max= 4096, per=100.00%, avg=2457.60, stdev=1806.12, samples=5 00:24:26.372 iops : min= 12, max= 1024, avg=614.40, stdev=451.53, samples=5 00:24:26.372 lat (usec) : 250=0.13%, 500=6.20%, 750=18.34%, 1000=44.94% 00:24:26.372 lat (msec) : 2=17.87%, 4=0.03%, 50=12.44%, >=2000=0.03% 00:24:26.372 cpu : usr=0.08%, sys=0.14%, ctx=2984, majf=0, minf=1 00:24:26.372 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:26.372 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:26.372 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:26.372 issued rwts: total=1446,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:26.372 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:26.372 00:24:26.372 Run status group 0 (all jobs): 00:24:26.372 READ: bw=96.3KiB/s (98.7kB/s), 96.3KiB/s-96.3KiB/s (98.7kB/s-98.7kB/s), io=5784KiB (5923kB), run=60036-60036msec 00:24:26.372 WRITE: bw=102KiB/s (105kB/s), 102KiB/s-102KiB/s (105kB/s-105kB/s), io=6144KiB (6291kB), run=60036-60036msec 00:24:26.372 00:24:26.372 Disk stats (read/write): 00:24:26.372 nvme0n1: ios=1541/1536, merge=0/0, ticks=17901/1167, in_queue=19068, util=99.65% 00:24:26.372 04:21:38 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:26.372 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:26.372 04:21:38 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:26.372 04:21:38 -- common/autotest_common.sh@1198 -- # local i=0 00:24:26.372 04:21:38 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:24:26.372 04:21:38 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:26.372 04:21:39 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:24:26.372 04:21:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:26.372 04:21:39 -- common/autotest_common.sh@1210 -- # return 0 00:24:26.372 04:21:39 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:26.372 04:21:39 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:26.372 nvmf hotplug test: fio successful as expected 00:24:26.372 04:21:39 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:26.372 04:21:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:26.372 04:21:39 -- common/autotest_common.sh@10 -- # set +x 00:24:26.372 04:21:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:26.372 04:21:39 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:26.372 04:21:39 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:26.372 04:21:39 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:26.372 04:21:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:26.372 04:21:39 -- nvmf/common.sh@116 -- # sync 00:24:26.372 04:21:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:26.372 04:21:39 -- nvmf/common.sh@119 -- # set +e 00:24:26.372 04:21:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:26.372 04:21:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:26.372 rmmod nvme_tcp 00:24:26.372 rmmod nvme_fabrics 00:24:26.372 rmmod nvme_keyring 00:24:26.372 04:21:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:26.372 04:21:39 -- nvmf/common.sh@123 -- # set -e 00:24:26.372 04:21:39 -- nvmf/common.sh@124 -- # return 0 00:24:26.372 04:21:39 -- nvmf/common.sh@477 -- # '[' -n 4017336 ']' 00:24:26.372 04:21:39 -- nvmf/common.sh@478 -- # killprocess 4017336 00:24:26.372 04:21:39 -- common/autotest_common.sh@926 -- # '[' -z 4017336 ']' 00:24:26.372 04:21:39 -- common/autotest_common.sh@930 -- # kill -0 4017336 00:24:26.372 04:21:39 -- common/autotest_common.sh@931 -- # uname 00:24:26.372 04:21:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:26.372 04:21:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4017336 00:24:26.372 04:21:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:26.372 04:21:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:26.372 04:21:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4017336' 00:24:26.372 killing process with pid 4017336 00:24:26.372 04:21:39 -- common/autotest_common.sh@945 -- # kill 4017336 00:24:26.372 04:21:39 -- common/autotest_common.sh@950 -- # wait 4017336 00:24:26.372 04:21:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:26.372 04:21:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:26.372 04:21:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:26.372 04:21:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:26.372 04:21:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:26.372 04:21:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:26.372 04:21:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:26.372 04:21:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:26.943 04:21:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:26.943 00:24:26.943 real 1m14.692s 00:24:26.943 user 4m37.709s 00:24:26.943 sys 0m6.829s 00:24:26.943 04:21:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:26.943 04:21:41 -- common/autotest_common.sh@10 -- # set +x 00:24:26.943 ************************************ 00:24:26.943 END TEST nvmf_initiator_timeout 00:24:26.943 ************************************ 00:24:26.943 04:21:41 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:26.943 04:21:41 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:26.943 04:21:41 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:26.943 04:21:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:26.943 04:21:41 -- common/autotest_common.sh@10 -- # set +x 00:24:35.123 04:21:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:35.123 04:21:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:35.123 04:21:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:35.123 04:21:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:35.123 04:21:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:35.123 04:21:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:35.123 04:21:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:35.123 04:21:48 -- nvmf/common.sh@294 -- # net_devs=() 00:24:35.123 04:21:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:35.123 04:21:48 -- nvmf/common.sh@295 -- # e810=() 00:24:35.123 04:21:48 -- nvmf/common.sh@295 -- # local -ga e810 00:24:35.123 04:21:48 -- nvmf/common.sh@296 -- # x722=() 00:24:35.123 04:21:48 -- nvmf/common.sh@296 -- # local -ga x722 00:24:35.123 04:21:48 -- nvmf/common.sh@297 -- # mlx=() 00:24:35.123 04:21:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:35.123 04:21:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:35.123 04:21:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:35.123 04:21:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:35.124 04:21:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:35.124 04:21:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:35.124 04:21:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:35.124 04:21:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:35.124 04:21:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:35.124 04:21:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:35.124 04:21:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:35.124 04:21:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:35.124 04:21:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:35.124 04:21:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:35.124 04:21:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:35.124 04:21:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:35.124 04:21:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:24:35.124 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:24:35.124 04:21:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:35.124 04:21:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:24:35.124 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:24:35.124 04:21:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:35.124 04:21:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:35.124 04:21:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:35.124 04:21:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:35.124 04:21:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:35.124 04:21:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:24:35.124 Found net devices under 0000:4b:00.0: cvl_0_0 00:24:35.124 04:21:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:35.124 04:21:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:35.124 04:21:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:35.124 04:21:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:35.124 04:21:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:35.124 04:21:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:24:35.124 Found net devices under 0000:4b:00.1: cvl_0_1 00:24:35.124 04:21:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:35.124 04:21:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:35.124 04:21:48 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:35.124 04:21:48 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:35.124 04:21:48 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:35.124 04:21:48 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:35.124 04:21:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:35.124 04:21:48 -- common/autotest_common.sh@10 -- # set +x 00:24:35.124 ************************************ 00:24:35.124 START TEST nvmf_perf_adq 00:24:35.124 ************************************ 00:24:35.124 04:21:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:35.124 * Looking for test storage... 00:24:35.124 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:35.124 04:21:48 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:35.124 04:21:48 -- nvmf/common.sh@7 -- # uname -s 00:24:35.124 04:21:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:35.124 04:21:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:35.124 04:21:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:35.124 04:21:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:35.124 04:21:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:35.124 04:21:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:35.124 04:21:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:35.124 04:21:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:35.124 04:21:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:35.124 04:21:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:35.124 04:21:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:24:35.124 04:21:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:24:35.124 04:21:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:35.124 04:21:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:35.124 04:21:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:35.124 04:21:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:35.124 04:21:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:35.124 04:21:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:35.124 04:21:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:35.124 04:21:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:35.124 04:21:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:35.124 04:21:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:35.124 04:21:48 -- paths/export.sh@5 -- # export PATH 00:24:35.124 04:21:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:35.124 04:21:48 -- nvmf/common.sh@46 -- # : 0 00:24:35.124 04:21:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:35.124 04:21:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:35.124 04:21:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:35.124 04:21:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:35.124 04:21:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:35.124 04:21:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:35.124 04:21:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:35.124 04:21:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:35.124 04:21:48 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:35.124 04:21:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:35.124 04:21:48 -- common/autotest_common.sh@10 -- # set +x 00:24:41.710 04:21:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:41.710 04:21:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:41.710 04:21:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:41.710 04:21:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:41.710 04:21:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:41.710 04:21:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:41.710 04:21:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:41.710 04:21:55 -- nvmf/common.sh@294 -- # net_devs=() 00:24:41.710 04:21:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:41.710 04:21:55 -- nvmf/common.sh@295 -- # e810=() 00:24:41.710 04:21:55 -- nvmf/common.sh@295 -- # local -ga e810 00:24:41.710 04:21:55 -- nvmf/common.sh@296 -- # x722=() 00:24:41.710 04:21:55 -- nvmf/common.sh@296 -- # local -ga x722 00:24:41.710 04:21:55 -- nvmf/common.sh@297 -- # mlx=() 00:24:41.710 04:21:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:41.710 04:21:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:41.710 04:21:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:41.710 04:21:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:41.710 04:21:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:41.710 04:21:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:41.710 04:21:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:24:41.710 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:24:41.710 04:21:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:41.710 04:21:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:24:41.710 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:24:41.710 04:21:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:41.710 04:21:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:41.710 04:21:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:41.710 04:21:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:41.710 04:21:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:41.710 04:21:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:41.710 04:21:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:24:41.710 Found net devices under 0000:4b:00.0: cvl_0_0 00:24:41.710 04:21:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:41.710 04:21:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:41.710 04:21:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:41.710 04:21:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:41.710 04:21:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:41.710 04:21:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:24:41.710 Found net devices under 0000:4b:00.1: cvl_0_1 00:24:41.710 04:21:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:41.710 04:21:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:41.710 04:21:55 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:41.710 04:21:55 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:41.710 04:21:55 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:41.710 04:21:55 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:41.710 04:21:55 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:42.651 04:21:56 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:44.565 04:21:58 -- target/perf_adq.sh@54 -- # sleep 5 00:24:49.852 04:22:03 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:49.852 04:22:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:49.852 04:22:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:49.852 04:22:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:49.852 04:22:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:49.852 04:22:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:49.852 04:22:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:49.852 04:22:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:49.852 04:22:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:49.852 04:22:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:49.852 04:22:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:49.852 04:22:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.852 04:22:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:49.852 04:22:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:49.852 04:22:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:49.852 04:22:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:49.852 04:22:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:49.852 04:22:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:49.852 04:22:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:49.852 04:22:03 -- nvmf/common.sh@294 -- # net_devs=() 00:24:49.852 04:22:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:49.852 04:22:03 -- nvmf/common.sh@295 -- # e810=() 00:24:49.852 04:22:03 -- nvmf/common.sh@295 -- # local -ga e810 00:24:49.852 04:22:03 -- nvmf/common.sh@296 -- # x722=() 00:24:49.852 04:22:03 -- nvmf/common.sh@296 -- # local -ga x722 00:24:49.852 04:22:03 -- nvmf/common.sh@297 -- # mlx=() 00:24:49.852 04:22:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:49.852 04:22:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:49.852 04:22:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:49.852 04:22:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:49.852 04:22:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:49.852 04:22:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.852 04:22:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:24:49.852 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:24:49.852 04:22:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.852 04:22:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:24:49.852 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:24:49.852 04:22:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:49.852 04:22:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:49.852 04:22:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.852 04:22:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.852 04:22:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.852 04:22:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.852 04:22:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:24:49.852 Found net devices under 0000:4b:00.0: cvl_0_0 00:24:49.852 04:22:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.852 04:22:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.852 04:22:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.852 04:22:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.852 04:22:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.852 04:22:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:24:49.853 Found net devices under 0000:4b:00.1: cvl_0_1 00:24:49.853 04:22:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.853 04:22:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:49.853 04:22:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:49.853 04:22:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:49.853 04:22:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:49.853 04:22:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:49.853 04:22:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:49.853 04:22:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:49.853 04:22:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:49.853 04:22:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:49.853 04:22:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:49.853 04:22:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:49.853 04:22:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:49.853 04:22:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:49.853 04:22:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:49.853 04:22:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:49.853 04:22:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:49.853 04:22:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:49.853 04:22:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:49.853 04:22:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:49.853 04:22:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:49.853 04:22:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:49.853 04:22:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:49.853 04:22:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:49.853 04:22:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:49.853 04:22:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:49.853 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:49.853 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.515 ms 00:24:49.853 00:24:49.853 --- 10.0.0.2 ping statistics --- 00:24:49.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:49.853 rtt min/avg/max/mdev = 0.515/0.515/0.515/0.000 ms 00:24:49.853 04:22:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:49.853 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:49.853 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.366 ms 00:24:49.853 00:24:49.853 --- 10.0.0.1 ping statistics --- 00:24:49.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:49.853 rtt min/avg/max/mdev = 0.366/0.366/0.366/0.000 ms 00:24:49.853 04:22:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:49.853 04:22:04 -- nvmf/common.sh@410 -- # return 0 00:24:49.853 04:22:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:49.853 04:22:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:49.853 04:22:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:49.853 04:22:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:49.853 04:22:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:49.853 04:22:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:49.853 04:22:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:49.853 04:22:04 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:49.853 04:22:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:49.853 04:22:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:49.853 04:22:04 -- common/autotest_common.sh@10 -- # set +x 00:24:49.853 04:22:04 -- nvmf/common.sh@469 -- # nvmfpid=4040313 00:24:49.853 04:22:04 -- nvmf/common.sh@470 -- # waitforlisten 4040313 00:24:49.853 04:22:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:49.853 04:22:04 -- common/autotest_common.sh@819 -- # '[' -z 4040313 ']' 00:24:49.853 04:22:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:49.853 04:22:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:49.853 04:22:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:49.853 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:49.853 04:22:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:49.853 04:22:04 -- common/autotest_common.sh@10 -- # set +x 00:24:49.853 [2024-05-14 04:22:04.301572] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:24:49.853 [2024-05-14 04:22:04.301631] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:49.853 EAL: No free 2048 kB hugepages reported on node 1 00:24:49.853 [2024-05-14 04:22:04.374192] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:50.114 [2024-05-14 04:22:04.446009] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:50.114 [2024-05-14 04:22:04.446148] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:50.114 [2024-05-14 04:22:04.446158] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:50.114 [2024-05-14 04:22:04.446166] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:50.114 [2024-05-14 04:22:04.446629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:50.114 [2024-05-14 04:22:04.446788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:50.114 [2024-05-14 04:22:04.447033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:50.114 [2024-05-14 04:22:04.447035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:50.687 04:22:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:50.687 04:22:05 -- common/autotest_common.sh@852 -- # return 0 00:24:50.687 04:22:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:50.687 04:22:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:50.687 04:22:05 -- common/autotest_common.sh@10 -- # set +x 00:24:50.687 04:22:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:50.687 04:22:05 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:50.687 04:22:05 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:50.687 04:22:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.687 04:22:05 -- common/autotest_common.sh@10 -- # set +x 00:24:50.687 04:22:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.687 04:22:05 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:50.687 04:22:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.687 04:22:05 -- common/autotest_common.sh@10 -- # set +x 00:24:50.687 04:22:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.687 04:22:05 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:50.687 04:22:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.687 04:22:05 -- common/autotest_common.sh@10 -- # set +x 00:24:50.687 [2024-05-14 04:22:05.215284] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:50.687 04:22:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.687 04:22:05 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:50.687 04:22:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.687 04:22:05 -- common/autotest_common.sh@10 -- # set +x 00:24:50.687 Malloc1 00:24:50.687 04:22:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.687 04:22:05 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:50.687 04:22:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.687 04:22:05 -- common/autotest_common.sh@10 -- # set +x 00:24:50.687 04:22:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.687 04:22:05 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:50.687 04:22:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.687 04:22:05 -- common/autotest_common.sh@10 -- # set +x 00:24:50.687 04:22:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.687 04:22:05 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:50.687 04:22:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.687 04:22:05 -- common/autotest_common.sh@10 -- # set +x 00:24:50.687 [2024-05-14 04:22:05.274623] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:50.949 04:22:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.949 04:22:05 -- target/perf_adq.sh@73 -- # perfpid=4040666 00:24:50.949 04:22:05 -- target/perf_adq.sh@74 -- # sleep 2 00:24:50.949 04:22:05 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:50.949 EAL: No free 2048 kB hugepages reported on node 1 00:24:52.865 04:22:07 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:52.865 04:22:07 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:52.865 04:22:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:52.865 04:22:07 -- target/perf_adq.sh@76 -- # wc -l 00:24:52.865 04:22:07 -- common/autotest_common.sh@10 -- # set +x 00:24:52.865 04:22:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:52.865 04:22:07 -- target/perf_adq.sh@76 -- # count=4 00:24:52.865 04:22:07 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:52.865 04:22:07 -- target/perf_adq.sh@81 -- # wait 4040666 00:25:01.015 Initializing NVMe Controllers 00:25:01.015 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:01.015 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:01.015 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:01.015 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:01.015 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:01.015 Initialization complete. Launching workers. 00:25:01.015 ======================================================== 00:25:01.015 Latency(us) 00:25:01.015 Device Information : IOPS MiB/s Average min max 00:25:01.015 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 12430.90 48.56 5148.39 1935.62 8869.14 00:25:01.015 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 15524.65 60.64 4121.90 1325.90 11125.09 00:25:01.015 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 15174.46 59.28 4217.23 1313.20 11570.47 00:25:01.015 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10732.13 41.92 5982.01 2068.82 48322.11 00:25:01.015 ======================================================== 00:25:01.015 Total : 53862.15 210.40 4756.29 1313.20 48322.11 00:25:01.015 00:25:01.015 04:22:15 -- target/perf_adq.sh@82 -- # nvmftestfini 00:25:01.015 04:22:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:01.015 04:22:15 -- nvmf/common.sh@116 -- # sync 00:25:01.015 04:22:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:01.015 04:22:15 -- nvmf/common.sh@119 -- # set +e 00:25:01.015 04:22:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:01.015 04:22:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:01.015 rmmod nvme_tcp 00:25:01.015 rmmod nvme_fabrics 00:25:01.015 rmmod nvme_keyring 00:25:01.015 04:22:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:01.015 04:22:15 -- nvmf/common.sh@123 -- # set -e 00:25:01.015 04:22:15 -- nvmf/common.sh@124 -- # return 0 00:25:01.015 04:22:15 -- nvmf/common.sh@477 -- # '[' -n 4040313 ']' 00:25:01.015 04:22:15 -- nvmf/common.sh@478 -- # killprocess 4040313 00:25:01.015 04:22:15 -- common/autotest_common.sh@926 -- # '[' -z 4040313 ']' 00:25:01.015 04:22:15 -- common/autotest_common.sh@930 -- # kill -0 4040313 00:25:01.015 04:22:15 -- common/autotest_common.sh@931 -- # uname 00:25:01.015 04:22:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:01.015 04:22:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4040313 00:25:01.277 04:22:15 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:01.277 04:22:15 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:01.277 04:22:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4040313' 00:25:01.277 killing process with pid 4040313 00:25:01.277 04:22:15 -- common/autotest_common.sh@945 -- # kill 4040313 00:25:01.277 04:22:15 -- common/autotest_common.sh@950 -- # wait 4040313 00:25:01.277 04:22:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:01.277 04:22:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:01.277 04:22:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:01.277 04:22:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:01.277 04:22:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:01.277 04:22:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:01.277 04:22:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:01.277 04:22:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:03.276 04:22:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:03.276 04:22:17 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:25:03.276 04:22:17 -- target/perf_adq.sh@52 -- # rmmod ice 00:25:05.193 04:22:19 -- target/perf_adq.sh@53 -- # modprobe ice 00:25:07.107 04:22:21 -- target/perf_adq.sh@54 -- # sleep 5 00:25:12.399 04:22:26 -- target/perf_adq.sh@87 -- # nvmftestinit 00:25:12.399 04:22:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:12.399 04:22:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:12.399 04:22:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:12.399 04:22:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:12.399 04:22:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:12.399 04:22:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:12.399 04:22:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:12.399 04:22:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:12.399 04:22:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:12.399 04:22:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:12.399 04:22:26 -- common/autotest_common.sh@10 -- # set +x 00:25:12.399 04:22:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:12.399 04:22:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:12.399 04:22:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:12.399 04:22:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:12.399 04:22:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:12.399 04:22:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:12.399 04:22:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:12.399 04:22:26 -- nvmf/common.sh@294 -- # net_devs=() 00:25:12.399 04:22:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:12.399 04:22:26 -- nvmf/common.sh@295 -- # e810=() 00:25:12.399 04:22:26 -- nvmf/common.sh@295 -- # local -ga e810 00:25:12.399 04:22:26 -- nvmf/common.sh@296 -- # x722=() 00:25:12.399 04:22:26 -- nvmf/common.sh@296 -- # local -ga x722 00:25:12.399 04:22:26 -- nvmf/common.sh@297 -- # mlx=() 00:25:12.399 04:22:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:12.399 04:22:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:12.399 04:22:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:12.399 04:22:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:12.399 04:22:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:12.399 04:22:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:12.399 04:22:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:25:12.399 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:25:12.399 04:22:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:12.399 04:22:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:25:12.399 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:25:12.399 04:22:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:12.399 04:22:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:12.399 04:22:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:12.399 04:22:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:12.399 04:22:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:12.399 04:22:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:25:12.399 Found net devices under 0000:4b:00.0: cvl_0_0 00:25:12.399 04:22:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:12.399 04:22:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:12.399 04:22:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:12.399 04:22:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:12.399 04:22:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:12.399 04:22:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:25:12.399 Found net devices under 0000:4b:00.1: cvl_0_1 00:25:12.399 04:22:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:12.399 04:22:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:12.399 04:22:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:12.399 04:22:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:12.399 04:22:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:12.399 04:22:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:12.399 04:22:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:12.399 04:22:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:12.399 04:22:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:12.399 04:22:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:12.399 04:22:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:12.399 04:22:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:12.399 04:22:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:12.399 04:22:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:12.399 04:22:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:12.399 04:22:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:12.399 04:22:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:12.399 04:22:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:12.399 04:22:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:12.399 04:22:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:12.399 04:22:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:12.399 04:22:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:12.399 04:22:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:12.399 04:22:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:12.399 04:22:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:12.399 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:12.399 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.664 ms 00:25:12.399 00:25:12.399 --- 10.0.0.2 ping statistics --- 00:25:12.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:12.399 rtt min/avg/max/mdev = 0.664/0.664/0.664/0.000 ms 00:25:12.399 04:22:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:12.399 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:12.400 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.432 ms 00:25:12.400 00:25:12.400 --- 10.0.0.1 ping statistics --- 00:25:12.400 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:12.400 rtt min/avg/max/mdev = 0.432/0.432/0.432/0.000 ms 00:25:12.400 04:22:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:12.400 04:22:26 -- nvmf/common.sh@410 -- # return 0 00:25:12.400 04:22:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:12.400 04:22:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:12.400 04:22:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:12.400 04:22:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:12.400 04:22:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:12.400 04:22:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:12.400 04:22:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:12.400 04:22:26 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:25:12.400 04:22:26 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:25:12.400 04:22:26 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:25:12.400 04:22:26 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:25:12.400 net.core.busy_poll = 1 00:25:12.400 04:22:26 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:25:12.400 net.core.busy_read = 1 00:25:12.400 04:22:26 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:25:12.400 04:22:26 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:25:12.400 04:22:26 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:25:12.400 04:22:26 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:25:12.400 04:22:26 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:25:12.660 04:22:27 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:12.660 04:22:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:12.660 04:22:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:12.660 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:25:12.660 04:22:27 -- nvmf/common.sh@469 -- # nvmfpid=4045177 00:25:12.660 04:22:27 -- nvmf/common.sh@470 -- # waitforlisten 4045177 00:25:12.661 04:22:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:12.661 04:22:27 -- common/autotest_common.sh@819 -- # '[' -z 4045177 ']' 00:25:12.661 04:22:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:12.661 04:22:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:12.661 04:22:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:12.661 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:12.661 04:22:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:12.661 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:25:12.661 [2024-05-14 04:22:27.070869] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:12.661 [2024-05-14 04:22:27.070923] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:12.661 EAL: No free 2048 kB hugepages reported on node 1 00:25:12.661 [2024-05-14 04:22:27.135699] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:12.661 [2024-05-14 04:22:27.204361] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:12.661 [2024-05-14 04:22:27.204494] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:12.661 [2024-05-14 04:22:27.204504] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:12.661 [2024-05-14 04:22:27.204512] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:12.661 [2024-05-14 04:22:27.204649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:12.661 [2024-05-14 04:22:27.204748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:12.661 [2024-05-14 04:22:27.204910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:12.661 [2024-05-14 04:22:27.204911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:13.604 04:22:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:13.604 04:22:27 -- common/autotest_common.sh@852 -- # return 0 00:25:13.604 04:22:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:13.604 04:22:27 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:13.604 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:25:13.604 04:22:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:13.604 04:22:27 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:25:13.604 04:22:27 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:25:13.604 04:22:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:13.604 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:25:13.604 04:22:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:13.604 04:22:27 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:13.604 04:22:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:13.604 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:25:13.604 04:22:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:13.604 04:22:27 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:25:13.604 04:22:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:13.604 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:25:13.604 [2024-05-14 04:22:27.960540] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:13.604 04:22:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:13.604 04:22:27 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:13.604 04:22:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:13.604 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:25:13.604 Malloc1 00:25:13.604 04:22:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:13.604 04:22:27 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:13.604 04:22:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:13.604 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:25:13.604 04:22:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:13.604 04:22:27 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:13.604 04:22:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:13.604 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:25:13.604 04:22:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:13.604 04:22:28 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:13.604 04:22:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:13.604 04:22:28 -- common/autotest_common.sh@10 -- # set +x 00:25:13.604 [2024-05-14 04:22:28.015911] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:13.604 04:22:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:13.604 04:22:28 -- target/perf_adq.sh@94 -- # perfpid=4045519 00:25:13.604 04:22:28 -- target/perf_adq.sh@95 -- # sleep 2 00:25:13.604 04:22:28 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:13.604 EAL: No free 2048 kB hugepages reported on node 1 00:25:15.520 04:22:30 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:15.520 04:22:30 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:15.520 04:22:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:15.520 04:22:30 -- target/perf_adq.sh@97 -- # wc -l 00:25:15.520 04:22:30 -- common/autotest_common.sh@10 -- # set +x 00:25:15.520 04:22:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:15.520 04:22:30 -- target/perf_adq.sh@97 -- # count=3 00:25:15.520 04:22:30 -- target/perf_adq.sh@98 -- # [[ 3 -lt 2 ]] 00:25:15.520 04:22:30 -- target/perf_adq.sh@103 -- # wait 4045519 00:25:23.662 Initializing NVMe Controllers 00:25:23.662 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:23.662 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:23.662 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:23.662 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:23.662 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:23.662 Initialization complete. Launching workers. 00:25:23.662 ======================================================== 00:25:23.662 Latency(us) 00:25:23.662 Device Information : IOPS MiB/s Average min max 00:25:23.662 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7386.60 28.85 8665.91 1542.58 53262.28 00:25:23.662 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 7419.90 28.98 8625.14 1576.24 53546.00 00:25:23.662 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7105.30 27.76 9006.51 1683.28 53261.94 00:25:23.662 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 7011.20 27.39 9127.38 1557.01 52795.75 00:25:23.662 ======================================================== 00:25:23.662 Total : 28923.00 112.98 8850.99 1542.58 53546.00 00:25:23.662 00:25:23.662 04:22:38 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:23.662 04:22:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:23.662 04:22:38 -- nvmf/common.sh@116 -- # sync 00:25:23.662 04:22:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:23.662 04:22:38 -- nvmf/common.sh@119 -- # set +e 00:25:23.662 04:22:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:23.662 04:22:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:23.662 rmmod nvme_tcp 00:25:23.662 rmmod nvme_fabrics 00:25:23.662 rmmod nvme_keyring 00:25:23.662 04:22:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:23.925 04:22:38 -- nvmf/common.sh@123 -- # set -e 00:25:23.925 04:22:38 -- nvmf/common.sh@124 -- # return 0 00:25:23.925 04:22:38 -- nvmf/common.sh@477 -- # '[' -n 4045177 ']' 00:25:23.925 04:22:38 -- nvmf/common.sh@478 -- # killprocess 4045177 00:25:23.925 04:22:38 -- common/autotest_common.sh@926 -- # '[' -z 4045177 ']' 00:25:23.925 04:22:38 -- common/autotest_common.sh@930 -- # kill -0 4045177 00:25:23.925 04:22:38 -- common/autotest_common.sh@931 -- # uname 00:25:23.925 04:22:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:23.925 04:22:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4045177 00:25:23.925 04:22:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:23.925 04:22:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:23.925 04:22:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4045177' 00:25:23.925 killing process with pid 4045177 00:25:23.925 04:22:38 -- common/autotest_common.sh@945 -- # kill 4045177 00:25:23.925 04:22:38 -- common/autotest_common.sh@950 -- # wait 4045177 00:25:23.925 04:22:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:23.925 04:22:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:23.925 04:22:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:23.925 04:22:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:23.925 04:22:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:23.925 04:22:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:23.925 04:22:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:23.925 04:22:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:26.479 04:22:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:26.479 04:22:40 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:26.479 00:25:26.479 real 0m52.209s 00:25:26.479 user 2m45.492s 00:25:26.479 sys 0m12.286s 00:25:26.479 04:22:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:26.479 04:22:40 -- common/autotest_common.sh@10 -- # set +x 00:25:26.479 ************************************ 00:25:26.479 END TEST nvmf_perf_adq 00:25:26.479 ************************************ 00:25:26.479 04:22:40 -- nvmf/nvmf.sh@80 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:26.479 04:22:40 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:26.479 04:22:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:26.479 04:22:40 -- common/autotest_common.sh@10 -- # set +x 00:25:26.479 ************************************ 00:25:26.479 START TEST nvmf_shutdown 00:25:26.479 ************************************ 00:25:26.479 04:22:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:26.479 * Looking for test storage... 00:25:26.479 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:26.479 04:22:40 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:26.479 04:22:40 -- nvmf/common.sh@7 -- # uname -s 00:25:26.479 04:22:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:26.479 04:22:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:26.479 04:22:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:26.479 04:22:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:26.479 04:22:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:26.479 04:22:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:26.479 04:22:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:26.479 04:22:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:26.479 04:22:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:26.479 04:22:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:26.479 04:22:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:26.479 04:22:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:26.479 04:22:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:26.479 04:22:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:26.479 04:22:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:26.479 04:22:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:26.479 04:22:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:26.479 04:22:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:26.479 04:22:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:26.479 04:22:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.479 04:22:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.479 04:22:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.479 04:22:40 -- paths/export.sh@5 -- # export PATH 00:25:26.479 04:22:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.479 04:22:40 -- nvmf/common.sh@46 -- # : 0 00:25:26.479 04:22:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:26.479 04:22:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:26.479 04:22:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:26.479 04:22:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:26.479 04:22:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:26.479 04:22:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:26.479 04:22:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:26.479 04:22:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:26.479 04:22:40 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:26.479 04:22:40 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:26.479 04:22:40 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:26.479 04:22:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:25:26.479 04:22:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:26.479 04:22:40 -- common/autotest_common.sh@10 -- # set +x 00:25:26.479 ************************************ 00:25:26.479 START TEST nvmf_shutdown_tc1 00:25:26.479 ************************************ 00:25:26.479 04:22:40 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:25:26.479 04:22:40 -- target/shutdown.sh@74 -- # starttarget 00:25:26.479 04:22:40 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:26.479 04:22:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:26.479 04:22:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:26.479 04:22:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:26.479 04:22:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:26.479 04:22:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:26.480 04:22:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:26.480 04:22:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:26.480 04:22:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:26.480 04:22:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:26.480 04:22:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:26.480 04:22:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:26.480 04:22:40 -- common/autotest_common.sh@10 -- # set +x 00:25:33.079 04:22:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:33.079 04:22:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:33.079 04:22:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:33.079 04:22:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:33.079 04:22:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:33.079 04:22:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:33.079 04:22:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:33.079 04:22:47 -- nvmf/common.sh@294 -- # net_devs=() 00:25:33.079 04:22:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:33.079 04:22:47 -- nvmf/common.sh@295 -- # e810=() 00:25:33.079 04:22:47 -- nvmf/common.sh@295 -- # local -ga e810 00:25:33.079 04:22:47 -- nvmf/common.sh@296 -- # x722=() 00:25:33.079 04:22:47 -- nvmf/common.sh@296 -- # local -ga x722 00:25:33.079 04:22:47 -- nvmf/common.sh@297 -- # mlx=() 00:25:33.079 04:22:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:33.079 04:22:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:33.079 04:22:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:33.079 04:22:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:33.079 04:22:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:33.079 04:22:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.079 04:22:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:25:33.079 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:25:33.079 04:22:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.079 04:22:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:25:33.079 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:25:33.079 04:22:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:33.079 04:22:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.079 04:22:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.079 04:22:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.079 04:22:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.079 04:22:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:25:33.079 Found net devices under 0000:4b:00.0: cvl_0_0 00:25:33.079 04:22:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.079 04:22:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.079 04:22:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.079 04:22:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.079 04:22:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.079 04:22:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:25:33.079 Found net devices under 0000:4b:00.1: cvl_0_1 00:25:33.079 04:22:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.079 04:22:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:33.079 04:22:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:33.079 04:22:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:33.079 04:22:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:33.079 04:22:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:33.079 04:22:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:33.079 04:22:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:33.079 04:22:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:33.079 04:22:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:33.079 04:22:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:33.079 04:22:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:33.079 04:22:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:33.079 04:22:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:33.079 04:22:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:33.079 04:22:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:33.079 04:22:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:33.079 04:22:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:33.341 04:22:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:33.341 04:22:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:33.341 04:22:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:33.341 04:22:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:33.341 04:22:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:33.341 04:22:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:33.341 04:22:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:33.341 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:33.341 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.615 ms 00:25:33.341 00:25:33.341 --- 10.0.0.2 ping statistics --- 00:25:33.341 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.341 rtt min/avg/max/mdev = 0.615/0.615/0.615/0.000 ms 00:25:33.341 04:22:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:33.602 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:33.602 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.486 ms 00:25:33.602 00:25:33.602 --- 10.0.0.1 ping statistics --- 00:25:33.602 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.602 rtt min/avg/max/mdev = 0.486/0.486/0.486/0.000 ms 00:25:33.602 04:22:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:33.602 04:22:47 -- nvmf/common.sh@410 -- # return 0 00:25:33.602 04:22:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:33.602 04:22:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:33.602 04:22:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:33.602 04:22:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:33.602 04:22:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:33.602 04:22:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:33.602 04:22:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:33.602 04:22:47 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:33.602 04:22:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:33.602 04:22:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:33.602 04:22:47 -- common/autotest_common.sh@10 -- # set +x 00:25:33.602 04:22:47 -- nvmf/common.sh@469 -- # nvmfpid=4051694 00:25:33.602 04:22:47 -- nvmf/common.sh@470 -- # waitforlisten 4051694 00:25:33.602 04:22:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:33.602 04:22:47 -- common/autotest_common.sh@819 -- # '[' -z 4051694 ']' 00:25:33.602 04:22:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:33.602 04:22:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:33.602 04:22:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:33.602 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:33.602 04:22:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:33.602 04:22:47 -- common/autotest_common.sh@10 -- # set +x 00:25:33.602 [2024-05-14 04:22:48.031027] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:33.602 [2024-05-14 04:22:48.031078] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:33.602 EAL: No free 2048 kB hugepages reported on node 1 00:25:33.602 [2024-05-14 04:22:48.113595] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:33.602 [2024-05-14 04:22:48.177500] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:33.602 [2024-05-14 04:22:48.177636] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:33.603 [2024-05-14 04:22:48.177649] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:33.603 [2024-05-14 04:22:48.177658] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:33.603 [2024-05-14 04:22:48.177811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:33.603 [2024-05-14 04:22:48.177968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:33.603 [2024-05-14 04:22:48.178123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:33.603 [2024-05-14 04:22:48.178125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:34.547 04:22:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:34.547 04:22:48 -- common/autotest_common.sh@852 -- # return 0 00:25:34.547 04:22:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:34.547 04:22:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:34.547 04:22:48 -- common/autotest_common.sh@10 -- # set +x 00:25:34.547 04:22:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:34.547 04:22:48 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:34.547 04:22:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.547 04:22:48 -- common/autotest_common.sh@10 -- # set +x 00:25:34.547 [2024-05-14 04:22:48.884595] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:34.547 04:22:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.547 04:22:48 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:34.547 04:22:48 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:34.547 04:22:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:34.547 04:22:48 -- common/autotest_common.sh@10 -- # set +x 00:25:34.547 04:22:48 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.547 04:22:48 -- target/shutdown.sh@28 -- # cat 00:25:34.547 04:22:48 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:34.547 04:22:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.547 04:22:48 -- common/autotest_common.sh@10 -- # set +x 00:25:34.547 Malloc1 00:25:34.547 [2024-05-14 04:22:48.988081] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:34.547 Malloc2 00:25:34.547 Malloc3 00:25:34.547 Malloc4 00:25:34.547 Malloc5 00:25:34.847 Malloc6 00:25:34.847 Malloc7 00:25:34.847 Malloc8 00:25:34.847 Malloc9 00:25:34.847 Malloc10 00:25:34.847 04:22:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.847 04:22:49 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:34.847 04:22:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:34.847 04:22:49 -- common/autotest_common.sh@10 -- # set +x 00:25:34.847 04:22:49 -- target/shutdown.sh@78 -- # perfpid=4052069 00:25:34.847 04:22:49 -- target/shutdown.sh@79 -- # waitforlisten 4052069 /var/tmp/bdevperf.sock 00:25:34.847 04:22:49 -- common/autotest_common.sh@819 -- # '[' -z 4052069 ']' 00:25:34.847 04:22:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:34.847 04:22:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:34.847 04:22:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:34.847 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:34.847 04:22:49 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:34.847 04:22:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:34.847 04:22:49 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:34.847 04:22:49 -- common/autotest_common.sh@10 -- # set +x 00:25:34.847 04:22:49 -- nvmf/common.sh@520 -- # config=() 00:25:34.847 04:22:49 -- nvmf/common.sh@520 -- # local subsystem config 00:25:34.847 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.847 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.847 { 00:25:34.847 "params": { 00:25:34.847 "name": "Nvme$subsystem", 00:25:34.847 "trtype": "$TEST_TRANSPORT", 00:25:34.847 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.847 "adrfam": "ipv4", 00:25:34.847 "trsvcid": "$NVMF_PORT", 00:25:34.847 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.847 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.847 "hdgst": ${hdgst:-false}, 00:25:34.847 "ddgst": ${ddgst:-false} 00:25:34.847 }, 00:25:34.847 "method": "bdev_nvme_attach_controller" 00:25:34.847 } 00:25:34.847 EOF 00:25:34.847 )") 00:25:34.847 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:34.847 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.847 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.847 { 00:25:34.847 "params": { 00:25:34.847 "name": "Nvme$subsystem", 00:25:34.847 "trtype": "$TEST_TRANSPORT", 00:25:34.847 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.847 "adrfam": "ipv4", 00:25:34.847 "trsvcid": "$NVMF_PORT", 00:25:34.847 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.847 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.847 "hdgst": ${hdgst:-false}, 00:25:34.847 "ddgst": ${ddgst:-false} 00:25:34.847 }, 00:25:34.847 "method": "bdev_nvme_attach_controller" 00:25:34.847 } 00:25:34.847 EOF 00:25:34.847 )") 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:35.115 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.115 { 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme$subsystem", 00:25:35.115 "trtype": "$TEST_TRANSPORT", 00:25:35.115 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "$NVMF_PORT", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.115 "hdgst": ${hdgst:-false}, 00:25:35.115 "ddgst": ${ddgst:-false} 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 } 00:25:35.115 EOF 00:25:35.115 )") 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:35.115 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.115 { 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme$subsystem", 00:25:35.115 "trtype": "$TEST_TRANSPORT", 00:25:35.115 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "$NVMF_PORT", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.115 "hdgst": ${hdgst:-false}, 00:25:35.115 "ddgst": ${ddgst:-false} 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 } 00:25:35.115 EOF 00:25:35.115 )") 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:35.115 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.115 { 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme$subsystem", 00:25:35.115 "trtype": "$TEST_TRANSPORT", 00:25:35.115 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "$NVMF_PORT", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.115 "hdgst": ${hdgst:-false}, 00:25:35.115 "ddgst": ${ddgst:-false} 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 } 00:25:35.115 EOF 00:25:35.115 )") 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:35.115 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.115 { 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme$subsystem", 00:25:35.115 "trtype": "$TEST_TRANSPORT", 00:25:35.115 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "$NVMF_PORT", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.115 "hdgst": ${hdgst:-false}, 00:25:35.115 "ddgst": ${ddgst:-false} 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 } 00:25:35.115 EOF 00:25:35.115 )") 00:25:35.115 [2024-05-14 04:22:49.444154] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:35.115 [2024-05-14 04:22:49.444205] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:35.115 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.115 { 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme$subsystem", 00:25:35.115 "trtype": "$TEST_TRANSPORT", 00:25:35.115 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "$NVMF_PORT", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.115 "hdgst": ${hdgst:-false}, 00:25:35.115 "ddgst": ${ddgst:-false} 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 } 00:25:35.115 EOF 00:25:35.115 )") 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:35.115 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.115 { 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme$subsystem", 00:25:35.115 "trtype": "$TEST_TRANSPORT", 00:25:35.115 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "$NVMF_PORT", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.115 "hdgst": ${hdgst:-false}, 00:25:35.115 "ddgst": ${ddgst:-false} 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 } 00:25:35.115 EOF 00:25:35.115 )") 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:35.115 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.115 { 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme$subsystem", 00:25:35.115 "trtype": "$TEST_TRANSPORT", 00:25:35.115 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "$NVMF_PORT", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.115 "hdgst": ${hdgst:-false}, 00:25:35.115 "ddgst": ${ddgst:-false} 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 } 00:25:35.115 EOF 00:25:35.115 )") 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:35.115 EAL: No free 2048 kB hugepages reported on node 1 00:25:35.115 04:22:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.115 { 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme$subsystem", 00:25:35.115 "trtype": "$TEST_TRANSPORT", 00:25:35.115 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "$NVMF_PORT", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.115 "hdgst": ${hdgst:-false}, 00:25:35.115 "ddgst": ${ddgst:-false} 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 } 00:25:35.115 EOF 00:25:35.115 )") 00:25:35.115 04:22:49 -- nvmf/common.sh@542 -- # cat 00:25:35.115 04:22:49 -- nvmf/common.sh@544 -- # jq . 00:25:35.115 04:22:49 -- nvmf/common.sh@545 -- # IFS=, 00:25:35.115 04:22:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme1", 00:25:35.115 "trtype": "tcp", 00:25:35.115 "traddr": "10.0.0.2", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "4420", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:35.115 "hdgst": false, 00:25:35.115 "ddgst": false 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 },{ 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme2", 00:25:35.115 "trtype": "tcp", 00:25:35.115 "traddr": "10.0.0.2", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "4420", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:35.115 "hdgst": false, 00:25:35.115 "ddgst": false 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 },{ 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme3", 00:25:35.115 "trtype": "tcp", 00:25:35.115 "traddr": "10.0.0.2", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "4420", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:35.115 "hdgst": false, 00:25:35.115 "ddgst": false 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 },{ 00:25:35.115 "params": { 00:25:35.115 "name": "Nvme4", 00:25:35.115 "trtype": "tcp", 00:25:35.115 "traddr": "10.0.0.2", 00:25:35.115 "adrfam": "ipv4", 00:25:35.115 "trsvcid": "4420", 00:25:35.115 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:35.115 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:35.115 "hdgst": false, 00:25:35.115 "ddgst": false 00:25:35.115 }, 00:25:35.115 "method": "bdev_nvme_attach_controller" 00:25:35.115 },{ 00:25:35.115 "params": { 00:25:35.116 "name": "Nvme5", 00:25:35.116 "trtype": "tcp", 00:25:35.116 "traddr": "10.0.0.2", 00:25:35.116 "adrfam": "ipv4", 00:25:35.116 "trsvcid": "4420", 00:25:35.116 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:35.116 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:35.116 "hdgst": false, 00:25:35.116 "ddgst": false 00:25:35.116 }, 00:25:35.116 "method": "bdev_nvme_attach_controller" 00:25:35.116 },{ 00:25:35.116 "params": { 00:25:35.116 "name": "Nvme6", 00:25:35.116 "trtype": "tcp", 00:25:35.116 "traddr": "10.0.0.2", 00:25:35.116 "adrfam": "ipv4", 00:25:35.116 "trsvcid": "4420", 00:25:35.116 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:35.116 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:35.116 "hdgst": false, 00:25:35.116 "ddgst": false 00:25:35.116 }, 00:25:35.116 "method": "bdev_nvme_attach_controller" 00:25:35.116 },{ 00:25:35.116 "params": { 00:25:35.116 "name": "Nvme7", 00:25:35.116 "trtype": "tcp", 00:25:35.116 "traddr": "10.0.0.2", 00:25:35.116 "adrfam": "ipv4", 00:25:35.116 "trsvcid": "4420", 00:25:35.116 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:35.116 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:35.116 "hdgst": false, 00:25:35.116 "ddgst": false 00:25:35.116 }, 00:25:35.116 "method": "bdev_nvme_attach_controller" 00:25:35.116 },{ 00:25:35.116 "params": { 00:25:35.116 "name": "Nvme8", 00:25:35.116 "trtype": "tcp", 00:25:35.116 "traddr": "10.0.0.2", 00:25:35.116 "adrfam": "ipv4", 00:25:35.116 "trsvcid": "4420", 00:25:35.116 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:35.116 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:35.116 "hdgst": false, 00:25:35.116 "ddgst": false 00:25:35.116 }, 00:25:35.116 "method": "bdev_nvme_attach_controller" 00:25:35.116 },{ 00:25:35.116 "params": { 00:25:35.116 "name": "Nvme9", 00:25:35.116 "trtype": "tcp", 00:25:35.116 "traddr": "10.0.0.2", 00:25:35.116 "adrfam": "ipv4", 00:25:35.116 "trsvcid": "4420", 00:25:35.116 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:35.116 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:35.116 "hdgst": false, 00:25:35.116 "ddgst": false 00:25:35.116 }, 00:25:35.116 "method": "bdev_nvme_attach_controller" 00:25:35.116 },{ 00:25:35.116 "params": { 00:25:35.116 "name": "Nvme10", 00:25:35.116 "trtype": "tcp", 00:25:35.116 "traddr": "10.0.0.2", 00:25:35.116 "adrfam": "ipv4", 00:25:35.116 "trsvcid": "4420", 00:25:35.116 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:35.116 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:35.116 "hdgst": false, 00:25:35.116 "ddgst": false 00:25:35.116 }, 00:25:35.116 "method": "bdev_nvme_attach_controller" 00:25:35.116 }' 00:25:35.116 [2024-05-14 04:22:49.505654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:35.116 [2024-05-14 04:22:49.568162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:36.501 04:22:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:36.501 04:22:50 -- common/autotest_common.sh@852 -- # return 0 00:25:36.501 04:22:50 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:36.501 04:22:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:36.501 04:22:50 -- common/autotest_common.sh@10 -- # set +x 00:25:36.501 04:22:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:36.501 04:22:50 -- target/shutdown.sh@83 -- # kill -9 4052069 00:25:36.501 04:22:50 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:36.501 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 4052069 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:36.501 04:22:50 -- target/shutdown.sh@87 -- # sleep 1 00:25:37.443 04:22:51 -- target/shutdown.sh@88 -- # kill -0 4051694 00:25:37.443 04:22:51 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:37.443 04:22:51 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:37.443 04:22:51 -- nvmf/common.sh@520 -- # config=() 00:25:37.443 04:22:51 -- nvmf/common.sh@520 -- # local subsystem config 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.443 "ddgst": ${ddgst:-false} 00:25:37.443 }, 00:25:37.443 "method": "bdev_nvme_attach_controller" 00:25:37.443 } 00:25:37.443 EOF 00:25:37.443 )") 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.443 "ddgst": ${ddgst:-false} 00:25:37.443 }, 00:25:37.443 "method": "bdev_nvme_attach_controller" 00:25:37.443 } 00:25:37.443 EOF 00:25:37.443 )") 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.443 "ddgst": ${ddgst:-false} 00:25:37.443 }, 00:25:37.443 "method": "bdev_nvme_attach_controller" 00:25:37.443 } 00:25:37.443 EOF 00:25:37.443 )") 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.443 "ddgst": ${ddgst:-false} 00:25:37.443 }, 00:25:37.443 "method": "bdev_nvme_attach_controller" 00:25:37.443 } 00:25:37.443 EOF 00:25:37.443 )") 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.443 "ddgst": ${ddgst:-false} 00:25:37.443 }, 00:25:37.443 "method": "bdev_nvme_attach_controller" 00:25:37.443 } 00:25:37.443 EOF 00:25:37.443 )") 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.443 "ddgst": ${ddgst:-false} 00:25:37.443 }, 00:25:37.443 "method": "bdev_nvme_attach_controller" 00:25:37.443 } 00:25:37.443 EOF 00:25:37.443 )") 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.443 [2024-05-14 04:22:51.932663] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:37.443 [2024-05-14 04:22:51.932717] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4052461 ] 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.443 "ddgst": ${ddgst:-false} 00:25:37.443 }, 00:25:37.443 "method": "bdev_nvme_attach_controller" 00:25:37.443 } 00:25:37.443 EOF 00:25:37.443 )") 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.443 "ddgst": ${ddgst:-false} 00:25:37.443 }, 00:25:37.443 "method": "bdev_nvme_attach_controller" 00:25:37.443 } 00:25:37.443 EOF 00:25:37.443 )") 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.443 "ddgst": ${ddgst:-false} 00:25:37.443 }, 00:25:37.443 "method": "bdev_nvme_attach_controller" 00:25:37.443 } 00:25:37.443 EOF 00:25:37.443 )") 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.443 04:22:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:37.443 04:22:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:37.443 { 00:25:37.443 "params": { 00:25:37.443 "name": "Nvme$subsystem", 00:25:37.443 "trtype": "$TEST_TRANSPORT", 00:25:37.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:37.443 "adrfam": "ipv4", 00:25:37.443 "trsvcid": "$NVMF_PORT", 00:25:37.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:37.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:37.443 "hdgst": ${hdgst:-false}, 00:25:37.444 "ddgst": ${ddgst:-false} 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 } 00:25:37.444 EOF 00:25:37.444 )") 00:25:37.444 EAL: No free 2048 kB hugepages reported on node 1 00:25:37.444 04:22:51 -- nvmf/common.sh@542 -- # cat 00:25:37.444 04:22:51 -- nvmf/common.sh@544 -- # jq . 00:25:37.444 04:22:51 -- nvmf/common.sh@545 -- # IFS=, 00:25:37.444 04:22:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme1", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 },{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme2", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 },{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme3", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 },{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme4", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 },{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme5", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 },{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme6", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 },{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme7", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 },{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme8", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 },{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme9", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 },{ 00:25:37.444 "params": { 00:25:37.444 "name": "Nvme10", 00:25:37.444 "trtype": "tcp", 00:25:37.444 "traddr": "10.0.0.2", 00:25:37.444 "adrfam": "ipv4", 00:25:37.444 "trsvcid": "4420", 00:25:37.444 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:37.444 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:37.444 "hdgst": false, 00:25:37.444 "ddgst": false 00:25:37.444 }, 00:25:37.444 "method": "bdev_nvme_attach_controller" 00:25:37.444 }' 00:25:37.444 [2024-05-14 04:22:51.993011] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:37.704 [2024-05-14 04:22:52.055540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:39.090 Running I/O for 1 seconds... 00:25:40.037 00:25:40.037 Latency(us) 00:25:40.037 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:40.037 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme1n1 : 1.03 427.31 26.71 0.00 0.00 147183.06 16384.00 133693.44 00:25:40.037 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme2n1 : 1.05 473.57 29.60 0.00 0.00 129703.44 11031.89 117090.99 00:25:40.037 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme3n1 : 1.06 416.34 26.02 0.00 0.00 146803.55 10267.31 118838.61 00:25:40.037 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme4n1 : 1.06 494.99 30.94 0.00 0.00 123164.07 29928.11 111848.11 00:25:40.037 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme5n1 : 1.13 356.33 22.27 0.00 0.00 164434.80 28398.93 152043.52 00:25:40.037 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme6n1 : 1.08 402.98 25.19 0.00 0.00 149822.37 17039.36 128450.56 00:25:40.037 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme7n1 : 1.10 394.22 24.64 0.00 0.00 153890.78 4997.12 127576.75 00:25:40.037 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme8n1 : 1.14 425.26 26.58 0.00 0.00 136361.86 8574.29 106168.32 00:25:40.037 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme9n1 : 1.09 443.46 27.72 0.00 0.00 134363.39 7208.96 127576.75 00:25:40.037 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:40.037 Verification LBA range: start 0x0 length 0x400 00:25:40.037 Nvme10n1 : 1.11 440.08 27.51 0.00 0.00 134464.87 8628.91 125829.12 00:25:40.037 =================================================================================================================== 00:25:40.037 Total : 4274.53 267.16 0.00 0.00 141115.79 4997.12 152043.52 00:25:40.298 04:22:54 -- target/shutdown.sh@93 -- # stoptarget 00:25:40.298 04:22:54 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:40.298 04:22:54 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:40.298 04:22:54 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:40.298 04:22:54 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:40.298 04:22:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:40.298 04:22:54 -- nvmf/common.sh@116 -- # sync 00:25:40.298 04:22:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:40.298 04:22:54 -- nvmf/common.sh@119 -- # set +e 00:25:40.298 04:22:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:40.298 04:22:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:40.298 rmmod nvme_tcp 00:25:40.298 rmmod nvme_fabrics 00:25:40.298 rmmod nvme_keyring 00:25:40.298 04:22:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:40.298 04:22:54 -- nvmf/common.sh@123 -- # set -e 00:25:40.298 04:22:54 -- nvmf/common.sh@124 -- # return 0 00:25:40.298 04:22:54 -- nvmf/common.sh@477 -- # '[' -n 4051694 ']' 00:25:40.298 04:22:54 -- nvmf/common.sh@478 -- # killprocess 4051694 00:25:40.298 04:22:54 -- common/autotest_common.sh@926 -- # '[' -z 4051694 ']' 00:25:40.298 04:22:54 -- common/autotest_common.sh@930 -- # kill -0 4051694 00:25:40.298 04:22:54 -- common/autotest_common.sh@931 -- # uname 00:25:40.298 04:22:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:40.298 04:22:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4051694 00:25:40.298 04:22:54 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:40.298 04:22:54 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:40.298 04:22:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4051694' 00:25:40.298 killing process with pid 4051694 00:25:40.298 04:22:54 -- common/autotest_common.sh@945 -- # kill 4051694 00:25:40.298 04:22:54 -- common/autotest_common.sh@950 -- # wait 4051694 00:25:40.559 04:22:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:40.559 04:22:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:40.559 04:22:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:40.559 04:22:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:40.559 04:22:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:40.559 04:22:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.559 04:22:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.559 04:22:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:43.107 04:22:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:43.107 00:25:43.107 real 0m16.377s 00:25:43.107 user 0m32.967s 00:25:43.107 sys 0m6.673s 00:25:43.107 04:22:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:43.107 04:22:57 -- common/autotest_common.sh@10 -- # set +x 00:25:43.107 ************************************ 00:25:43.107 END TEST nvmf_shutdown_tc1 00:25:43.107 ************************************ 00:25:43.107 04:22:57 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:43.107 04:22:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:25:43.107 04:22:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:43.107 04:22:57 -- common/autotest_common.sh@10 -- # set +x 00:25:43.107 ************************************ 00:25:43.107 START TEST nvmf_shutdown_tc2 00:25:43.107 ************************************ 00:25:43.107 04:22:57 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:25:43.107 04:22:57 -- target/shutdown.sh@98 -- # starttarget 00:25:43.107 04:22:57 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:43.107 04:22:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:43.107 04:22:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:43.107 04:22:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:43.107 04:22:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:43.107 04:22:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:43.107 04:22:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:43.107 04:22:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:43.107 04:22:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:43.107 04:22:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:43.107 04:22:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:43.107 04:22:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:43.107 04:22:57 -- common/autotest_common.sh@10 -- # set +x 00:25:43.107 04:22:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:43.107 04:22:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:43.107 04:22:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:43.107 04:22:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:43.107 04:22:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:43.107 04:22:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:43.107 04:22:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:43.107 04:22:57 -- nvmf/common.sh@294 -- # net_devs=() 00:25:43.107 04:22:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:43.107 04:22:57 -- nvmf/common.sh@295 -- # e810=() 00:25:43.107 04:22:57 -- nvmf/common.sh@295 -- # local -ga e810 00:25:43.107 04:22:57 -- nvmf/common.sh@296 -- # x722=() 00:25:43.107 04:22:57 -- nvmf/common.sh@296 -- # local -ga x722 00:25:43.107 04:22:57 -- nvmf/common.sh@297 -- # mlx=() 00:25:43.107 04:22:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:43.107 04:22:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:43.107 04:22:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:43.108 04:22:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:43.108 04:22:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:43.108 04:22:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:43.108 04:22:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.108 04:22:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:25:43.108 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:25:43.108 04:22:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.108 04:22:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:25:43.108 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:25:43.108 04:22:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:43.108 04:22:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.108 04:22:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.108 04:22:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.108 04:22:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.108 04:22:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:25:43.108 Found net devices under 0000:4b:00.0: cvl_0_0 00:25:43.108 04:22:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.108 04:22:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.108 04:22:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.108 04:22:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.108 04:22:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.108 04:22:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:25:43.108 Found net devices under 0000:4b:00.1: cvl_0_1 00:25:43.108 04:22:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.108 04:22:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:43.108 04:22:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:43.108 04:22:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:43.108 04:22:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:43.108 04:22:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:43.108 04:22:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:43.108 04:22:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:43.108 04:22:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:43.108 04:22:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:43.108 04:22:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:43.108 04:22:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:43.108 04:22:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:43.108 04:22:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:43.108 04:22:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:43.108 04:22:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:43.108 04:22:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:43.108 04:22:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:43.108 04:22:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:43.108 04:22:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:43.108 04:22:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:43.108 04:22:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:43.108 04:22:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:43.108 04:22:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:43.108 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:43.108 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.597 ms 00:25:43.108 00:25:43.108 --- 10.0.0.2 ping statistics --- 00:25:43.108 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.108 rtt min/avg/max/mdev = 0.597/0.597/0.597/0.000 ms 00:25:43.108 04:22:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:43.108 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:43.108 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.405 ms 00:25:43.108 00:25:43.108 --- 10.0.0.1 ping statistics --- 00:25:43.108 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.108 rtt min/avg/max/mdev = 0.405/0.405/0.405/0.000 ms 00:25:43.108 04:22:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:43.108 04:22:57 -- nvmf/common.sh@410 -- # return 0 00:25:43.108 04:22:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:43.108 04:22:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:43.108 04:22:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:43.108 04:22:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:43.108 04:22:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:43.108 04:22:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:43.108 04:22:57 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:43.108 04:22:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:43.108 04:22:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:43.108 04:22:57 -- common/autotest_common.sh@10 -- # set +x 00:25:43.108 04:22:57 -- nvmf/common.sh@469 -- # nvmfpid=4053606 00:25:43.108 04:22:57 -- nvmf/common.sh@470 -- # waitforlisten 4053606 00:25:43.108 04:22:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:43.108 04:22:57 -- common/autotest_common.sh@819 -- # '[' -z 4053606 ']' 00:25:43.108 04:22:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:43.108 04:22:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:43.108 04:22:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:43.108 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:43.108 04:22:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:43.108 04:22:57 -- common/autotest_common.sh@10 -- # set +x 00:25:43.108 [2024-05-14 04:22:57.585538] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:43.108 [2024-05-14 04:22:57.585605] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:43.108 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.108 [2024-05-14 04:22:57.672245] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:43.370 [2024-05-14 04:22:57.732099] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:43.370 [2024-05-14 04:22:57.732199] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:43.370 [2024-05-14 04:22:57.732205] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:43.370 [2024-05-14 04:22:57.732210] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:43.370 [2024-05-14 04:22:57.732395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:43.370 [2024-05-14 04:22:57.732562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:43.370 [2024-05-14 04:22:57.732731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:43.370 [2024-05-14 04:22:57.732734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:43.942 04:22:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:43.942 04:22:58 -- common/autotest_common.sh@852 -- # return 0 00:25:43.942 04:22:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:43.942 04:22:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:43.942 04:22:58 -- common/autotest_common.sh@10 -- # set +x 00:25:43.942 04:22:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:43.942 04:22:58 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:43.942 04:22:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.942 04:22:58 -- common/autotest_common.sh@10 -- # set +x 00:25:43.942 [2024-05-14 04:22:58.399319] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:43.942 04:22:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.942 04:22:58 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:43.942 04:22:58 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:43.942 04:22:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:43.942 04:22:58 -- common/autotest_common.sh@10 -- # set +x 00:25:43.942 04:22:58 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:43.942 04:22:58 -- target/shutdown.sh@28 -- # cat 00:25:43.942 04:22:58 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:43.942 04:22:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.942 04:22:58 -- common/autotest_common.sh@10 -- # set +x 00:25:43.942 Malloc1 00:25:43.942 [2024-05-14 04:22:58.498064] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:43.942 Malloc2 00:25:44.203 Malloc3 00:25:44.203 Malloc4 00:25:44.203 Malloc5 00:25:44.203 Malloc6 00:25:44.203 Malloc7 00:25:44.203 Malloc8 00:25:44.203 Malloc9 00:25:44.465 Malloc10 00:25:44.465 04:22:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.465 04:22:58 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:44.465 04:22:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:44.465 04:22:58 -- common/autotest_common.sh@10 -- # set +x 00:25:44.465 04:22:58 -- target/shutdown.sh@102 -- # perfpid=4053969 00:25:44.465 04:22:58 -- target/shutdown.sh@103 -- # waitforlisten 4053969 /var/tmp/bdevperf.sock 00:25:44.465 04:22:58 -- common/autotest_common.sh@819 -- # '[' -z 4053969 ']' 00:25:44.465 04:22:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:44.465 04:22:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:44.465 04:22:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:44.465 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:44.465 04:22:58 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:44.465 04:22:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:44.465 04:22:58 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:44.465 04:22:58 -- common/autotest_common.sh@10 -- # set +x 00:25:44.465 04:22:58 -- nvmf/common.sh@520 -- # config=() 00:25:44.465 04:22:58 -- nvmf/common.sh@520 -- # local subsystem config 00:25:44.465 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.465 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.465 { 00:25:44.465 "params": { 00:25:44.465 "name": "Nvme$subsystem", 00:25:44.465 "trtype": "$TEST_TRANSPORT", 00:25:44.465 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.465 "adrfam": "ipv4", 00:25:44.465 "trsvcid": "$NVMF_PORT", 00:25:44.465 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.465 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.465 "hdgst": ${hdgst:-false}, 00:25:44.465 "ddgst": ${ddgst:-false} 00:25:44.465 }, 00:25:44.465 "method": "bdev_nvme_attach_controller" 00:25:44.465 } 00:25:44.465 EOF 00:25:44.465 )") 00:25:44.465 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.465 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.465 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.465 { 00:25:44.465 "params": { 00:25:44.465 "name": "Nvme$subsystem", 00:25:44.465 "trtype": "$TEST_TRANSPORT", 00:25:44.465 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.465 "adrfam": "ipv4", 00:25:44.465 "trsvcid": "$NVMF_PORT", 00:25:44.465 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.465 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.465 "hdgst": ${hdgst:-false}, 00:25:44.465 "ddgst": ${ddgst:-false} 00:25:44.465 }, 00:25:44.465 "method": "bdev_nvme_attach_controller" 00:25:44.465 } 00:25:44.465 EOF 00:25:44.465 )") 00:25:44.465 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.465 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.465 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.465 { 00:25:44.465 "params": { 00:25:44.465 "name": "Nvme$subsystem", 00:25:44.465 "trtype": "$TEST_TRANSPORT", 00:25:44.465 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.465 "adrfam": "ipv4", 00:25:44.465 "trsvcid": "$NVMF_PORT", 00:25:44.465 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.465 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.465 "hdgst": ${hdgst:-false}, 00:25:44.465 "ddgst": ${ddgst:-false} 00:25:44.465 }, 00:25:44.465 "method": "bdev_nvme_attach_controller" 00:25:44.466 } 00:25:44.466 EOF 00:25:44.466 )") 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.466 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.466 { 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme$subsystem", 00:25:44.466 "trtype": "$TEST_TRANSPORT", 00:25:44.466 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "$NVMF_PORT", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.466 "hdgst": ${hdgst:-false}, 00:25:44.466 "ddgst": ${ddgst:-false} 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 } 00:25:44.466 EOF 00:25:44.466 )") 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.466 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.466 { 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme$subsystem", 00:25:44.466 "trtype": "$TEST_TRANSPORT", 00:25:44.466 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "$NVMF_PORT", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.466 "hdgst": ${hdgst:-false}, 00:25:44.466 "ddgst": ${ddgst:-false} 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 } 00:25:44.466 EOF 00:25:44.466 )") 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.466 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.466 { 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme$subsystem", 00:25:44.466 "trtype": "$TEST_TRANSPORT", 00:25:44.466 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "$NVMF_PORT", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.466 "hdgst": ${hdgst:-false}, 00:25:44.466 "ddgst": ${ddgst:-false} 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 } 00:25:44.466 EOF 00:25:44.466 )") 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.466 [2024-05-14 04:22:58.937381] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:44.466 [2024-05-14 04:22:58.937437] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4053969 ] 00:25:44.466 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.466 { 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme$subsystem", 00:25:44.466 "trtype": "$TEST_TRANSPORT", 00:25:44.466 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "$NVMF_PORT", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.466 "hdgst": ${hdgst:-false}, 00:25:44.466 "ddgst": ${ddgst:-false} 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 } 00:25:44.466 EOF 00:25:44.466 )") 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.466 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.466 { 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme$subsystem", 00:25:44.466 "trtype": "$TEST_TRANSPORT", 00:25:44.466 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "$NVMF_PORT", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.466 "hdgst": ${hdgst:-false}, 00:25:44.466 "ddgst": ${ddgst:-false} 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 } 00:25:44.466 EOF 00:25:44.466 )") 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.466 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.466 { 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme$subsystem", 00:25:44.466 "trtype": "$TEST_TRANSPORT", 00:25:44.466 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "$NVMF_PORT", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.466 "hdgst": ${hdgst:-false}, 00:25:44.466 "ddgst": ${ddgst:-false} 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 } 00:25:44.466 EOF 00:25:44.466 )") 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.466 EAL: No free 2048 kB hugepages reported on node 1 00:25:44.466 04:22:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:44.466 { 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme$subsystem", 00:25:44.466 "trtype": "$TEST_TRANSPORT", 00:25:44.466 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "$NVMF_PORT", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:44.466 "hdgst": ${hdgst:-false}, 00:25:44.466 "ddgst": ${ddgst:-false} 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 } 00:25:44.466 EOF 00:25:44.466 )") 00:25:44.466 04:22:58 -- nvmf/common.sh@542 -- # cat 00:25:44.466 04:22:58 -- nvmf/common.sh@544 -- # jq . 00:25:44.466 04:22:58 -- nvmf/common.sh@545 -- # IFS=, 00:25:44.466 04:22:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme1", 00:25:44.466 "trtype": "tcp", 00:25:44.466 "traddr": "10.0.0.2", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "4420", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:44.466 "hdgst": false, 00:25:44.466 "ddgst": false 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 },{ 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme2", 00:25:44.466 "trtype": "tcp", 00:25:44.466 "traddr": "10.0.0.2", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "4420", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:44.466 "hdgst": false, 00:25:44.466 "ddgst": false 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 },{ 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme3", 00:25:44.466 "trtype": "tcp", 00:25:44.466 "traddr": "10.0.0.2", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "4420", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:44.466 "hdgst": false, 00:25:44.466 "ddgst": false 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 },{ 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme4", 00:25:44.466 "trtype": "tcp", 00:25:44.466 "traddr": "10.0.0.2", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "4420", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:44.466 "hdgst": false, 00:25:44.466 "ddgst": false 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 },{ 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme5", 00:25:44.466 "trtype": "tcp", 00:25:44.466 "traddr": "10.0.0.2", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "4420", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:44.466 "hdgst": false, 00:25:44.466 "ddgst": false 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 },{ 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme6", 00:25:44.466 "trtype": "tcp", 00:25:44.466 "traddr": "10.0.0.2", 00:25:44.466 "adrfam": "ipv4", 00:25:44.466 "trsvcid": "4420", 00:25:44.466 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:44.466 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:44.466 "hdgst": false, 00:25:44.466 "ddgst": false 00:25:44.466 }, 00:25:44.466 "method": "bdev_nvme_attach_controller" 00:25:44.466 },{ 00:25:44.466 "params": { 00:25:44.466 "name": "Nvme7", 00:25:44.466 "trtype": "tcp", 00:25:44.466 "traddr": "10.0.0.2", 00:25:44.466 "adrfam": "ipv4", 00:25:44.467 "trsvcid": "4420", 00:25:44.467 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:44.467 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:44.467 "hdgst": false, 00:25:44.467 "ddgst": false 00:25:44.467 }, 00:25:44.467 "method": "bdev_nvme_attach_controller" 00:25:44.467 },{ 00:25:44.467 "params": { 00:25:44.467 "name": "Nvme8", 00:25:44.467 "trtype": "tcp", 00:25:44.467 "traddr": "10.0.0.2", 00:25:44.467 "adrfam": "ipv4", 00:25:44.467 "trsvcid": "4420", 00:25:44.467 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:44.467 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:44.467 "hdgst": false, 00:25:44.467 "ddgst": false 00:25:44.467 }, 00:25:44.467 "method": "bdev_nvme_attach_controller" 00:25:44.467 },{ 00:25:44.467 "params": { 00:25:44.467 "name": "Nvme9", 00:25:44.467 "trtype": "tcp", 00:25:44.467 "traddr": "10.0.0.2", 00:25:44.467 "adrfam": "ipv4", 00:25:44.467 "trsvcid": "4420", 00:25:44.467 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:44.467 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:44.467 "hdgst": false, 00:25:44.467 "ddgst": false 00:25:44.467 }, 00:25:44.467 "method": "bdev_nvme_attach_controller" 00:25:44.467 },{ 00:25:44.467 "params": { 00:25:44.467 "name": "Nvme10", 00:25:44.467 "trtype": "tcp", 00:25:44.467 "traddr": "10.0.0.2", 00:25:44.467 "adrfam": "ipv4", 00:25:44.467 "trsvcid": "4420", 00:25:44.467 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:44.467 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:44.467 "hdgst": false, 00:25:44.467 "ddgst": false 00:25:44.467 }, 00:25:44.467 "method": "bdev_nvme_attach_controller" 00:25:44.467 }' 00:25:44.467 [2024-05-14 04:22:58.996981] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:44.727 [2024-05-14 04:22:59.059457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:46.112 Running I/O for 10 seconds... 00:25:46.685 04:23:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:46.685 04:23:01 -- common/autotest_common.sh@852 -- # return 0 00:25:46.685 04:23:01 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:46.685 04:23:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:46.685 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:25:46.685 04:23:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:46.685 04:23:01 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:46.685 04:23:01 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:46.685 04:23:01 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:46.685 04:23:01 -- target/shutdown.sh@57 -- # local ret=1 00:25:46.685 04:23:01 -- target/shutdown.sh@58 -- # local i 00:25:46.685 04:23:01 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:46.685 04:23:01 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:46.685 04:23:01 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:46.685 04:23:01 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:46.685 04:23:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:46.685 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:25:46.685 04:23:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:46.685 04:23:01 -- target/shutdown.sh@60 -- # read_io_count=215 00:25:46.685 04:23:01 -- target/shutdown.sh@63 -- # '[' 215 -ge 100 ']' 00:25:46.685 04:23:01 -- target/shutdown.sh@64 -- # ret=0 00:25:46.685 04:23:01 -- target/shutdown.sh@65 -- # break 00:25:46.685 04:23:01 -- target/shutdown.sh@69 -- # return 0 00:25:46.685 04:23:01 -- target/shutdown.sh@109 -- # killprocess 4053969 00:25:46.685 04:23:01 -- common/autotest_common.sh@926 -- # '[' -z 4053969 ']' 00:25:46.685 04:23:01 -- common/autotest_common.sh@930 -- # kill -0 4053969 00:25:46.685 04:23:01 -- common/autotest_common.sh@931 -- # uname 00:25:46.685 04:23:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:46.685 04:23:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4053969 00:25:46.685 04:23:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:46.685 04:23:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:46.685 04:23:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4053969' 00:25:46.685 killing process with pid 4053969 00:25:46.685 04:23:01 -- common/autotest_common.sh@945 -- # kill 4053969 00:25:46.685 04:23:01 -- common/autotest_common.sh@950 -- # wait 4053969 00:25:46.685 Received shutdown signal, test time was about 0.686617 seconds 00:25:46.685 00:25:46.685 Latency(us) 00:25:46.685 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:46.685 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme1n1 : 0.65 492.37 30.77 0.00 0.00 127103.37 12342.61 117964.80 00:25:46.685 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme2n1 : 0.68 334.94 20.93 0.00 0.00 173259.84 18459.31 178257.92 00:25:46.685 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme3n1 : 0.69 332.50 20.78 0.00 0.00 172597.30 16820.91 177384.11 00:25:46.685 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme4n1 : 0.68 402.21 25.14 0.00 0.00 150541.95 9502.72 139810.13 00:25:46.685 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme5n1 : 0.65 497.04 31.07 0.00 0.00 120017.79 10212.69 111848.11 00:25:46.685 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme6n1 : 0.64 437.89 27.37 0.00 0.00 133939.74 4232.53 112721.92 00:25:46.685 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme7n1 : 0.68 401.20 25.07 0.00 0.00 145946.00 8301.23 130198.19 00:25:46.685 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme8n1 : 0.67 413.05 25.82 0.00 0.00 139410.93 3454.29 130198.19 00:25:46.685 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme9n1 : 0.66 410.56 25.66 0.00 0.00 138588.26 7482.03 131072.00 00:25:46.685 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:46.685 Verification LBA range: start 0x0 length 0x400 00:25:46.685 Nvme10n1 : 0.64 429.80 26.86 0.00 0.00 129336.74 8082.77 107042.13 00:25:46.685 =================================================================================================================== 00:25:46.685 Total : 4151.57 259.47 0.00 0.00 141367.35 3454.29 178257.92 00:25:46.946 04:23:01 -- target/shutdown.sh@112 -- # sleep 1 00:25:47.888 04:23:02 -- target/shutdown.sh@113 -- # kill -0 4053606 00:25:47.888 04:23:02 -- target/shutdown.sh@115 -- # stoptarget 00:25:47.888 04:23:02 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:47.888 04:23:02 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:47.888 04:23:02 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:47.888 04:23:02 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:47.888 04:23:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:47.888 04:23:02 -- nvmf/common.sh@116 -- # sync 00:25:47.888 04:23:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:47.888 04:23:02 -- nvmf/common.sh@119 -- # set +e 00:25:47.888 04:23:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:47.888 04:23:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:47.888 rmmod nvme_tcp 00:25:47.888 rmmod nvme_fabrics 00:25:47.888 rmmod nvme_keyring 00:25:47.888 04:23:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:47.888 04:23:02 -- nvmf/common.sh@123 -- # set -e 00:25:47.888 04:23:02 -- nvmf/common.sh@124 -- # return 0 00:25:47.888 04:23:02 -- nvmf/common.sh@477 -- # '[' -n 4053606 ']' 00:25:47.888 04:23:02 -- nvmf/common.sh@478 -- # killprocess 4053606 00:25:47.888 04:23:02 -- common/autotest_common.sh@926 -- # '[' -z 4053606 ']' 00:25:47.888 04:23:02 -- common/autotest_common.sh@930 -- # kill -0 4053606 00:25:47.888 04:23:02 -- common/autotest_common.sh@931 -- # uname 00:25:47.888 04:23:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:47.888 04:23:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4053606 00:25:48.148 04:23:02 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:48.148 04:23:02 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:48.148 04:23:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4053606' 00:25:48.148 killing process with pid 4053606 00:25:48.148 04:23:02 -- common/autotest_common.sh@945 -- # kill 4053606 00:25:48.148 04:23:02 -- common/autotest_common.sh@950 -- # wait 4053606 00:25:48.148 04:23:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:48.148 04:23:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:48.148 04:23:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:48.148 04:23:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:48.148 04:23:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:48.148 04:23:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:48.148 04:23:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:48.148 04:23:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:50.696 04:23:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:50.696 00:25:50.696 real 0m7.673s 00:25:50.696 user 0m22.718s 00:25:50.696 sys 0m1.264s 00:25:50.696 04:23:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:50.696 04:23:04 -- common/autotest_common.sh@10 -- # set +x 00:25:50.696 ************************************ 00:25:50.696 END TEST nvmf_shutdown_tc2 00:25:50.696 ************************************ 00:25:50.696 04:23:04 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:50.696 04:23:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:25:50.696 04:23:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:50.696 04:23:04 -- common/autotest_common.sh@10 -- # set +x 00:25:50.696 ************************************ 00:25:50.696 START TEST nvmf_shutdown_tc3 00:25:50.696 ************************************ 00:25:50.696 04:23:04 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:25:50.696 04:23:04 -- target/shutdown.sh@120 -- # starttarget 00:25:50.696 04:23:04 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:50.696 04:23:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:50.696 04:23:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:50.696 04:23:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:50.696 04:23:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:50.696 04:23:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:50.696 04:23:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:50.696 04:23:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:50.696 04:23:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:50.696 04:23:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:50.696 04:23:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:50.696 04:23:04 -- common/autotest_common.sh@10 -- # set +x 00:25:50.696 04:23:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:50.696 04:23:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:50.696 04:23:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:50.696 04:23:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:50.696 04:23:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:50.696 04:23:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:50.696 04:23:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:50.696 04:23:04 -- nvmf/common.sh@294 -- # net_devs=() 00:25:50.696 04:23:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:50.696 04:23:04 -- nvmf/common.sh@295 -- # e810=() 00:25:50.696 04:23:04 -- nvmf/common.sh@295 -- # local -ga e810 00:25:50.696 04:23:04 -- nvmf/common.sh@296 -- # x722=() 00:25:50.696 04:23:04 -- nvmf/common.sh@296 -- # local -ga x722 00:25:50.696 04:23:04 -- nvmf/common.sh@297 -- # mlx=() 00:25:50.696 04:23:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:50.696 04:23:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:50.696 04:23:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:50.696 04:23:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:50.696 04:23:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:50.696 04:23:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:50.696 04:23:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:25:50.696 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:25:50.696 04:23:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:50.696 04:23:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:25:50.696 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:25:50.696 04:23:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:50.696 04:23:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:50.696 04:23:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:50.696 04:23:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:50.696 04:23:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:50.696 04:23:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:25:50.696 Found net devices under 0000:4b:00.0: cvl_0_0 00:25:50.696 04:23:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:50.696 04:23:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:50.696 04:23:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:50.696 04:23:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:50.696 04:23:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:50.696 04:23:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:25:50.696 Found net devices under 0000:4b:00.1: cvl_0_1 00:25:50.696 04:23:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:50.696 04:23:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:50.696 04:23:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:50.696 04:23:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:50.696 04:23:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:50.696 04:23:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:50.696 04:23:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:50.696 04:23:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:50.696 04:23:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:50.696 04:23:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:50.696 04:23:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:50.696 04:23:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:50.696 04:23:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:50.696 04:23:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:50.696 04:23:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:50.696 04:23:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:50.696 04:23:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:50.696 04:23:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:50.696 04:23:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:50.696 04:23:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:50.696 04:23:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:50.696 04:23:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:50.696 04:23:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:50.697 04:23:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:50.697 04:23:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:50.697 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:50.697 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.599 ms 00:25:50.697 00:25:50.697 --- 10.0.0.2 ping statistics --- 00:25:50.697 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:50.697 rtt min/avg/max/mdev = 0.599/0.599/0.599/0.000 ms 00:25:50.697 04:23:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:50.697 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:50.697 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.357 ms 00:25:50.697 00:25:50.697 --- 10.0.0.1 ping statistics --- 00:25:50.697 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:50.697 rtt min/avg/max/mdev = 0.357/0.357/0.357/0.000 ms 00:25:50.697 04:23:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:50.697 04:23:05 -- nvmf/common.sh@410 -- # return 0 00:25:50.697 04:23:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:50.697 04:23:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:50.697 04:23:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:50.697 04:23:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:50.697 04:23:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:50.697 04:23:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:50.697 04:23:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:50.697 04:23:05 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:50.697 04:23:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:50.697 04:23:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:50.697 04:23:05 -- common/autotest_common.sh@10 -- # set +x 00:25:50.697 04:23:05 -- nvmf/common.sh@469 -- # nvmfpid=4055411 00:25:50.697 04:23:05 -- nvmf/common.sh@470 -- # waitforlisten 4055411 00:25:50.697 04:23:05 -- common/autotest_common.sh@819 -- # '[' -z 4055411 ']' 00:25:50.697 04:23:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:50.697 04:23:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:50.697 04:23:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:50.697 04:23:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:50.697 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:50.697 04:23:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:50.697 04:23:05 -- common/autotest_common.sh@10 -- # set +x 00:25:50.958 [2024-05-14 04:23:05.314285] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:50.958 [2024-05-14 04:23:05.314361] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:50.958 EAL: No free 2048 kB hugepages reported on node 1 00:25:50.958 [2024-05-14 04:23:05.399001] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:50.958 [2024-05-14 04:23:05.458644] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:50.958 [2024-05-14 04:23:05.458743] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:50.958 [2024-05-14 04:23:05.458749] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:50.958 [2024-05-14 04:23:05.458754] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:50.958 [2024-05-14 04:23:05.458860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:50.958 [2024-05-14 04:23:05.458998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:50.958 [2024-05-14 04:23:05.459381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:50.958 [2024-05-14 04:23:05.459381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:51.530 04:23:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:51.530 04:23:06 -- common/autotest_common.sh@852 -- # return 0 00:25:51.530 04:23:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:51.530 04:23:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:51.530 04:23:06 -- common/autotest_common.sh@10 -- # set +x 00:25:51.790 04:23:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:51.790 04:23:06 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:51.790 04:23:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:51.790 04:23:06 -- common/autotest_common.sh@10 -- # set +x 00:25:51.790 [2024-05-14 04:23:06.132347] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:51.790 04:23:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:51.790 04:23:06 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:51.790 04:23:06 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:51.790 04:23:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:51.790 04:23:06 -- common/autotest_common.sh@10 -- # set +x 00:25:51.790 04:23:06 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:51.790 04:23:06 -- target/shutdown.sh@28 -- # cat 00:25:51.790 04:23:06 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:51.790 04:23:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:51.790 04:23:06 -- common/autotest_common.sh@10 -- # set +x 00:25:51.790 Malloc1 00:25:51.790 [2024-05-14 04:23:06.231097] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:51.790 Malloc2 00:25:51.790 Malloc3 00:25:51.790 Malloc4 00:25:51.790 Malloc5 00:25:52.052 Malloc6 00:25:52.052 Malloc7 00:25:52.052 Malloc8 00:25:52.052 Malloc9 00:25:52.052 Malloc10 00:25:52.052 04:23:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:52.052 04:23:06 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:52.052 04:23:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:52.052 04:23:06 -- common/autotest_common.sh@10 -- # set +x 00:25:52.052 04:23:06 -- target/shutdown.sh@124 -- # perfpid=4055615 00:25:52.052 04:23:06 -- target/shutdown.sh@125 -- # waitforlisten 4055615 /var/tmp/bdevperf.sock 00:25:52.052 04:23:06 -- common/autotest_common.sh@819 -- # '[' -z 4055615 ']' 00:25:52.052 04:23:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:52.052 04:23:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:52.052 04:23:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:52.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:52.052 04:23:06 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:52.052 04:23:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:52.052 04:23:06 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:52.052 04:23:06 -- common/autotest_common.sh@10 -- # set +x 00:25:52.052 04:23:06 -- nvmf/common.sh@520 -- # config=() 00:25:52.052 04:23:06 -- nvmf/common.sh@520 -- # local subsystem config 00:25:52.052 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.052 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.052 { 00:25:52.052 "params": { 00:25:52.052 "name": "Nvme$subsystem", 00:25:52.052 "trtype": "$TEST_TRANSPORT", 00:25:52.052 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.052 "adrfam": "ipv4", 00:25:52.052 "trsvcid": "$NVMF_PORT", 00:25:52.052 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.052 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.052 "hdgst": ${hdgst:-false}, 00:25:52.052 "ddgst": ${ddgst:-false} 00:25:52.052 }, 00:25:52.052 "method": "bdev_nvme_attach_controller" 00:25:52.052 } 00:25:52.052 EOF 00:25:52.052 )") 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.314 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.314 { 00:25:52.314 "params": { 00:25:52.314 "name": "Nvme$subsystem", 00:25:52.314 "trtype": "$TEST_TRANSPORT", 00:25:52.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.314 "adrfam": "ipv4", 00:25:52.314 "trsvcid": "$NVMF_PORT", 00:25:52.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.314 "hdgst": ${hdgst:-false}, 00:25:52.314 "ddgst": ${ddgst:-false} 00:25:52.314 }, 00:25:52.314 "method": "bdev_nvme_attach_controller" 00:25:52.314 } 00:25:52.314 EOF 00:25:52.314 )") 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.314 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.314 { 00:25:52.314 "params": { 00:25:52.314 "name": "Nvme$subsystem", 00:25:52.314 "trtype": "$TEST_TRANSPORT", 00:25:52.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.314 "adrfam": "ipv4", 00:25:52.314 "trsvcid": "$NVMF_PORT", 00:25:52.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.314 "hdgst": ${hdgst:-false}, 00:25:52.314 "ddgst": ${ddgst:-false} 00:25:52.314 }, 00:25:52.314 "method": "bdev_nvme_attach_controller" 00:25:52.314 } 00:25:52.314 EOF 00:25:52.314 )") 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.314 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.314 { 00:25:52.314 "params": { 00:25:52.314 "name": "Nvme$subsystem", 00:25:52.314 "trtype": "$TEST_TRANSPORT", 00:25:52.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.314 "adrfam": "ipv4", 00:25:52.314 "trsvcid": "$NVMF_PORT", 00:25:52.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.314 "hdgst": ${hdgst:-false}, 00:25:52.314 "ddgst": ${ddgst:-false} 00:25:52.314 }, 00:25:52.314 "method": "bdev_nvme_attach_controller" 00:25:52.314 } 00:25:52.314 EOF 00:25:52.314 )") 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.314 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.314 { 00:25:52.314 "params": { 00:25:52.314 "name": "Nvme$subsystem", 00:25:52.314 "trtype": "$TEST_TRANSPORT", 00:25:52.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.314 "adrfam": "ipv4", 00:25:52.314 "trsvcid": "$NVMF_PORT", 00:25:52.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.314 "hdgst": ${hdgst:-false}, 00:25:52.314 "ddgst": ${ddgst:-false} 00:25:52.314 }, 00:25:52.314 "method": "bdev_nvme_attach_controller" 00:25:52.314 } 00:25:52.314 EOF 00:25:52.314 )") 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.314 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.314 { 00:25:52.314 "params": { 00:25:52.314 "name": "Nvme$subsystem", 00:25:52.314 "trtype": "$TEST_TRANSPORT", 00:25:52.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.314 "adrfam": "ipv4", 00:25:52.314 "trsvcid": "$NVMF_PORT", 00:25:52.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.314 "hdgst": ${hdgst:-false}, 00:25:52.314 "ddgst": ${ddgst:-false} 00:25:52.314 }, 00:25:52.314 "method": "bdev_nvme_attach_controller" 00:25:52.314 } 00:25:52.314 EOF 00:25:52.314 )") 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.314 [2024-05-14 04:23:06.681014] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:52.314 [2024-05-14 04:23:06.681077] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4055615 ] 00:25:52.314 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.314 { 00:25:52.314 "params": { 00:25:52.314 "name": "Nvme$subsystem", 00:25:52.314 "trtype": "$TEST_TRANSPORT", 00:25:52.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.314 "adrfam": "ipv4", 00:25:52.314 "trsvcid": "$NVMF_PORT", 00:25:52.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.314 "hdgst": ${hdgst:-false}, 00:25:52.314 "ddgst": ${ddgst:-false} 00:25:52.314 }, 00:25:52.314 "method": "bdev_nvme_attach_controller" 00:25:52.314 } 00:25:52.314 EOF 00:25:52.314 )") 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.314 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.314 { 00:25:52.314 "params": { 00:25:52.314 "name": "Nvme$subsystem", 00:25:52.314 "trtype": "$TEST_TRANSPORT", 00:25:52.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.314 "adrfam": "ipv4", 00:25:52.314 "trsvcid": "$NVMF_PORT", 00:25:52.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.314 "hdgst": ${hdgst:-false}, 00:25:52.314 "ddgst": ${ddgst:-false} 00:25:52.314 }, 00:25:52.314 "method": "bdev_nvme_attach_controller" 00:25:52.314 } 00:25:52.314 EOF 00:25:52.314 )") 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.314 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.314 { 00:25:52.314 "params": { 00:25:52.314 "name": "Nvme$subsystem", 00:25:52.314 "trtype": "$TEST_TRANSPORT", 00:25:52.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.314 "adrfam": "ipv4", 00:25:52.314 "trsvcid": "$NVMF_PORT", 00:25:52.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.314 "hdgst": ${hdgst:-false}, 00:25:52.314 "ddgst": ${ddgst:-false} 00:25:52.314 }, 00:25:52.314 "method": "bdev_nvme_attach_controller" 00:25:52.314 } 00:25:52.314 EOF 00:25:52.314 )") 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.314 04:23:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:52.314 04:23:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:52.314 { 00:25:52.314 "params": { 00:25:52.314 "name": "Nvme$subsystem", 00:25:52.314 "trtype": "$TEST_TRANSPORT", 00:25:52.314 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:52.314 "adrfam": "ipv4", 00:25:52.314 "trsvcid": "$NVMF_PORT", 00:25:52.314 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:52.314 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:52.314 "hdgst": ${hdgst:-false}, 00:25:52.314 "ddgst": ${ddgst:-false} 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 } 00:25:52.315 EOF 00:25:52.315 )") 00:25:52.315 04:23:06 -- nvmf/common.sh@542 -- # cat 00:25:52.315 EAL: No free 2048 kB hugepages reported on node 1 00:25:52.315 04:23:06 -- nvmf/common.sh@544 -- # jq . 00:25:52.315 04:23:06 -- nvmf/common.sh@545 -- # IFS=, 00:25:52.315 04:23:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme1", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 },{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme2", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 },{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme3", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 },{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme4", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 },{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme5", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 },{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme6", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 },{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme7", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 },{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme8", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 },{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme9", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 },{ 00:25:52.315 "params": { 00:25:52.315 "name": "Nvme10", 00:25:52.315 "trtype": "tcp", 00:25:52.315 "traddr": "10.0.0.2", 00:25:52.315 "adrfam": "ipv4", 00:25:52.315 "trsvcid": "4420", 00:25:52.315 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:52.315 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:52.315 "hdgst": false, 00:25:52.315 "ddgst": false 00:25:52.315 }, 00:25:52.315 "method": "bdev_nvme_attach_controller" 00:25:52.315 }' 00:25:52.315 [2024-05-14 04:23:06.747917] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:52.315 [2024-05-14 04:23:06.809840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:53.704 Running I/O for 10 seconds... 00:25:54.277 04:23:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:54.277 04:23:08 -- common/autotest_common.sh@852 -- # return 0 00:25:54.277 04:23:08 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:54.277 04:23:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:54.277 04:23:08 -- common/autotest_common.sh@10 -- # set +x 00:25:54.277 04:23:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:54.277 04:23:08 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:54.277 04:23:08 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:54.277 04:23:08 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:54.277 04:23:08 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:54.277 04:23:08 -- target/shutdown.sh@57 -- # local ret=1 00:25:54.277 04:23:08 -- target/shutdown.sh@58 -- # local i 00:25:54.277 04:23:08 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:54.277 04:23:08 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:54.277 04:23:08 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:54.277 04:23:08 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:54.277 04:23:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:54.277 04:23:08 -- common/autotest_common.sh@10 -- # set +x 00:25:54.277 04:23:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:54.277 04:23:08 -- target/shutdown.sh@60 -- # read_io_count=254 00:25:54.277 04:23:08 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:25:54.277 04:23:08 -- target/shutdown.sh@64 -- # ret=0 00:25:54.277 04:23:08 -- target/shutdown.sh@65 -- # break 00:25:54.277 04:23:08 -- target/shutdown.sh@69 -- # return 0 00:25:54.277 04:23:08 -- target/shutdown.sh@134 -- # killprocess 4055411 00:25:54.277 04:23:08 -- common/autotest_common.sh@926 -- # '[' -z 4055411 ']' 00:25:54.277 04:23:08 -- common/autotest_common.sh@930 -- # kill -0 4055411 00:25:54.277 04:23:08 -- common/autotest_common.sh@931 -- # uname 00:25:54.277 04:23:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:54.277 04:23:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4055411 00:25:54.557 04:23:08 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:54.557 04:23:08 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:54.557 04:23:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4055411' 00:25:54.557 killing process with pid 4055411 00:25:54.557 04:23:08 -- common/autotest_common.sh@945 -- # kill 4055411 00:25:54.557 04:23:08 -- common/autotest_common.sh@950 -- # wait 4055411 00:25:54.557 [2024-05-14 04:23:08.888173] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888224] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888230] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888235] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888240] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888250] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888265] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888269] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888297] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888302] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888311] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888320] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888325] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888334] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888343] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888348] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888371] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888375] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888380] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888385] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888390] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.557 [2024-05-14 04:23:08.888394] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888400] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888404] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888409] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888413] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888418] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888427] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888431] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888436] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888444] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888449] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888457] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888462] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888467] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888471] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888475] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888480] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888484] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888489] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888493] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888497] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.888511] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7070 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889314] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889346] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889371] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889375] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889380] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889384] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889393] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889398] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889407] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889412] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889417] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889421] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889426] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889431] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889445] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889449] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889454] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889458] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889463] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889469] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889474] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889478] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889483] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889487] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889497] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889511] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889520] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889525] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889530] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889534] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889543] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889548] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889553] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889557] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889567] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889572] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889580] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889585] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889590] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889594] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889600] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889605] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.558 [2024-05-14 04:23:08.889609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.889613] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.889618] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.889622] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.889626] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa98f0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891310] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891343] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891348] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891353] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891362] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891367] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891372] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891381] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891385] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891390] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891394] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891399] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891409] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891414] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891419] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891431] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891436] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891445] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891449] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891458] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891463] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891467] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891472] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891476] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891481] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891486] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891495] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891499] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891504] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891508] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891513] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891518] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891522] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891528] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891533] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891537] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891542] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891547] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891557] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891566] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891570] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891575] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891579] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891583] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891593] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891602] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891606] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891611] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891616] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891620] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.891625] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa79d0 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892499] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892521] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892532] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892537] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892541] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892546] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892555] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892560] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892565] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892573] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892578] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892582] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892586] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892591] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.559 [2024-05-14 04:23:08.892600] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892604] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892613] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892618] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892622] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892627] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892631] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892636] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892640] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892644] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892649] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892658] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892663] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892672] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892676] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892685] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892689] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892694] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892700] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892706] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892710] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892715] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892719] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892723] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892728] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892733] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892737] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892741] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892745] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892750] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892755] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892759] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892764] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892768] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892773] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892777] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892782] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892786] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892790] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892795] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892799] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.892804] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa7e60 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893253] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893272] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893284] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893297] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893301] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893310] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893314] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893323] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893328] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893332] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893337] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893346] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893350] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893355] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893359] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893364] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893368] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893373] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893377] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893382] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893391] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893395] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893400] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893405] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893410] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893414] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893419] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893423] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893428] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893433] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893437] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893441] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.560 [2024-05-14 04:23:08.893445] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893450] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893454] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893458] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893462] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893467] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893472] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893481] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893486] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893494] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893498] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893507] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893511] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893517] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893521] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893531] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893536] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893540] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893545] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.893549] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8310 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894099] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894118] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894123] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894127] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894132] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894137] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894141] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894146] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894151] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894155] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894160] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894164] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894173] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894177] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894182] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894186] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894191] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894195] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894200] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894205] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894212] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894217] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894221] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894226] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894230] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894235] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894240] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894249] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894253] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894258] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894262] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894271] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894276] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894280] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894285] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894289] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894297] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894302] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894311] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa87c0 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894884] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894908] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894919] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894924] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894929] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.561 [2024-05-14 04:23:08.894933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894938] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894942] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894947] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894956] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894965] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894970] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894974] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894979] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894983] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894988] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894992] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.894997] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895001] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895006] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895011] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895016] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895025] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895030] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895034] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895038] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895043] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895049] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895054] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895067] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895076] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895080] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895085] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895089] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895093] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895102] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895107] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895111] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.895116] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.896322] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896368] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896383] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896399] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x212b940 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.896446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896467] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896483] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x208f060 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.896534] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896565] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896580] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x206b7c0 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.896614] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896630] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896645] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896659] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.562 [2024-05-14 04:23:08.896674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x206e520 is same with the state(5) to be set 00:25:54.562 [2024-05-14 04:23:08.896704] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.562 [2024-05-14 04:23:08.896712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896720] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896749] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2232020 is same with the state(5) to be set 00:25:54.563 [2024-05-14 04:23:08.896784] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896800] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896816] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2231590 is same with the state(5) to be set 00:25:54.563 [2024-05-14 04:23:08.896866] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896882] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896897] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896912] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2144cd0 is same with the state(5) to be set 00:25:54.563 [2024-05-14 04:23:08.896950] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896967] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896982] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.896989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.896997] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.563 [2024-05-14 04:23:08.897004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2066160 is same with the state(5) to be set 00:25:54.563 [2024-05-14 04:23:08.897084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.563 [2024-05-14 04:23:08.897473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.563 [2024-05-14 04:23:08.897482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.897985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.897994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.898010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.898027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.898043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.898061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.898077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.898092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.898112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.898128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.564 [2024-05-14 04:23:08.898144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.564 [2024-05-14 04:23:08.898151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.565 [2024-05-14 04:23:08.898203] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x21fc610 was disconnected and freed. reset controller. 00:25:54.565 [2024-05-14 04:23:08.905265] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905285] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905295] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905301] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905311] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905316] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905320] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905325] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905330] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905335] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905340] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905347] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905356] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8c70 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.905987] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8fd0 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa8fd0 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906142] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906156] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906161] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906166] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906170] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906175] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906179] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906184] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906188] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906193] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906202] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906206] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906210] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906215] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906223] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906228] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906232] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906237] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906241] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906252] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906257] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906261] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906266] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906270] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906296] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906301] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906310] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906323] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906328] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906332] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906336] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906345] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906349] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906354] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906358] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906363] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906367] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906372] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906377] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906381] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906391] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906395] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906399] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906404] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906408] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906412] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906417] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906421] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906425] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906430] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfa9460 is same with the state(5) to be set 00:25:54.565 [2024-05-14 04:23:08.906862] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.565 [2024-05-14 04:23:08.906884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.565 [2024-05-14 04:23:08.906892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.565 [2024-05-14 04:23:08.906900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.565 [2024-05-14 04:23:08.906908] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.566 [2024-05-14 04:23:08.906915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.906923] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.566 [2024-05-14 04:23:08.906931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.906938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2096d70 is same with the state(5) to be set 00:25:54.566 [2024-05-14 04:23:08.906958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x212b940 (9): Bad file descriptor 00:25:54.566 [2024-05-14 04:23:08.906971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x208f060 (9): Bad file descriptor 00:25:54.566 [2024-05-14 04:23:08.906987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x206b7c0 (9): Bad file descriptor 00:25:54.566 [2024-05-14 04:23:08.907000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x206e520 (9): Bad file descriptor 00:25:54.566 [2024-05-14 04:23:08.907026] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.566 [2024-05-14 04:23:08.907034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.907042] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.566 [2024-05-14 04:23:08.907049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.907057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.566 [2024-05-14 04:23:08.907064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.907071] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.566 [2024-05-14 04:23:08.907078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.907085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x212c5f0 is same with the state(5) to be set 00:25:54.566 [2024-05-14 04:23:08.907101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2232020 (9): Bad file descriptor 00:25:54.566 [2024-05-14 04:23:08.907113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2231590 (9): Bad file descriptor 00:25:54.566 [2024-05-14 04:23:08.907128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2144cd0 (9): Bad file descriptor 00:25:54.566 [2024-05-14 04:23:08.907144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2066160 (9): Bad file descriptor 00:25:54.566 [2024-05-14 04:23:08.908825] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:54.566 [2024-05-14 04:23:08.909247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.566 [2024-05-14 04:23:08.909661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.566 [2024-05-14 04:23:08.909668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.909984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.909993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.910250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.910259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.918703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.918751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.918761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.918772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.918779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.918789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.918797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.918806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.567 [2024-05-14 04:23:08.918813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.567 [2024-05-14 04:23:08.918880] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20583f0 was disconnected and freed. reset controller. 00:25:54.568 [2024-05-14 04:23:08.919650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.568 [2024-05-14 04:23:08.920162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.568 [2024-05-14 04:23:08.920174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2232020 with addr=10.0.0.2, port=4420 00:25:54.568 [2024-05-14 04:23:08.920185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2232020 is same with the state(5) to be set 00:25:54.568 [2024-05-14 04:23:08.920217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2096d70 (9): Bad file descriptor 00:25:54.568 [2024-05-14 04:23:08.920263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x212c5f0 (9): Bad file descriptor 00:25:54.568 [2024-05-14 04:23:08.920300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2232020 (9): Bad file descriptor 00:25:54.568 [2024-05-14 04:23:08.920686] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:54.568 [2024-05-14 04:23:08.920735] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:54.568 [2024-05-14 04:23:08.920775] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:54.568 [2024-05-14 04:23:08.920817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.920829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.920854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.920862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.920875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.920883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.920895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.920902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.920914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.920922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.920936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.920944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.920956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.920964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.920977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.920984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.920997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.568 [2024-05-14 04:23:08.921541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.568 [2024-05-14 04:23:08.921552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.921988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.921995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.922007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.922014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.922027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.922035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.922048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.922055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.922067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.922074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.922088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.922095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.923006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2055830 is same with the state(5) to be set 00:25:54.569 [2024-05-14 04:23:08.923057] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2055830 was disconnected and freed. reset controller. 00:25:54.569 [2024-05-14 04:23:08.923066] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.569 [2024-05-14 04:23:08.925114] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:54.569 [2024-05-14 04:23:08.925218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.925243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.925260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.925277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.925299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.925317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.925334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.925351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.925367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.569 [2024-05-14 04:23:08.925384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.569 [2024-05-14 04:23:08.925395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.570 [2024-05-14 04:23:08.925947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.570 [2024-05-14 04:23:08.925957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.925964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.925973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.925981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.925990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.925997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.926295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.926303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.571 [2024-05-14 04:23:08.927892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.571 [2024-05-14 04:23:08.927899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.927909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.927916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.927927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.927934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.927944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.927951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.927960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.927968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.927977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.927984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.927994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.928542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.928550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2208a90 is same with the state(5) to be set 00:25:54.572 [2024-05-14 04:23:08.929781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.929794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.572 [2024-05-14 04:23:08.929806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.572 [2024-05-14 04:23:08.929815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.929988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.929995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.573 [2024-05-14 04:23:08.930509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.573 [2024-05-14 04:23:08.930518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.930880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.930889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2052c70 is same with the state(5) to be set 00:25:54.574 [2024-05-14 04:23:08.932130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.574 [2024-05-14 04:23:08.932454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.574 [2024-05-14 04:23:08.932463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.932987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.932995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.933004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.933011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.933021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.933028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.933037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.575 [2024-05-14 04:23:08.933045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.575 [2024-05-14 04:23:08.933054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.933233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.933241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2054250 is same with the state(5) to be set 00:25:54.576 [2024-05-14 04:23:08.934566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.934983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.934990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.935000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.935007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.935016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.935024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.935033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.935040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.935050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.576 [2024-05-14 04:23:08.935057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.576 [2024-05-14 04:23:08.935066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.935641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.935649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.936946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.936961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.936976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.936985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.936996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.937005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.937016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.937025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.937036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.937045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.577 [2024-05-14 04:23:08.937056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.577 [2024-05-14 04:23:08.937065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.937379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.937387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2059990 is same with the state(5) to be set 00:25:54.578 [2024-05-14 04:23:08.938056] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2059990 was disconnected and freed. reset controller. 00:25:54.578 [2024-05-14 04:23:08.938100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.578 [2024-05-14 04:23:08.938481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.578 [2024-05-14 04:23:08.938490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.938985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.938994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.939001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.939011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.939019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.939028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.939035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.939044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.579 [2024-05-14 04:23:08.939052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.579 [2024-05-14 04:23:08.939061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.580 [2024-05-14 04:23:08.939069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.580 [2024-05-14 04:23:08.939078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.580 [2024-05-14 04:23:08.939085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.580 [2024-05-14 04:23:08.939094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.580 [2024-05-14 04:23:08.939103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.580 [2024-05-14 04:23:08.939113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.580 [2024-05-14 04:23:08.939120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.580 [2024-05-14 04:23:08.939129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.580 [2024-05-14 04:23:08.939136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.580 [2024-05-14 04:23:08.939146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.580 [2024-05-14 04:23:08.939153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.580 [2024-05-14 04:23:08.939162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.580 [2024-05-14 04:23:08.939170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.580 [2024-05-14 04:23:08.939179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:54.580 [2024-05-14 04:23:08.939186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.580 [2024-05-14 04:23:08.939194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x205af70 is same with the state(5) to be set 00:25:54.580 [2024-05-14 04:23:08.942762] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:54.580 [2024-05-14 04:23:08.942788] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:54.580 [2024-05-14 04:23:08.942798] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:54.580 [2024-05-14 04:23:08.942831] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:54.580 [2024-05-14 04:23:08.942839] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:54.580 [2024-05-14 04:23:08.942848] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:54.580 [2024-05-14 04:23:08.942866] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.580 [2024-05-14 04:23:08.942877] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.580 [2024-05-14 04:23:08.942888] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.580 [2024-05-14 04:23:08.942903] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.580 [2024-05-14 04:23:08.942913] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.580 [2024-05-14 04:23:08.942924] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.580 [2024-05-14 04:23:08.942933] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.580 [2024-05-14 04:23:08.944559] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:54.580 [2024-05-14 04:23:08.944575] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:54.580 [2024-05-14 04:23:08.944585] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:54.580 [2024-05-14 04:23:08.944599] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:54.580 [2024-05-14 04:23:08.945152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.945543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.945554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x212c5f0 with addr=10.0.0.2, port=4420 00:25:54.580 [2024-05-14 04:23:08.945562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x212c5f0 is same with the state(5) to be set 00:25:54.580 [2024-05-14 04:23:08.945723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.946199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.946208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x206b7c0 with addr=10.0.0.2, port=4420 00:25:54.580 [2024-05-14 04:23:08.946215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x206b7c0 is same with the state(5) to be set 00:25:54.580 [2024-05-14 04:23:08.946685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.947199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.947208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x206e520 with addr=10.0.0.2, port=4420 00:25:54.580 [2024-05-14 04:23:08.947215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x206e520 is same with the state(5) to be set 00:25:54.580 [2024-05-14 04:23:08.948820] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:54.580 [2024-05-14 04:23:08.948832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.580 task offset: 34560 on job bdev=Nvme2n1 fails 00:25:54.580 00:25:54.580 Latency(us) 00:25:54.580 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:54.580 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme1n1 ended in about 0.67 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme1n1 : 0.67 432.37 27.02 95.09 0.00 120401.02 65972.91 112721.92 00:25:54.580 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme2n1 ended in about 0.65 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme2n1 : 0.65 383.80 23.99 97.86 0.00 130189.95 11578.03 132819.63 00:25:54.580 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme3n1 ended in about 0.68 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme3n1 : 0.68 251.76 15.73 85.89 0.00 183132.16 19660.80 151169.71 00:25:54.580 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme4n1 ended in about 0.68 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme4n1 : 0.68 242.03 15.13 94.45 0.00 182040.61 114469.55 159907.84 00:25:54.580 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme5n1 ended in about 0.68 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme5n1 : 0.68 305.90 19.12 94.12 0.00 151273.31 57234.77 138062.51 00:25:54.580 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme6n1 ended in about 0.67 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme6n1 : 0.67 379.92 23.75 95.73 0.00 125336.05 20316.16 137188.69 00:25:54.580 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme7n1 ended in about 0.68 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme7n1 : 0.68 369.31 23.08 93.79 0.00 127410.49 19114.67 120586.24 00:25:54.580 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme8n1 ended in about 0.67 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme8n1 : 0.67 374.70 23.42 95.54 0.00 123636.61 14636.37 122333.87 00:25:54.580 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme9n1 ended in about 0.69 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme9n1 : 0.69 481.12 30.07 33.33 0.00 109769.26 18459.31 103546.88 00:25:54.580 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:54.580 Job: Nvme10n1 ended in about 0.69 seconds with error 00:25:54.580 Verification LBA range: start 0x0 length 0x400 00:25:54.580 Nvme10n1 : 0.69 303.25 18.95 93.31 0.00 143365.62 83886.08 116217.17 00:25:54.580 =================================================================================================================== 00:25:54.580 Total : 3524.15 220.26 879.12 0.00 136242.63 11578.03 159907.84 00:25:54.580 [2024-05-14 04:23:08.977155] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:54.580 [2024-05-14 04:23:08.977192] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:54.580 [2024-05-14 04:23:08.977648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.978131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.978141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x208f060 with addr=10.0.0.2, port=4420 00:25:54.580 [2024-05-14 04:23:08.978150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x208f060 is same with the state(5) to be set 00:25:54.580 [2024-05-14 04:23:08.978384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.978869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.978879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2231590 with addr=10.0.0.2, port=4420 00:25:54.580 [2024-05-14 04:23:08.978886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2231590 is same with the state(5) to be set 00:25:54.580 [2024-05-14 04:23:08.979238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.979801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.979811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2144cd0 with addr=10.0.0.2, port=4420 00:25:54.580 [2024-05-14 04:23:08.979818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2144cd0 is same with the state(5) to be set 00:25:54.580 [2024-05-14 04:23:08.980320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.980650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.580 [2024-05-14 04:23:08.980669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2066160 with addr=10.0.0.2, port=4420 00:25:54.581 [2024-05-14 04:23:08.980678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2066160 is same with the state(5) to be set 00:25:54.581 [2024-05-14 04:23:08.980693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x212c5f0 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.980705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x206b7c0 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.980714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x206e520 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.981671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.581 [2024-05-14 04:23:08.982148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.581 [2024-05-14 04:23:08.982158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x212b940 with addr=10.0.0.2, port=4420 00:25:54.581 [2024-05-14 04:23:08.982165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x212b940 is same with the state(5) to be set 00:25:54.581 [2024-05-14 04:23:08.982693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.581 [2024-05-14 04:23:08.983042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.581 [2024-05-14 04:23:08.983051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2096d70 with addr=10.0.0.2, port=4420 00:25:54.581 [2024-05-14 04:23:08.983059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2096d70 is same with the state(5) to be set 00:25:54.581 [2024-05-14 04:23:08.983068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x208f060 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.983077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2231590 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.983086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2144cd0 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.983095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2066160 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.983103] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.983110] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.983118] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:54.581 [2024-05-14 04:23:08.983130] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.983136] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.983143] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:54.581 [2024-05-14 04:23:08.983154] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.983161] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.983167] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:54.581 [2024-05-14 04:23:08.983202] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.581 [2024-05-14 04:23:08.983213] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.581 [2024-05-14 04:23:08.983223] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.581 [2024-05-14 04:23:08.983233] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.581 [2024-05-14 04:23:08.983243] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.581 [2024-05-14 04:23:08.983253] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.581 [2024-05-14 04:23:08.983263] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:54.581 [2024-05-14 04:23:08.983342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.581 [2024-05-14 04:23:08.983351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.581 [2024-05-14 04:23:08.983357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.581 [2024-05-14 04:23:08.983371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x212b940 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.983381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2096d70 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.983388] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.983395] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.983402] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:54.581 [2024-05-14 04:23:08.983411] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.983418] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.983425] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:54.581 [2024-05-14 04:23:08.983434] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.983440] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.983447] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:54.581 [2024-05-14 04:23:08.983456] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.983463] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.983469] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:54.581 [2024-05-14 04:23:08.983506] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:54.581 [2024-05-14 04:23:08.983516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.581 [2024-05-14 04:23:08.983522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.581 [2024-05-14 04:23:08.983528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.581 [2024-05-14 04:23:08.983534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.581 [2024-05-14 04:23:08.983546] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.983554] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.983560] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:54.581 [2024-05-14 04:23:08.983569] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.983575] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.983582] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:54.581 [2024-05-14 04:23:08.983608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.581 [2024-05-14 04:23:08.983615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.581 [2024-05-14 04:23:08.984139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.581 [2024-05-14 04:23:08.984603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:54.581 [2024-05-14 04:23:08.984643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2232020 with addr=10.0.0.2, port=4420 00:25:54.581 [2024-05-14 04:23:08.984654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2232020 is same with the state(5) to be set 00:25:54.581 [2024-05-14 04:23:08.984704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2232020 (9): Bad file descriptor 00:25:54.581 [2024-05-14 04:23:08.984738] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:54.581 [2024-05-14 04:23:08.984746] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:54.581 [2024-05-14 04:23:08.984754] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:54.581 [2024-05-14 04:23:08.984784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:54.857 04:23:09 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:54.857 04:23:09 -- target/shutdown.sh@138 -- # sleep 1 00:25:55.802 04:23:10 -- target/shutdown.sh@141 -- # kill -9 4055615 00:25:55.802 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (4055615) - No such process 00:25:55.802 04:23:10 -- target/shutdown.sh@141 -- # true 00:25:55.802 04:23:10 -- target/shutdown.sh@143 -- # stoptarget 00:25:55.802 04:23:10 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:55.802 04:23:10 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:55.802 04:23:10 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:55.802 04:23:10 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:55.802 04:23:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:55.802 04:23:10 -- nvmf/common.sh@116 -- # sync 00:25:55.802 04:23:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:55.802 04:23:10 -- nvmf/common.sh@119 -- # set +e 00:25:55.802 04:23:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:55.802 04:23:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:55.802 rmmod nvme_tcp 00:25:55.802 rmmod nvme_fabrics 00:25:55.802 rmmod nvme_keyring 00:25:55.802 04:23:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:55.802 04:23:10 -- nvmf/common.sh@123 -- # set -e 00:25:55.802 04:23:10 -- nvmf/common.sh@124 -- # return 0 00:25:55.802 04:23:10 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:55.802 04:23:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:55.802 04:23:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:55.802 04:23:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:55.802 04:23:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:55.802 04:23:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:55.802 04:23:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:55.802 04:23:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:55.802 04:23:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:58.352 04:23:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:58.352 00:25:58.352 real 0m7.481s 00:25:58.352 user 0m17.380s 00:25:58.352 sys 0m1.243s 00:25:58.352 04:23:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:58.352 04:23:12 -- common/autotest_common.sh@10 -- # set +x 00:25:58.352 ************************************ 00:25:58.352 END TEST nvmf_shutdown_tc3 00:25:58.352 ************************************ 00:25:58.352 04:23:12 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:58.352 00:25:58.352 real 0m31.803s 00:25:58.352 user 1m13.164s 00:25:58.352 sys 0m9.383s 00:25:58.352 04:23:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:58.352 04:23:12 -- common/autotest_common.sh@10 -- # set +x 00:25:58.352 ************************************ 00:25:58.352 END TEST nvmf_shutdown 00:25:58.352 ************************************ 00:25:58.352 04:23:12 -- nvmf/nvmf.sh@85 -- # timing_exit target 00:25:58.352 04:23:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:58.352 04:23:12 -- common/autotest_common.sh@10 -- # set +x 00:25:58.352 04:23:12 -- nvmf/nvmf.sh@87 -- # timing_enter host 00:25:58.352 04:23:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:58.352 04:23:12 -- common/autotest_common.sh@10 -- # set +x 00:25:58.352 04:23:12 -- nvmf/nvmf.sh@89 -- # [[ 0 -eq 0 ]] 00:25:58.352 04:23:12 -- nvmf/nvmf.sh@90 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:58.352 04:23:12 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:58.352 04:23:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:58.352 04:23:12 -- common/autotest_common.sh@10 -- # set +x 00:25:58.352 ************************************ 00:25:58.352 START TEST nvmf_multicontroller 00:25:58.352 ************************************ 00:25:58.352 04:23:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:58.353 * Looking for test storage... 00:25:58.353 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:58.353 04:23:12 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:58.353 04:23:12 -- nvmf/common.sh@7 -- # uname -s 00:25:58.353 04:23:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:58.353 04:23:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:58.353 04:23:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:58.353 04:23:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:58.353 04:23:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:58.353 04:23:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:58.353 04:23:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:58.353 04:23:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:58.353 04:23:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:58.353 04:23:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:58.353 04:23:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:58.353 04:23:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:58.353 04:23:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:58.353 04:23:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:58.353 04:23:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:58.353 04:23:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:58.353 04:23:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:58.353 04:23:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:58.353 04:23:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:58.353 04:23:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.353 04:23:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.353 04:23:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.353 04:23:12 -- paths/export.sh@5 -- # export PATH 00:25:58.353 04:23:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.353 04:23:12 -- nvmf/common.sh@46 -- # : 0 00:25:58.353 04:23:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:58.353 04:23:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:58.353 04:23:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:58.353 04:23:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:58.353 04:23:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:58.353 04:23:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:58.353 04:23:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:58.353 04:23:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:58.353 04:23:12 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:58.353 04:23:12 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:58.353 04:23:12 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:58.353 04:23:12 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:58.353 04:23:12 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:58.353 04:23:12 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:58.353 04:23:12 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:58.353 04:23:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:58.353 04:23:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:58.353 04:23:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:58.353 04:23:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:58.353 04:23:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:58.353 04:23:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:58.353 04:23:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:58.353 04:23:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:58.353 04:23:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:58.353 04:23:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:58.353 04:23:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:58.353 04:23:12 -- common/autotest_common.sh@10 -- # set +x 00:26:04.942 04:23:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:04.942 04:23:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:04.943 04:23:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:04.943 04:23:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:04.943 04:23:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:04.943 04:23:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:04.943 04:23:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:04.943 04:23:19 -- nvmf/common.sh@294 -- # net_devs=() 00:26:04.943 04:23:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:04.943 04:23:19 -- nvmf/common.sh@295 -- # e810=() 00:26:04.943 04:23:19 -- nvmf/common.sh@295 -- # local -ga e810 00:26:04.943 04:23:19 -- nvmf/common.sh@296 -- # x722=() 00:26:04.943 04:23:19 -- nvmf/common.sh@296 -- # local -ga x722 00:26:04.943 04:23:19 -- nvmf/common.sh@297 -- # mlx=() 00:26:04.943 04:23:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:04.943 04:23:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:04.943 04:23:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:04.943 04:23:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:04.943 04:23:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:04.943 04:23:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:04.943 04:23:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:26:04.943 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:26:04.943 04:23:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:04.943 04:23:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:26:04.943 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:26:04.943 04:23:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:04.943 04:23:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:04.943 04:23:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:04.943 04:23:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:04.943 04:23:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:04.943 04:23:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:26:04.943 Found net devices under 0000:4b:00.0: cvl_0_0 00:26:04.943 04:23:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:04.943 04:23:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:04.943 04:23:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:04.943 04:23:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:04.943 04:23:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:04.943 04:23:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:26:04.943 Found net devices under 0000:4b:00.1: cvl_0_1 00:26:04.943 04:23:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:04.943 04:23:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:04.943 04:23:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:04.943 04:23:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:04.943 04:23:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:04.943 04:23:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:04.943 04:23:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:04.943 04:23:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:04.943 04:23:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:04.943 04:23:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:04.943 04:23:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:04.943 04:23:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:04.943 04:23:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:04.943 04:23:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:04.943 04:23:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:04.943 04:23:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:04.943 04:23:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:04.943 04:23:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:04.943 04:23:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:04.943 04:23:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:04.943 04:23:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:04.943 04:23:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:05.204 04:23:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:05.204 04:23:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:05.204 04:23:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:05.204 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:05.204 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.598 ms 00:26:05.204 00:26:05.204 --- 10.0.0.2 ping statistics --- 00:26:05.204 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.204 rtt min/avg/max/mdev = 0.598/0.598/0.598/0.000 ms 00:26:05.204 04:23:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:05.204 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:05.204 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.368 ms 00:26:05.204 00:26:05.204 --- 10.0.0.1 ping statistics --- 00:26:05.204 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.204 rtt min/avg/max/mdev = 0.368/0.368/0.368/0.000 ms 00:26:05.204 04:23:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:05.204 04:23:19 -- nvmf/common.sh@410 -- # return 0 00:26:05.204 04:23:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:05.204 04:23:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:05.204 04:23:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:05.204 04:23:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:05.204 04:23:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:05.204 04:23:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:05.204 04:23:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:05.204 04:23:19 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:26:05.204 04:23:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:05.204 04:23:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:05.205 04:23:19 -- common/autotest_common.sh@10 -- # set +x 00:26:05.205 04:23:19 -- nvmf/common.sh@469 -- # nvmfpid=4060517 00:26:05.205 04:23:19 -- nvmf/common.sh@470 -- # waitforlisten 4060517 00:26:05.205 04:23:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:05.205 04:23:19 -- common/autotest_common.sh@819 -- # '[' -z 4060517 ']' 00:26:05.205 04:23:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:05.205 04:23:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:05.205 04:23:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:05.205 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:05.205 04:23:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:05.205 04:23:19 -- common/autotest_common.sh@10 -- # set +x 00:26:05.205 [2024-05-14 04:23:19.728189] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:26:05.205 [2024-05-14 04:23:19.728252] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:05.205 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.466 [2024-05-14 04:23:19.815140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:05.466 [2024-05-14 04:23:19.905688] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:05.466 [2024-05-14 04:23:19.905873] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:05.466 [2024-05-14 04:23:19.905884] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:05.466 [2024-05-14 04:23:19.905891] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:05.466 [2024-05-14 04:23:19.906050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:05.466 [2024-05-14 04:23:19.906216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:05.466 [2024-05-14 04:23:19.906216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:06.039 04:23:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:06.039 04:23:20 -- common/autotest_common.sh@852 -- # return 0 00:26:06.039 04:23:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:06.039 04:23:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:06.039 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.039 04:23:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:06.039 04:23:20 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:06.039 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.039 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.039 [2024-05-14 04:23:20.548588] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:06.039 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.039 04:23:20 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:06.039 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.039 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.039 Malloc0 00:26:06.039 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.039 04:23:20 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:06.039 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.039 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.039 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.039 04:23:20 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:06.039 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.039 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.039 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.039 04:23:20 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:06.039 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.039 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.039 [2024-05-14 04:23:20.595471] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:06.039 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.039 04:23:20 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:06.039 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.039 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.039 [2024-05-14 04:23:20.603380] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:06.039 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.039 04:23:20 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:06.039 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.039 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.039 Malloc1 00:26:06.039 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.039 04:23:20 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:26:06.039 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.039 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.301 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.301 04:23:20 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:26:06.301 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.301 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.301 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.301 04:23:20 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:26:06.301 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.301 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.301 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.301 04:23:20 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:26:06.301 04:23:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.301 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.301 04:23:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:06.301 04:23:20 -- host/multicontroller.sh@44 -- # bdevperf_pid=4060627 00:26:06.301 04:23:20 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:06.301 04:23:20 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:26:06.301 04:23:20 -- host/multicontroller.sh@47 -- # waitforlisten 4060627 /var/tmp/bdevperf.sock 00:26:06.301 04:23:20 -- common/autotest_common.sh@819 -- # '[' -z 4060627 ']' 00:26:06.301 04:23:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:06.301 04:23:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:06.301 04:23:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:06.301 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:06.301 04:23:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:06.301 04:23:20 -- common/autotest_common.sh@10 -- # set +x 00:26:06.873 04:23:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:06.873 04:23:21 -- common/autotest_common.sh@852 -- # return 0 00:26:06.873 04:23:21 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:06.873 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:06.873 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.135 NVMe0n1 00:26:07.135 04:23:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:07.135 04:23:21 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:07.135 04:23:21 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:26:07.135 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.135 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.135 04:23:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:07.135 1 00:26:07.135 04:23:21 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:07.136 04:23:21 -- common/autotest_common.sh@640 -- # local es=0 00:26:07.136 04:23:21 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:07.136 04:23:21 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:07.136 04:23:21 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:26:07.136 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.136 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.136 request: 00:26:07.136 { 00:26:07.136 "name": "NVMe0", 00:26:07.136 "trtype": "tcp", 00:26:07.136 "traddr": "10.0.0.2", 00:26:07.136 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:26:07.136 "hostaddr": "10.0.0.2", 00:26:07.136 "hostsvcid": "60000", 00:26:07.136 "adrfam": "ipv4", 00:26:07.136 "trsvcid": "4420", 00:26:07.136 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:07.136 "method": "bdev_nvme_attach_controller", 00:26:07.136 "req_id": 1 00:26:07.136 } 00:26:07.136 Got JSON-RPC error response 00:26:07.136 response: 00:26:07.136 { 00:26:07.136 "code": -114, 00:26:07.136 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:07.136 } 00:26:07.136 04:23:21 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:07.136 04:23:21 -- common/autotest_common.sh@643 -- # es=1 00:26:07.136 04:23:21 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:07.136 04:23:21 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:07.136 04:23:21 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:07.136 04:23:21 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:07.136 04:23:21 -- common/autotest_common.sh@640 -- # local es=0 00:26:07.136 04:23:21 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:07.136 04:23:21 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:07.136 04:23:21 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:26:07.136 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.136 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.136 request: 00:26:07.136 { 00:26:07.136 "name": "NVMe0", 00:26:07.136 "trtype": "tcp", 00:26:07.136 "traddr": "10.0.0.2", 00:26:07.136 "hostaddr": "10.0.0.2", 00:26:07.136 "hostsvcid": "60000", 00:26:07.136 "adrfam": "ipv4", 00:26:07.136 "trsvcid": "4420", 00:26:07.136 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:07.136 "method": "bdev_nvme_attach_controller", 00:26:07.136 "req_id": 1 00:26:07.136 } 00:26:07.136 Got JSON-RPC error response 00:26:07.136 response: 00:26:07.136 { 00:26:07.136 "code": -114, 00:26:07.136 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:07.136 } 00:26:07.136 04:23:21 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:07.136 04:23:21 -- common/autotest_common.sh@643 -- # es=1 00:26:07.136 04:23:21 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:07.136 04:23:21 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:07.136 04:23:21 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:07.136 04:23:21 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:07.136 04:23:21 -- common/autotest_common.sh@640 -- # local es=0 00:26:07.136 04:23:21 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:07.136 04:23:21 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:07.136 04:23:21 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:26:07.136 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.136 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.136 request: 00:26:07.136 { 00:26:07.136 "name": "NVMe0", 00:26:07.136 "trtype": "tcp", 00:26:07.136 "traddr": "10.0.0.2", 00:26:07.136 "hostaddr": "10.0.0.2", 00:26:07.136 "hostsvcid": "60000", 00:26:07.136 "adrfam": "ipv4", 00:26:07.136 "trsvcid": "4420", 00:26:07.136 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:07.136 "multipath": "disable", 00:26:07.136 "method": "bdev_nvme_attach_controller", 00:26:07.136 "req_id": 1 00:26:07.136 } 00:26:07.136 Got JSON-RPC error response 00:26:07.136 response: 00:26:07.136 { 00:26:07.136 "code": -114, 00:26:07.136 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:26:07.136 } 00:26:07.136 04:23:21 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:07.136 04:23:21 -- common/autotest_common.sh@643 -- # es=1 00:26:07.136 04:23:21 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:07.136 04:23:21 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:07.136 04:23:21 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:07.136 04:23:21 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:07.136 04:23:21 -- common/autotest_common.sh@640 -- # local es=0 00:26:07.136 04:23:21 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:07.136 04:23:21 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:07.136 04:23:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:07.136 04:23:21 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:26:07.136 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.136 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.136 request: 00:26:07.136 { 00:26:07.136 "name": "NVMe0", 00:26:07.136 "trtype": "tcp", 00:26:07.136 "traddr": "10.0.0.2", 00:26:07.136 "hostaddr": "10.0.0.2", 00:26:07.136 "hostsvcid": "60000", 00:26:07.136 "adrfam": "ipv4", 00:26:07.136 "trsvcid": "4420", 00:26:07.136 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:07.136 "multipath": "failover", 00:26:07.136 "method": "bdev_nvme_attach_controller", 00:26:07.136 "req_id": 1 00:26:07.136 } 00:26:07.136 Got JSON-RPC error response 00:26:07.136 response: 00:26:07.136 { 00:26:07.136 "code": -114, 00:26:07.136 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:26:07.136 } 00:26:07.136 04:23:21 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:07.136 04:23:21 -- common/autotest_common.sh@643 -- # es=1 00:26:07.136 04:23:21 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:07.136 04:23:21 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:07.136 04:23:21 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:07.136 04:23:21 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:07.136 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.136 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.398 00:26:07.398 04:23:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:07.398 04:23:21 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:07.398 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.398 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.398 04:23:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:07.398 04:23:21 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:26:07.398 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.398 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.398 00:26:07.398 04:23:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:07.399 04:23:21 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:07.399 04:23:21 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:26:07.399 04:23:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:07.399 04:23:21 -- common/autotest_common.sh@10 -- # set +x 00:26:07.399 04:23:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:07.399 04:23:21 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:26:07.399 04:23:21 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:08.786 0 00:26:08.786 04:23:23 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:26:08.786 04:23:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:08.786 04:23:23 -- common/autotest_common.sh@10 -- # set +x 00:26:08.786 04:23:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:08.786 04:23:23 -- host/multicontroller.sh@100 -- # killprocess 4060627 00:26:08.786 04:23:23 -- common/autotest_common.sh@926 -- # '[' -z 4060627 ']' 00:26:08.786 04:23:23 -- common/autotest_common.sh@930 -- # kill -0 4060627 00:26:08.786 04:23:23 -- common/autotest_common.sh@931 -- # uname 00:26:08.786 04:23:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:08.786 04:23:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4060627 00:26:08.786 04:23:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:08.786 04:23:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:08.786 04:23:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4060627' 00:26:08.786 killing process with pid 4060627 00:26:08.786 04:23:23 -- common/autotest_common.sh@945 -- # kill 4060627 00:26:08.786 04:23:23 -- common/autotest_common.sh@950 -- # wait 4060627 00:26:08.786 04:23:23 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:08.786 04:23:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:08.786 04:23:23 -- common/autotest_common.sh@10 -- # set +x 00:26:08.786 04:23:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:08.786 04:23:23 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:26:08.786 04:23:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:08.786 04:23:23 -- common/autotest_common.sh@10 -- # set +x 00:26:08.786 04:23:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:08.786 04:23:23 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:26:08.786 04:23:23 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:08.786 04:23:23 -- common/autotest_common.sh@1597 -- # read -r file 00:26:08.786 04:23:23 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:26:08.786 04:23:23 -- common/autotest_common.sh@1596 -- # sort -u 00:26:08.786 04:23:23 -- common/autotest_common.sh@1598 -- # cat 00:26:08.786 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:26:08.786 [2024-05-14 04:23:20.697818] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:26:08.786 [2024-05-14 04:23:20.697874] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4060627 ] 00:26:08.786 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.787 [2024-05-14 04:23:20.756452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:08.787 [2024-05-14 04:23:20.819311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:08.787 [2024-05-14 04:23:21.941817] bdev.c:4548:bdev_name_add: *ERROR*: Bdev name 6a5fea60-e79d-4bf6-8bbb-6089e55b0435 already exists 00:26:08.787 [2024-05-14 04:23:21.941847] bdev.c:7598:bdev_register: *ERROR*: Unable to add uuid:6a5fea60-e79d-4bf6-8bbb-6089e55b0435 alias for bdev NVMe1n1 00:26:08.787 [2024-05-14 04:23:21.941857] bdev_nvme.c:4230:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:26:08.787 Running I/O for 1 seconds... 00:26:08.787 00:26:08.787 Latency(us) 00:26:08.787 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:08.787 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:26:08.787 NVMe0n1 : 1.00 28574.39 111.62 0.00 0.00 4469.29 2471.25 11741.87 00:26:08.787 =================================================================================================================== 00:26:08.787 Total : 28574.39 111.62 0.00 0.00 4469.29 2471.25 11741.87 00:26:08.787 Received shutdown signal, test time was about 1.000000 seconds 00:26:08.787 00:26:08.787 Latency(us) 00:26:08.787 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:08.787 =================================================================================================================== 00:26:08.787 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:08.787 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:26:08.787 04:23:23 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:08.787 04:23:23 -- common/autotest_common.sh@1597 -- # read -r file 00:26:08.787 04:23:23 -- host/multicontroller.sh@108 -- # nvmftestfini 00:26:08.787 04:23:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:08.787 04:23:23 -- nvmf/common.sh@116 -- # sync 00:26:08.787 04:23:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:08.787 04:23:23 -- nvmf/common.sh@119 -- # set +e 00:26:08.787 04:23:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:08.787 04:23:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:08.787 rmmod nvme_tcp 00:26:08.787 rmmod nvme_fabrics 00:26:08.787 rmmod nvme_keyring 00:26:09.048 04:23:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:09.048 04:23:23 -- nvmf/common.sh@123 -- # set -e 00:26:09.048 04:23:23 -- nvmf/common.sh@124 -- # return 0 00:26:09.048 04:23:23 -- nvmf/common.sh@477 -- # '[' -n 4060517 ']' 00:26:09.048 04:23:23 -- nvmf/common.sh@478 -- # killprocess 4060517 00:26:09.048 04:23:23 -- common/autotest_common.sh@926 -- # '[' -z 4060517 ']' 00:26:09.048 04:23:23 -- common/autotest_common.sh@930 -- # kill -0 4060517 00:26:09.048 04:23:23 -- common/autotest_common.sh@931 -- # uname 00:26:09.048 04:23:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:09.048 04:23:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4060517 00:26:09.048 04:23:23 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:09.048 04:23:23 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:09.048 04:23:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4060517' 00:26:09.048 killing process with pid 4060517 00:26:09.048 04:23:23 -- common/autotest_common.sh@945 -- # kill 4060517 00:26:09.048 04:23:23 -- common/autotest_common.sh@950 -- # wait 4060517 00:26:09.048 04:23:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:09.048 04:23:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:09.048 04:23:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:09.048 04:23:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:09.048 04:23:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:09.048 04:23:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:09.048 04:23:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:09.048 04:23:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:11.594 04:23:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:11.594 00:26:11.594 real 0m13.168s 00:26:11.594 user 0m15.550s 00:26:11.594 sys 0m6.120s 00:26:11.594 04:23:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:11.594 04:23:25 -- common/autotest_common.sh@10 -- # set +x 00:26:11.594 ************************************ 00:26:11.594 END TEST nvmf_multicontroller 00:26:11.594 ************************************ 00:26:11.594 04:23:25 -- nvmf/nvmf.sh@91 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:11.594 04:23:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:11.594 04:23:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:11.594 04:23:25 -- common/autotest_common.sh@10 -- # set +x 00:26:11.594 ************************************ 00:26:11.594 START TEST nvmf_aer 00:26:11.594 ************************************ 00:26:11.594 04:23:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:26:11.594 * Looking for test storage... 00:26:11.594 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:11.594 04:23:25 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:11.594 04:23:25 -- nvmf/common.sh@7 -- # uname -s 00:26:11.594 04:23:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:11.594 04:23:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:11.594 04:23:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:11.594 04:23:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:11.594 04:23:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:11.594 04:23:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:11.594 04:23:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:11.594 04:23:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:11.594 04:23:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:11.594 04:23:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:11.594 04:23:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:11.594 04:23:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:11.594 04:23:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:11.594 04:23:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:11.594 04:23:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:11.594 04:23:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:11.594 04:23:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:11.594 04:23:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:11.594 04:23:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:11.595 04:23:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.595 04:23:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.595 04:23:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.595 04:23:25 -- paths/export.sh@5 -- # export PATH 00:26:11.595 04:23:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.595 04:23:25 -- nvmf/common.sh@46 -- # : 0 00:26:11.595 04:23:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:11.595 04:23:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:11.595 04:23:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:11.595 04:23:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:11.595 04:23:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:11.595 04:23:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:11.595 04:23:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:11.595 04:23:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:11.595 04:23:25 -- host/aer.sh@11 -- # nvmftestinit 00:26:11.595 04:23:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:11.595 04:23:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:11.595 04:23:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:11.595 04:23:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:11.595 04:23:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:11.595 04:23:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:11.595 04:23:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:11.595 04:23:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:11.595 04:23:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:11.595 04:23:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:11.595 04:23:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:11.595 04:23:25 -- common/autotest_common.sh@10 -- # set +x 00:26:18.201 04:23:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:18.201 04:23:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:18.201 04:23:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:18.201 04:23:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:18.201 04:23:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:18.201 04:23:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:18.201 04:23:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:18.201 04:23:32 -- nvmf/common.sh@294 -- # net_devs=() 00:26:18.201 04:23:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:18.201 04:23:32 -- nvmf/common.sh@295 -- # e810=() 00:26:18.201 04:23:32 -- nvmf/common.sh@295 -- # local -ga e810 00:26:18.201 04:23:32 -- nvmf/common.sh@296 -- # x722=() 00:26:18.201 04:23:32 -- nvmf/common.sh@296 -- # local -ga x722 00:26:18.201 04:23:32 -- nvmf/common.sh@297 -- # mlx=() 00:26:18.201 04:23:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:18.201 04:23:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:18.201 04:23:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:18.201 04:23:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:18.201 04:23:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:18.201 04:23:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:18.201 04:23:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:26:18.201 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:26:18.201 04:23:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:18.201 04:23:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:26:18.201 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:26:18.201 04:23:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:18.201 04:23:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:18.201 04:23:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:18.201 04:23:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:18.201 04:23:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:18.201 04:23:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:26:18.201 Found net devices under 0000:4b:00.0: cvl_0_0 00:26:18.201 04:23:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:18.201 04:23:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:18.201 04:23:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:18.201 04:23:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:18.201 04:23:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:18.201 04:23:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:26:18.201 Found net devices under 0000:4b:00.1: cvl_0_1 00:26:18.201 04:23:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:18.201 04:23:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:18.201 04:23:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:18.201 04:23:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:18.201 04:23:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:18.201 04:23:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:18.201 04:23:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:18.201 04:23:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:18.201 04:23:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:18.201 04:23:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:18.201 04:23:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:18.201 04:23:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:18.201 04:23:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:18.201 04:23:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:18.201 04:23:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:18.201 04:23:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:18.201 04:23:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:18.201 04:23:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:18.201 04:23:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:18.201 04:23:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:18.201 04:23:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:18.201 04:23:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:18.463 04:23:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:18.463 04:23:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:18.463 04:23:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:18.463 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:18.463 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.895 ms 00:26:18.463 00:26:18.463 --- 10.0.0.2 ping statistics --- 00:26:18.463 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:18.463 rtt min/avg/max/mdev = 0.895/0.895/0.895/0.000 ms 00:26:18.463 04:23:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:18.463 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:18.463 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.434 ms 00:26:18.463 00:26:18.463 --- 10.0.0.1 ping statistics --- 00:26:18.463 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:18.463 rtt min/avg/max/mdev = 0.434/0.434/0.434/0.000 ms 00:26:18.463 04:23:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:18.463 04:23:32 -- nvmf/common.sh@410 -- # return 0 00:26:18.464 04:23:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:18.464 04:23:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:18.464 04:23:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:18.464 04:23:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:18.464 04:23:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:18.464 04:23:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:18.464 04:23:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:18.464 04:23:32 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:26:18.464 04:23:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:18.464 04:23:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:18.464 04:23:32 -- common/autotest_common.sh@10 -- # set +x 00:26:18.464 04:23:32 -- nvmf/common.sh@469 -- # nvmfpid=4065325 00:26:18.464 04:23:32 -- nvmf/common.sh@470 -- # waitforlisten 4065325 00:26:18.464 04:23:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:18.464 04:23:32 -- common/autotest_common.sh@819 -- # '[' -z 4065325 ']' 00:26:18.464 04:23:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:18.464 04:23:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:18.464 04:23:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:18.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:18.464 04:23:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:18.464 04:23:32 -- common/autotest_common.sh@10 -- # set +x 00:26:18.464 [2024-05-14 04:23:32.976687] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:26:18.464 [2024-05-14 04:23:32.976749] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:18.464 EAL: No free 2048 kB hugepages reported on node 1 00:26:18.464 [2024-05-14 04:23:33.047144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:18.725 [2024-05-14 04:23:33.120352] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:18.725 [2024-05-14 04:23:33.120477] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:18.725 [2024-05-14 04:23:33.120485] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:18.725 [2024-05-14 04:23:33.120492] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:18.725 [2024-05-14 04:23:33.120636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:18.725 [2024-05-14 04:23:33.120754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:18.725 [2024-05-14 04:23:33.120911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:18.725 [2024-05-14 04:23:33.120912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:19.298 04:23:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:19.298 04:23:33 -- common/autotest_common.sh@852 -- # return 0 00:26:19.298 04:23:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:19.298 04:23:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:19.298 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:26:19.298 04:23:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:19.298 04:23:33 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:19.298 04:23:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.298 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:26:19.298 [2024-05-14 04:23:33.800490] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:19.298 04:23:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.298 04:23:33 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:26:19.298 04:23:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.298 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:26:19.298 Malloc0 00:26:19.298 04:23:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.298 04:23:33 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:26:19.298 04:23:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.298 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:26:19.298 04:23:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.298 04:23:33 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:19.298 04:23:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.298 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:26:19.298 04:23:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.298 04:23:33 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:19.298 04:23:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.298 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:26:19.298 [2024-05-14 04:23:33.859810] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:19.298 04:23:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.298 04:23:33 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:26:19.298 04:23:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.298 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:26:19.298 [2024-05-14 04:23:33.871644] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:19.298 [ 00:26:19.298 { 00:26:19.298 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:19.298 "subtype": "Discovery", 00:26:19.298 "listen_addresses": [], 00:26:19.298 "allow_any_host": true, 00:26:19.298 "hosts": [] 00:26:19.298 }, 00:26:19.298 { 00:26:19.298 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:19.298 "subtype": "NVMe", 00:26:19.298 "listen_addresses": [ 00:26:19.298 { 00:26:19.298 "transport": "TCP", 00:26:19.298 "trtype": "TCP", 00:26:19.298 "adrfam": "IPv4", 00:26:19.298 "traddr": "10.0.0.2", 00:26:19.298 "trsvcid": "4420" 00:26:19.298 } 00:26:19.298 ], 00:26:19.298 "allow_any_host": true, 00:26:19.298 "hosts": [], 00:26:19.298 "serial_number": "SPDK00000000000001", 00:26:19.298 "model_number": "SPDK bdev Controller", 00:26:19.298 "max_namespaces": 2, 00:26:19.298 "min_cntlid": 1, 00:26:19.298 "max_cntlid": 65519, 00:26:19.298 "namespaces": [ 00:26:19.298 { 00:26:19.298 "nsid": 1, 00:26:19.298 "bdev_name": "Malloc0", 00:26:19.298 "name": "Malloc0", 00:26:19.298 "nguid": "8B8C25DE97F34C738711F78886385AFA", 00:26:19.298 "uuid": "8b8c25de-97f3-4c73-8711-f78886385afa" 00:26:19.298 } 00:26:19.298 ] 00:26:19.298 } 00:26:19.298 ] 00:26:19.298 04:23:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.298 04:23:33 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:26:19.298 04:23:33 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:26:19.559 04:23:33 -- host/aer.sh@33 -- # aerpid=4065536 00:26:19.559 04:23:33 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:26:19.559 04:23:33 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:26:19.559 04:23:33 -- common/autotest_common.sh@1244 -- # local i=0 00:26:19.559 04:23:33 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:19.559 04:23:33 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:26:19.559 04:23:33 -- common/autotest_common.sh@1247 -- # i=1 00:26:19.559 04:23:33 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:26:19.559 EAL: No free 2048 kB hugepages reported on node 1 00:26:19.559 04:23:33 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:19.559 04:23:33 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:26:19.559 04:23:33 -- common/autotest_common.sh@1247 -- # i=2 00:26:19.559 04:23:33 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:26:19.559 04:23:34 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:19.559 04:23:34 -- common/autotest_common.sh@1246 -- # '[' 2 -lt 200 ']' 00:26:19.559 04:23:34 -- common/autotest_common.sh@1247 -- # i=3 00:26:19.559 04:23:34 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:26:19.821 04:23:34 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:19.821 04:23:34 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:19.821 04:23:34 -- common/autotest_common.sh@1255 -- # return 0 00:26:19.821 04:23:34 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:26:19.821 04:23:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.821 04:23:34 -- common/autotest_common.sh@10 -- # set +x 00:26:19.821 Malloc1 00:26:19.821 04:23:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.821 04:23:34 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:26:19.821 04:23:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.821 04:23:34 -- common/autotest_common.sh@10 -- # set +x 00:26:19.821 04:23:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.821 04:23:34 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:26:19.821 04:23:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.821 04:23:34 -- common/autotest_common.sh@10 -- # set +x 00:26:19.821 [ 00:26:19.821 { 00:26:19.821 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:19.821 "subtype": "Discovery", 00:26:19.821 "listen_addresses": [], 00:26:19.821 "allow_any_host": true, 00:26:19.821 "hosts": [] 00:26:19.821 }, 00:26:19.821 { 00:26:19.821 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:19.821 "subtype": "NVMe", 00:26:19.821 "listen_addresses": [ 00:26:19.821 { 00:26:19.821 "transport": "TCP", 00:26:19.821 "trtype": "TCP", 00:26:19.821 "adrfam": "IPv4", 00:26:19.821 "traddr": "10.0.0.2", 00:26:19.821 "trsvcid": "4420" 00:26:19.821 } 00:26:19.821 ], 00:26:19.821 "allow_any_host": true, 00:26:19.821 "hosts": [], 00:26:19.821 "serial_number": "SPDK00000000000001", 00:26:19.821 "model_number": "SPDK bdev Controller", 00:26:19.821 "max_namespaces": 2, 00:26:19.821 "min_cntlid": 1, 00:26:19.821 "max_cntlid": 65519, 00:26:19.821 "namespaces": [ 00:26:19.821 { 00:26:19.821 "nsid": 1, 00:26:19.821 "bdev_name": "Malloc0", 00:26:19.821 "name": "Malloc0", 00:26:19.821 "nguid": "8B8C25DE97F34C738711F78886385AFA", 00:26:19.821 "uuid": "8b8c25de-97f3-4c73-8711-f78886385afa" 00:26:19.821 }, 00:26:19.821 Asynchronous Event Request test 00:26:19.821 Attaching to 10.0.0.2 00:26:19.821 Attached to 10.0.0.2 00:26:19.821 Registering asynchronous event callbacks... 00:26:19.821 Starting namespace attribute notice tests for all controllers... 00:26:19.821 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:26:19.821 aer_cb - Changed Namespace 00:26:19.821 Cleaning up... 00:26:19.821 { 00:26:19.821 "nsid": 2, 00:26:19.821 "bdev_name": "Malloc1", 00:26:19.821 "name": "Malloc1", 00:26:19.821 "nguid": "EDE516282A96468AB2D1D0CC31D5F53C", 00:26:19.821 "uuid": "ede51628-2a96-468a-b2d1-d0cc31d5f53c" 00:26:19.821 } 00:26:19.821 ] 00:26:19.821 } 00:26:19.821 ] 00:26:19.821 04:23:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.821 04:23:34 -- host/aer.sh@43 -- # wait 4065536 00:26:19.821 04:23:34 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:26:19.821 04:23:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.821 04:23:34 -- common/autotest_common.sh@10 -- # set +x 00:26:19.821 04:23:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.821 04:23:34 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:26:19.821 04:23:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.821 04:23:34 -- common/autotest_common.sh@10 -- # set +x 00:26:19.821 04:23:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.821 04:23:34 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:19.821 04:23:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.821 04:23:34 -- common/autotest_common.sh@10 -- # set +x 00:26:19.821 04:23:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.821 04:23:34 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:26:19.821 04:23:34 -- host/aer.sh@51 -- # nvmftestfini 00:26:19.821 04:23:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:19.821 04:23:34 -- nvmf/common.sh@116 -- # sync 00:26:19.821 04:23:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:19.821 04:23:34 -- nvmf/common.sh@119 -- # set +e 00:26:19.821 04:23:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:19.821 04:23:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:19.821 rmmod nvme_tcp 00:26:19.821 rmmod nvme_fabrics 00:26:19.821 rmmod nvme_keyring 00:26:19.821 04:23:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:19.821 04:23:34 -- nvmf/common.sh@123 -- # set -e 00:26:19.821 04:23:34 -- nvmf/common.sh@124 -- # return 0 00:26:19.821 04:23:34 -- nvmf/common.sh@477 -- # '[' -n 4065325 ']' 00:26:19.821 04:23:34 -- nvmf/common.sh@478 -- # killprocess 4065325 00:26:19.821 04:23:34 -- common/autotest_common.sh@926 -- # '[' -z 4065325 ']' 00:26:19.821 04:23:34 -- common/autotest_common.sh@930 -- # kill -0 4065325 00:26:19.821 04:23:34 -- common/autotest_common.sh@931 -- # uname 00:26:19.821 04:23:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:19.821 04:23:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4065325 00:26:20.082 04:23:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:20.082 04:23:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:20.082 04:23:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4065325' 00:26:20.082 killing process with pid 4065325 00:26:20.082 04:23:34 -- common/autotest_common.sh@945 -- # kill 4065325 00:26:20.082 [2024-05-14 04:23:34.425974] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:20.082 04:23:34 -- common/autotest_common.sh@950 -- # wait 4065325 00:26:20.082 04:23:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:20.082 04:23:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:20.082 04:23:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:20.082 04:23:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:20.082 04:23:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:20.082 04:23:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:20.082 04:23:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:20.082 04:23:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:22.057 04:23:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:22.057 00:26:22.057 real 0m10.937s 00:26:22.057 user 0m7.797s 00:26:22.057 sys 0m5.693s 00:26:22.057 04:23:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:22.057 04:23:36 -- common/autotest_common.sh@10 -- # set +x 00:26:22.057 ************************************ 00:26:22.057 END TEST nvmf_aer 00:26:22.057 ************************************ 00:26:22.318 04:23:36 -- nvmf/nvmf.sh@92 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:22.318 04:23:36 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:22.318 04:23:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:22.318 04:23:36 -- common/autotest_common.sh@10 -- # set +x 00:26:22.318 ************************************ 00:26:22.318 START TEST nvmf_async_init 00:26:22.318 ************************************ 00:26:22.318 04:23:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:22.318 * Looking for test storage... 00:26:22.318 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:22.318 04:23:36 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:22.318 04:23:36 -- nvmf/common.sh@7 -- # uname -s 00:26:22.318 04:23:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:22.318 04:23:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:22.318 04:23:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:22.318 04:23:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:22.318 04:23:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:22.318 04:23:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:22.318 04:23:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:22.318 04:23:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:22.318 04:23:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:22.318 04:23:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:22.318 04:23:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:22.318 04:23:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:22.318 04:23:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:22.318 04:23:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:22.318 04:23:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:22.318 04:23:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:22.318 04:23:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:22.318 04:23:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:22.318 04:23:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:22.318 04:23:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:22.318 04:23:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:22.318 04:23:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:22.318 04:23:36 -- paths/export.sh@5 -- # export PATH 00:26:22.318 04:23:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:22.318 04:23:36 -- nvmf/common.sh@46 -- # : 0 00:26:22.318 04:23:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:22.318 04:23:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:22.318 04:23:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:22.318 04:23:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:22.318 04:23:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:22.318 04:23:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:22.318 04:23:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:22.318 04:23:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:22.318 04:23:36 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:26:22.318 04:23:36 -- host/async_init.sh@14 -- # null_block_size=512 00:26:22.318 04:23:36 -- host/async_init.sh@15 -- # null_bdev=null0 00:26:22.318 04:23:36 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:26:22.318 04:23:36 -- host/async_init.sh@20 -- # uuidgen 00:26:22.318 04:23:36 -- host/async_init.sh@20 -- # tr -d - 00:26:22.318 04:23:36 -- host/async_init.sh@20 -- # nguid=c25cbdbdd6ef441fb626d0d85f4d40a2 00:26:22.318 04:23:36 -- host/async_init.sh@22 -- # nvmftestinit 00:26:22.318 04:23:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:22.318 04:23:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:22.318 04:23:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:22.318 04:23:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:22.318 04:23:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:22.318 04:23:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:22.318 04:23:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:22.318 04:23:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:22.318 04:23:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:22.318 04:23:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:22.318 04:23:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:22.318 04:23:36 -- common/autotest_common.sh@10 -- # set +x 00:26:30.468 04:23:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:30.468 04:23:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:30.468 04:23:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:30.468 04:23:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:30.468 04:23:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:30.468 04:23:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:30.468 04:23:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:30.468 04:23:43 -- nvmf/common.sh@294 -- # net_devs=() 00:26:30.468 04:23:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:30.468 04:23:43 -- nvmf/common.sh@295 -- # e810=() 00:26:30.468 04:23:43 -- nvmf/common.sh@295 -- # local -ga e810 00:26:30.468 04:23:43 -- nvmf/common.sh@296 -- # x722=() 00:26:30.468 04:23:43 -- nvmf/common.sh@296 -- # local -ga x722 00:26:30.468 04:23:43 -- nvmf/common.sh@297 -- # mlx=() 00:26:30.468 04:23:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:30.468 04:23:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:30.468 04:23:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:30.468 04:23:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:30.468 04:23:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:30.468 04:23:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:30.468 04:23:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:26:30.468 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:26:30.468 04:23:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:30.468 04:23:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:26:30.468 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:26:30.468 04:23:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:30.468 04:23:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:30.468 04:23:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:30.468 04:23:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:30.468 04:23:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:30.468 04:23:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:26:30.468 Found net devices under 0000:4b:00.0: cvl_0_0 00:26:30.468 04:23:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:30.468 04:23:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:30.468 04:23:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:30.468 04:23:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:30.468 04:23:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:30.468 04:23:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:26:30.468 Found net devices under 0000:4b:00.1: cvl_0_1 00:26:30.468 04:23:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:30.468 04:23:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:30.468 04:23:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:30.468 04:23:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:30.468 04:23:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:30.468 04:23:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:30.468 04:23:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:30.468 04:23:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:30.468 04:23:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:30.468 04:23:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:30.468 04:23:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:30.468 04:23:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:30.468 04:23:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:30.468 04:23:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:30.468 04:23:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:30.468 04:23:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:30.468 04:23:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:30.468 04:23:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:30.468 04:23:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:30.468 04:23:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:30.468 04:23:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:30.468 04:23:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:30.468 04:23:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:30.468 04:23:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:30.468 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:30.468 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.672 ms 00:26:30.468 00:26:30.468 --- 10.0.0.2 ping statistics --- 00:26:30.468 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:30.468 rtt min/avg/max/mdev = 0.672/0.672/0.672/0.000 ms 00:26:30.468 04:23:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:30.468 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:30.468 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.504 ms 00:26:30.468 00:26:30.468 --- 10.0.0.1 ping statistics --- 00:26:30.468 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:30.468 rtt min/avg/max/mdev = 0.504/0.504/0.504/0.000 ms 00:26:30.468 04:23:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:30.468 04:23:43 -- nvmf/common.sh@410 -- # return 0 00:26:30.468 04:23:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:30.468 04:23:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:30.468 04:23:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:30.468 04:23:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:30.468 04:23:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:30.468 04:23:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:30.468 04:23:43 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:26:30.468 04:23:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:30.468 04:23:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:30.468 04:23:43 -- common/autotest_common.sh@10 -- # set +x 00:26:30.468 04:23:43 -- nvmf/common.sh@469 -- # nvmfpid=4069699 00:26:30.468 04:23:43 -- nvmf/common.sh@470 -- # waitforlisten 4069699 00:26:30.468 04:23:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:26:30.468 04:23:43 -- common/autotest_common.sh@819 -- # '[' -z 4069699 ']' 00:26:30.468 04:23:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:30.468 04:23:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:30.468 04:23:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:30.468 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:30.468 04:23:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:30.468 04:23:43 -- common/autotest_common.sh@10 -- # set +x 00:26:30.468 [2024-05-14 04:23:44.040987] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:26:30.468 [2024-05-14 04:23:44.041051] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:30.468 EAL: No free 2048 kB hugepages reported on node 1 00:26:30.468 [2024-05-14 04:23:44.110560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:30.468 [2024-05-14 04:23:44.182464] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:30.468 [2024-05-14 04:23:44.182587] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:30.468 [2024-05-14 04:23:44.182595] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:30.468 [2024-05-14 04:23:44.182602] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:30.468 [2024-05-14 04:23:44.182618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:30.468 04:23:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:30.469 04:23:44 -- common/autotest_common.sh@852 -- # return 0 00:26:30.469 04:23:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:30.469 04:23:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:30.469 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.469 04:23:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:30.469 04:23:44 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:30.469 04:23:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.469 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.469 [2024-05-14 04:23:44.849577] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:30.469 04:23:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.469 04:23:44 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:26:30.469 04:23:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.469 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.469 null0 00:26:30.469 04:23:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.469 04:23:44 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:26:30.469 04:23:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.469 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.469 04:23:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.469 04:23:44 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:26:30.469 04:23:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.469 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.469 04:23:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.469 04:23:44 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g c25cbdbdd6ef441fb626d0d85f4d40a2 00:26:30.469 04:23:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.469 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.469 04:23:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.469 04:23:44 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:30.469 04:23:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.469 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.469 [2024-05-14 04:23:44.905818] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:30.469 04:23:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.469 04:23:44 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:26:30.469 04:23:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.469 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:26:30.730 nvme0n1 00:26:30.730 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.730 04:23:45 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:30.730 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.730 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.730 [ 00:26:30.730 { 00:26:30.730 "name": "nvme0n1", 00:26:30.730 "aliases": [ 00:26:30.730 "c25cbdbd-d6ef-441f-b626-d0d85f4d40a2" 00:26:30.730 ], 00:26:30.730 "product_name": "NVMe disk", 00:26:30.730 "block_size": 512, 00:26:30.730 "num_blocks": 2097152, 00:26:30.730 "uuid": "c25cbdbd-d6ef-441f-b626-d0d85f4d40a2", 00:26:30.730 "assigned_rate_limits": { 00:26:30.730 "rw_ios_per_sec": 0, 00:26:30.730 "rw_mbytes_per_sec": 0, 00:26:30.730 "r_mbytes_per_sec": 0, 00:26:30.730 "w_mbytes_per_sec": 0 00:26:30.730 }, 00:26:30.730 "claimed": false, 00:26:30.730 "zoned": false, 00:26:30.730 "supported_io_types": { 00:26:30.730 "read": true, 00:26:30.730 "write": true, 00:26:30.730 "unmap": false, 00:26:30.730 "write_zeroes": true, 00:26:30.730 "flush": true, 00:26:30.730 "reset": true, 00:26:30.730 "compare": true, 00:26:30.730 "compare_and_write": true, 00:26:30.730 "abort": true, 00:26:30.730 "nvme_admin": true, 00:26:30.730 "nvme_io": true 00:26:30.730 }, 00:26:30.730 "driver_specific": { 00:26:30.730 "nvme": [ 00:26:30.730 { 00:26:30.730 "trid": { 00:26:30.730 "trtype": "TCP", 00:26:30.730 "adrfam": "IPv4", 00:26:30.730 "traddr": "10.0.0.2", 00:26:30.730 "trsvcid": "4420", 00:26:30.730 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:30.730 }, 00:26:30.730 "ctrlr_data": { 00:26:30.730 "cntlid": 1, 00:26:30.730 "vendor_id": "0x8086", 00:26:30.730 "model_number": "SPDK bdev Controller", 00:26:30.730 "serial_number": "00000000000000000000", 00:26:30.730 "firmware_revision": "24.01.1", 00:26:30.730 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:30.730 "oacs": { 00:26:30.730 "security": 0, 00:26:30.730 "format": 0, 00:26:30.730 "firmware": 0, 00:26:30.730 "ns_manage": 0 00:26:30.730 }, 00:26:30.730 "multi_ctrlr": true, 00:26:30.730 "ana_reporting": false 00:26:30.730 }, 00:26:30.730 "vs": { 00:26:30.730 "nvme_version": "1.3" 00:26:30.730 }, 00:26:30.730 "ns_data": { 00:26:30.730 "id": 1, 00:26:30.730 "can_share": true 00:26:30.730 } 00:26:30.730 } 00:26:30.730 ], 00:26:30.730 "mp_policy": "active_passive" 00:26:30.730 } 00:26:30.730 } 00:26:30.730 ] 00:26:30.730 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.730 04:23:45 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:26:30.730 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.730 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.730 [2024-05-14 04:23:45.170391] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:30.730 [2024-05-14 04:23:45.170451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x202bdb0 (9): Bad file descriptor 00:26:30.730 [2024-05-14 04:23:45.302384] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:30.730 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.730 04:23:45 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:30.730 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.730 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.730 [ 00:26:30.730 { 00:26:30.730 "name": "nvme0n1", 00:26:30.730 "aliases": [ 00:26:30.730 "c25cbdbd-d6ef-441f-b626-d0d85f4d40a2" 00:26:30.730 ], 00:26:30.730 "product_name": "NVMe disk", 00:26:30.730 "block_size": 512, 00:26:30.730 "num_blocks": 2097152, 00:26:30.730 "uuid": "c25cbdbd-d6ef-441f-b626-d0d85f4d40a2", 00:26:30.730 "assigned_rate_limits": { 00:26:30.730 "rw_ios_per_sec": 0, 00:26:30.730 "rw_mbytes_per_sec": 0, 00:26:30.730 "r_mbytes_per_sec": 0, 00:26:30.730 "w_mbytes_per_sec": 0 00:26:30.730 }, 00:26:30.730 "claimed": false, 00:26:30.730 "zoned": false, 00:26:30.730 "supported_io_types": { 00:26:30.730 "read": true, 00:26:30.730 "write": true, 00:26:30.730 "unmap": false, 00:26:30.730 "write_zeroes": true, 00:26:30.730 "flush": true, 00:26:30.730 "reset": true, 00:26:30.730 "compare": true, 00:26:30.730 "compare_and_write": true, 00:26:30.730 "abort": true, 00:26:30.730 "nvme_admin": true, 00:26:30.730 "nvme_io": true 00:26:30.730 }, 00:26:30.730 "driver_specific": { 00:26:30.730 "nvme": [ 00:26:30.730 { 00:26:30.730 "trid": { 00:26:30.730 "trtype": "TCP", 00:26:30.730 "adrfam": "IPv4", 00:26:30.730 "traddr": "10.0.0.2", 00:26:30.730 "trsvcid": "4420", 00:26:30.730 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:30.730 }, 00:26:30.730 "ctrlr_data": { 00:26:30.730 "cntlid": 2, 00:26:30.730 "vendor_id": "0x8086", 00:26:30.730 "model_number": "SPDK bdev Controller", 00:26:30.730 "serial_number": "00000000000000000000", 00:26:30.730 "firmware_revision": "24.01.1", 00:26:30.991 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:30.991 "oacs": { 00:26:30.991 "security": 0, 00:26:30.991 "format": 0, 00:26:30.991 "firmware": 0, 00:26:30.991 "ns_manage": 0 00:26:30.991 }, 00:26:30.991 "multi_ctrlr": true, 00:26:30.991 "ana_reporting": false 00:26:30.991 }, 00:26:30.991 "vs": { 00:26:30.991 "nvme_version": "1.3" 00:26:30.991 }, 00:26:30.991 "ns_data": { 00:26:30.991 "id": 1, 00:26:30.991 "can_share": true 00:26:30.991 } 00:26:30.991 } 00:26:30.991 ], 00:26:30.991 "mp_policy": "active_passive" 00:26:30.991 } 00:26:30.991 } 00:26:30.991 ] 00:26:30.991 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.991 04:23:45 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:30.991 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.991 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.991 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.991 04:23:45 -- host/async_init.sh@53 -- # mktemp 00:26:30.991 04:23:45 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.Q8PNljIMn4 00:26:30.991 04:23:45 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:26:30.991 04:23:45 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.Q8PNljIMn4 00:26:30.991 04:23:45 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:26:30.991 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.991 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.991 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.991 04:23:45 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:26:30.992 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.992 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.992 [2024-05-14 04:23:45.367027] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:26:30.992 [2024-05-14 04:23:45.367140] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:30.992 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.992 04:23:45 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Q8PNljIMn4 00:26:30.992 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.992 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.992 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.992 04:23:45 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Q8PNljIMn4 00:26:30.992 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.992 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.992 [2024-05-14 04:23:45.391091] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:26:30.992 nvme0n1 00:26:30.992 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.992 04:23:45 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:30.992 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.992 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.992 [ 00:26:30.992 { 00:26:30.992 "name": "nvme0n1", 00:26:30.992 "aliases": [ 00:26:30.992 "c25cbdbd-d6ef-441f-b626-d0d85f4d40a2" 00:26:30.992 ], 00:26:30.992 "product_name": "NVMe disk", 00:26:30.992 "block_size": 512, 00:26:30.992 "num_blocks": 2097152, 00:26:30.992 "uuid": "c25cbdbd-d6ef-441f-b626-d0d85f4d40a2", 00:26:30.992 "assigned_rate_limits": { 00:26:30.992 "rw_ios_per_sec": 0, 00:26:30.992 "rw_mbytes_per_sec": 0, 00:26:30.992 "r_mbytes_per_sec": 0, 00:26:30.992 "w_mbytes_per_sec": 0 00:26:30.992 }, 00:26:30.992 "claimed": false, 00:26:30.992 "zoned": false, 00:26:30.992 "supported_io_types": { 00:26:30.992 "read": true, 00:26:30.992 "write": true, 00:26:30.992 "unmap": false, 00:26:30.992 "write_zeroes": true, 00:26:30.992 "flush": true, 00:26:30.992 "reset": true, 00:26:30.992 "compare": true, 00:26:30.992 "compare_and_write": true, 00:26:30.992 "abort": true, 00:26:30.992 "nvme_admin": true, 00:26:30.992 "nvme_io": true 00:26:30.992 }, 00:26:30.992 "driver_specific": { 00:26:30.992 "nvme": [ 00:26:30.992 { 00:26:30.992 "trid": { 00:26:30.992 "trtype": "TCP", 00:26:30.992 "adrfam": "IPv4", 00:26:30.992 "traddr": "10.0.0.2", 00:26:30.992 "trsvcid": "4421", 00:26:30.992 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:30.992 }, 00:26:30.992 "ctrlr_data": { 00:26:30.992 "cntlid": 3, 00:26:30.992 "vendor_id": "0x8086", 00:26:30.992 "model_number": "SPDK bdev Controller", 00:26:30.992 "serial_number": "00000000000000000000", 00:26:30.992 "firmware_revision": "24.01.1", 00:26:30.992 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:30.992 "oacs": { 00:26:30.992 "security": 0, 00:26:30.992 "format": 0, 00:26:30.992 "firmware": 0, 00:26:30.992 "ns_manage": 0 00:26:30.992 }, 00:26:30.992 "multi_ctrlr": true, 00:26:30.992 "ana_reporting": false 00:26:30.992 }, 00:26:30.992 "vs": { 00:26:30.992 "nvme_version": "1.3" 00:26:30.992 }, 00:26:30.992 "ns_data": { 00:26:30.992 "id": 1, 00:26:30.992 "can_share": true 00:26:30.992 } 00:26:30.992 } 00:26:30.992 ], 00:26:30.992 "mp_policy": "active_passive" 00:26:30.992 } 00:26:30.992 } 00:26:30.992 ] 00:26:30.992 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.992 04:23:45 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:30.992 04:23:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.992 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:26:30.992 04:23:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.992 04:23:45 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.Q8PNljIMn4 00:26:30.992 04:23:45 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:26:30.992 04:23:45 -- host/async_init.sh@78 -- # nvmftestfini 00:26:30.992 04:23:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:30.992 04:23:45 -- nvmf/common.sh@116 -- # sync 00:26:30.992 04:23:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:30.992 04:23:45 -- nvmf/common.sh@119 -- # set +e 00:26:30.992 04:23:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:30.992 04:23:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:30.992 rmmod nvme_tcp 00:26:30.992 rmmod nvme_fabrics 00:26:30.992 rmmod nvme_keyring 00:26:30.992 04:23:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:30.992 04:23:45 -- nvmf/common.sh@123 -- # set -e 00:26:30.992 04:23:45 -- nvmf/common.sh@124 -- # return 0 00:26:30.992 04:23:45 -- nvmf/common.sh@477 -- # '[' -n 4069699 ']' 00:26:30.992 04:23:45 -- nvmf/common.sh@478 -- # killprocess 4069699 00:26:30.992 04:23:45 -- common/autotest_common.sh@926 -- # '[' -z 4069699 ']' 00:26:30.992 04:23:45 -- common/autotest_common.sh@930 -- # kill -0 4069699 00:26:30.992 04:23:45 -- common/autotest_common.sh@931 -- # uname 00:26:30.992 04:23:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:30.992 04:23:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4069699 00:26:31.253 04:23:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:31.253 04:23:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:31.253 04:23:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4069699' 00:26:31.253 killing process with pid 4069699 00:26:31.253 04:23:45 -- common/autotest_common.sh@945 -- # kill 4069699 00:26:31.253 04:23:45 -- common/autotest_common.sh@950 -- # wait 4069699 00:26:31.253 04:23:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:31.253 04:23:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:31.253 04:23:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:31.253 04:23:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:31.253 04:23:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:31.253 04:23:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:31.253 04:23:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:31.253 04:23:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:33.801 04:23:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:33.801 00:26:33.801 real 0m11.134s 00:26:33.801 user 0m3.964s 00:26:33.801 sys 0m5.612s 00:26:33.801 04:23:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:33.801 04:23:47 -- common/autotest_common.sh@10 -- # set +x 00:26:33.801 ************************************ 00:26:33.801 END TEST nvmf_async_init 00:26:33.801 ************************************ 00:26:33.801 04:23:47 -- nvmf/nvmf.sh@93 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:33.801 04:23:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:33.801 04:23:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:33.801 04:23:47 -- common/autotest_common.sh@10 -- # set +x 00:26:33.801 ************************************ 00:26:33.801 START TEST dma 00:26:33.801 ************************************ 00:26:33.801 04:23:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:33.801 * Looking for test storage... 00:26:33.801 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:33.801 04:23:47 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:33.801 04:23:47 -- nvmf/common.sh@7 -- # uname -s 00:26:33.801 04:23:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:33.801 04:23:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:33.801 04:23:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:33.801 04:23:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:33.802 04:23:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:33.802 04:23:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:33.802 04:23:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:33.802 04:23:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:33.802 04:23:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:33.802 04:23:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:33.802 04:23:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:33.802 04:23:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:33.802 04:23:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:33.802 04:23:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:33.802 04:23:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:33.802 04:23:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:33.802 04:23:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:33.802 04:23:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:33.802 04:23:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:33.802 04:23:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.802 04:23:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.802 04:23:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.802 04:23:47 -- paths/export.sh@5 -- # export PATH 00:26:33.802 04:23:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.802 04:23:47 -- nvmf/common.sh@46 -- # : 0 00:26:33.802 04:23:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:33.802 04:23:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:33.802 04:23:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:33.802 04:23:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:33.802 04:23:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:33.802 04:23:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:33.802 04:23:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:33.802 04:23:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:33.802 04:23:47 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:33.802 04:23:47 -- host/dma.sh@13 -- # exit 0 00:26:33.802 00:26:33.802 real 0m0.127s 00:26:33.802 user 0m0.058s 00:26:33.802 sys 0m0.077s 00:26:33.802 04:23:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:33.802 04:23:47 -- common/autotest_common.sh@10 -- # set +x 00:26:33.802 ************************************ 00:26:33.802 END TEST dma 00:26:33.802 ************************************ 00:26:33.802 04:23:48 -- nvmf/nvmf.sh@96 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:33.802 04:23:48 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:33.802 04:23:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:33.802 04:23:48 -- common/autotest_common.sh@10 -- # set +x 00:26:33.802 ************************************ 00:26:33.802 START TEST nvmf_identify 00:26:33.802 ************************************ 00:26:33.802 04:23:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:33.802 * Looking for test storage... 00:26:33.802 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:33.802 04:23:48 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:33.802 04:23:48 -- nvmf/common.sh@7 -- # uname -s 00:26:33.802 04:23:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:33.802 04:23:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:33.802 04:23:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:33.802 04:23:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:33.802 04:23:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:33.802 04:23:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:33.802 04:23:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:33.802 04:23:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:33.802 04:23:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:33.802 04:23:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:33.802 04:23:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:33.802 04:23:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:33.802 04:23:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:33.802 04:23:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:33.802 04:23:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:33.802 04:23:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:33.802 04:23:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:33.802 04:23:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:33.802 04:23:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:33.802 04:23:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.802 04:23:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.802 04:23:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.802 04:23:48 -- paths/export.sh@5 -- # export PATH 00:26:33.802 04:23:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:33.802 04:23:48 -- nvmf/common.sh@46 -- # : 0 00:26:33.802 04:23:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:33.802 04:23:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:33.802 04:23:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:33.802 04:23:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:33.802 04:23:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:33.802 04:23:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:33.802 04:23:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:33.802 04:23:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:33.802 04:23:48 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:33.802 04:23:48 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:33.802 04:23:48 -- host/identify.sh@14 -- # nvmftestinit 00:26:33.802 04:23:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:33.802 04:23:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:33.802 04:23:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:33.802 04:23:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:33.802 04:23:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:33.802 04:23:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:33.802 04:23:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:33.802 04:23:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:33.802 04:23:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:33.802 04:23:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:33.802 04:23:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:33.802 04:23:48 -- common/autotest_common.sh@10 -- # set +x 00:26:40.408 04:23:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:40.408 04:23:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:40.408 04:23:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:40.408 04:23:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:40.408 04:23:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:40.408 04:23:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:40.408 04:23:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:40.408 04:23:54 -- nvmf/common.sh@294 -- # net_devs=() 00:26:40.408 04:23:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:40.408 04:23:54 -- nvmf/common.sh@295 -- # e810=() 00:26:40.408 04:23:54 -- nvmf/common.sh@295 -- # local -ga e810 00:26:40.408 04:23:54 -- nvmf/common.sh@296 -- # x722=() 00:26:40.408 04:23:54 -- nvmf/common.sh@296 -- # local -ga x722 00:26:40.408 04:23:54 -- nvmf/common.sh@297 -- # mlx=() 00:26:40.408 04:23:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:40.408 04:23:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:40.408 04:23:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:40.408 04:23:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:40.408 04:23:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:40.408 04:23:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:40.408 04:23:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:26:40.408 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:26:40.408 04:23:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:40.408 04:23:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:26:40.408 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:26:40.408 04:23:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:40.408 04:23:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:40.408 04:23:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:40.408 04:23:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:40.408 04:23:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:40.408 04:23:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:26:40.408 Found net devices under 0000:4b:00.0: cvl_0_0 00:26:40.408 04:23:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:40.408 04:23:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:40.408 04:23:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:40.408 04:23:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:40.408 04:23:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:40.408 04:23:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:26:40.408 Found net devices under 0000:4b:00.1: cvl_0_1 00:26:40.408 04:23:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:40.408 04:23:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:40.408 04:23:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:40.408 04:23:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:40.408 04:23:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:40.408 04:23:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:40.408 04:23:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:40.408 04:23:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:40.408 04:23:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:40.408 04:23:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:40.408 04:23:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:40.408 04:23:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:40.408 04:23:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:40.408 04:23:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:40.408 04:23:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:40.408 04:23:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:40.408 04:23:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:40.408 04:23:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:40.670 04:23:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:40.670 04:23:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:40.670 04:23:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:40.670 04:23:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:40.670 04:23:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:40.670 04:23:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:40.670 04:23:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:40.670 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:40.670 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.702 ms 00:26:40.670 00:26:40.670 --- 10.0.0.2 ping statistics --- 00:26:40.670 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:40.670 rtt min/avg/max/mdev = 0.702/0.702/0.702/0.000 ms 00:26:40.670 04:23:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:40.670 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:40.670 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.424 ms 00:26:40.670 00:26:40.670 --- 10.0.0.1 ping statistics --- 00:26:40.670 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:40.670 rtt min/avg/max/mdev = 0.424/0.424/0.424/0.000 ms 00:26:40.670 04:23:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:40.670 04:23:55 -- nvmf/common.sh@410 -- # return 0 00:26:40.670 04:23:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:40.670 04:23:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:40.670 04:23:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:40.670 04:23:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:40.670 04:23:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:40.670 04:23:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:40.670 04:23:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:40.670 04:23:55 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:40.670 04:23:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:40.670 04:23:55 -- common/autotest_common.sh@10 -- # set +x 00:26:40.670 04:23:55 -- host/identify.sh@19 -- # nvmfpid=4074113 00:26:40.671 04:23:55 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:40.671 04:23:55 -- host/identify.sh@23 -- # waitforlisten 4074113 00:26:40.671 04:23:55 -- common/autotest_common.sh@819 -- # '[' -z 4074113 ']' 00:26:40.671 04:23:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:40.671 04:23:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:40.671 04:23:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:40.671 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:40.671 04:23:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:40.671 04:23:55 -- common/autotest_common.sh@10 -- # set +x 00:26:40.671 04:23:55 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:40.932 [2024-05-14 04:23:55.268084] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:26:40.932 [2024-05-14 04:23:55.268150] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:40.932 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.932 [2024-05-14 04:23:55.339363] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:40.932 [2024-05-14 04:23:55.414822] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:40.932 [2024-05-14 04:23:55.414959] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:40.932 [2024-05-14 04:23:55.414969] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:40.932 [2024-05-14 04:23:55.414977] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:40.932 [2024-05-14 04:23:55.415117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:40.932 [2024-05-14 04:23:55.415220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:40.932 [2024-05-14 04:23:55.415366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:40.932 [2024-05-14 04:23:55.415366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:41.505 04:23:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:41.505 04:23:56 -- common/autotest_common.sh@852 -- # return 0 00:26:41.505 04:23:56 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:41.505 04:23:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.505 04:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:41.505 [2024-05-14 04:23:56.048328] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:41.505 04:23:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.505 04:23:56 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:41.505 04:23:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:41.505 04:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:41.768 04:23:56 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:41.768 04:23:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.768 04:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:41.768 Malloc0 00:26:41.768 04:23:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.768 04:23:56 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:41.768 04:23:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.768 04:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:41.768 04:23:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.768 04:23:56 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:41.768 04:23:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.768 04:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:41.768 04:23:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.768 04:23:56 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:41.768 04:23:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.768 04:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:41.768 [2024-05-14 04:23:56.143785] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:41.768 04:23:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.768 04:23:56 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:41.768 04:23:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.768 04:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:41.768 04:23:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.768 04:23:56 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:41.768 04:23:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.768 04:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:41.768 [2024-05-14 04:23:56.167636] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:41.768 [ 00:26:41.768 { 00:26:41.768 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:41.768 "subtype": "Discovery", 00:26:41.768 "listen_addresses": [ 00:26:41.768 { 00:26:41.768 "transport": "TCP", 00:26:41.768 "trtype": "TCP", 00:26:41.768 "adrfam": "IPv4", 00:26:41.768 "traddr": "10.0.0.2", 00:26:41.768 "trsvcid": "4420" 00:26:41.768 } 00:26:41.768 ], 00:26:41.768 "allow_any_host": true, 00:26:41.768 "hosts": [] 00:26:41.768 }, 00:26:41.768 { 00:26:41.768 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:41.768 "subtype": "NVMe", 00:26:41.768 "listen_addresses": [ 00:26:41.768 { 00:26:41.768 "transport": "TCP", 00:26:41.768 "trtype": "TCP", 00:26:41.768 "adrfam": "IPv4", 00:26:41.768 "traddr": "10.0.0.2", 00:26:41.768 "trsvcid": "4420" 00:26:41.768 } 00:26:41.768 ], 00:26:41.768 "allow_any_host": true, 00:26:41.768 "hosts": [], 00:26:41.768 "serial_number": "SPDK00000000000001", 00:26:41.768 "model_number": "SPDK bdev Controller", 00:26:41.768 "max_namespaces": 32, 00:26:41.768 "min_cntlid": 1, 00:26:41.768 "max_cntlid": 65519, 00:26:41.768 "namespaces": [ 00:26:41.768 { 00:26:41.768 "nsid": 1, 00:26:41.768 "bdev_name": "Malloc0", 00:26:41.768 "name": "Malloc0", 00:26:41.768 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:41.768 "eui64": "ABCDEF0123456789", 00:26:41.768 "uuid": "a5128f9d-0a7c-4905-8840-d191af422ef7" 00:26:41.768 } 00:26:41.768 ] 00:26:41.768 } 00:26:41.768 ] 00:26:41.768 04:23:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.768 04:23:56 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:41.768 [2024-05-14 04:23:56.205034] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:26:41.768 [2024-05-14 04:23:56.205075] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4074464 ] 00:26:41.768 EAL: No free 2048 kB hugepages reported on node 1 00:26:41.768 [2024-05-14 04:23:56.237949] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:41.768 [2024-05-14 04:23:56.237998] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:41.768 [2024-05-14 04:23:56.238003] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:41.768 [2024-05-14 04:23:56.238014] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:41.768 [2024-05-14 04:23:56.238022] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:41.768 [2024-05-14 04:23:56.241322] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:41.768 [2024-05-14 04:23:56.241357] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x5cb9e0 0 00:26:41.768 [2024-05-14 04:23:56.249299] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:41.768 [2024-05-14 04:23:56.249314] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:41.768 [2024-05-14 04:23:56.249319] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:41.768 [2024-05-14 04:23:56.249322] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:41.768 [2024-05-14 04:23:56.249360] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.249366] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.249371] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.768 [2024-05-14 04:23:56.249385] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:41.768 [2024-05-14 04:23:56.249402] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.768 [2024-05-14 04:23:56.256301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.768 [2024-05-14 04:23:56.256310] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.768 [2024-05-14 04:23:56.256314] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.256318] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633730) on tqpair=0x5cb9e0 00:26:41.768 [2024-05-14 04:23:56.256331] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:41.768 [2024-05-14 04:23:56.256337] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:41.768 [2024-05-14 04:23:56.256343] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:41.768 [2024-05-14 04:23:56.256358] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.256362] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.256365] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.768 [2024-05-14 04:23:56.256373] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.768 [2024-05-14 04:23:56.256385] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.768 [2024-05-14 04:23:56.256616] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.768 [2024-05-14 04:23:56.256625] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.768 [2024-05-14 04:23:56.256628] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.256632] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633730) on tqpair=0x5cb9e0 00:26:41.768 [2024-05-14 04:23:56.256646] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:41.768 [2024-05-14 04:23:56.256654] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:41.768 [2024-05-14 04:23:56.256662] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.256665] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.256669] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.768 [2024-05-14 04:23:56.256676] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.768 [2024-05-14 04:23:56.256688] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.768 [2024-05-14 04:23:56.256825] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.768 [2024-05-14 04:23:56.256832] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.768 [2024-05-14 04:23:56.256835] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.256839] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633730) on tqpair=0x5cb9e0 00:26:41.768 [2024-05-14 04:23:56.256845] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:41.768 [2024-05-14 04:23:56.256853] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:41.768 [2024-05-14 04:23:56.256860] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.256863] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.256867] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.768 [2024-05-14 04:23:56.256874] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.768 [2024-05-14 04:23:56.256885] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.768 [2024-05-14 04:23:56.257083] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.768 [2024-05-14 04:23:56.257089] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.768 [2024-05-14 04:23:56.257093] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.257096] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633730) on tqpair=0x5cb9e0 00:26:41.768 [2024-05-14 04:23:56.257101] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:41.768 [2024-05-14 04:23:56.257110] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.257114] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.768 [2024-05-14 04:23:56.257117] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.257124] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.769 [2024-05-14 04:23:56.257134] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.769 [2024-05-14 04:23:56.257326] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.769 [2024-05-14 04:23:56.257334] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.769 [2024-05-14 04:23:56.257337] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.257341] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633730) on tqpair=0x5cb9e0 00:26:41.769 [2024-05-14 04:23:56.257346] nvme_ctrlr.c:3736:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:41.769 [2024-05-14 04:23:56.257354] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:41.769 [2024-05-14 04:23:56.257361] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:41.769 [2024-05-14 04:23:56.257467] nvme_ctrlr.c:3929:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:41.769 [2024-05-14 04:23:56.257472] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:41.769 [2024-05-14 04:23:56.257481] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.257484] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.257488] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.257495] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.769 [2024-05-14 04:23:56.257507] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.769 [2024-05-14 04:23:56.257790] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.769 [2024-05-14 04:23:56.257796] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.769 [2024-05-14 04:23:56.257799] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.257803] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633730) on tqpair=0x5cb9e0 00:26:41.769 [2024-05-14 04:23:56.257808] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:41.769 [2024-05-14 04:23:56.257817] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.257821] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.257824] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.257831] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.769 [2024-05-14 04:23:56.257841] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.769 [2024-05-14 04:23:56.258014] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.769 [2024-05-14 04:23:56.258020] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.769 [2024-05-14 04:23:56.258023] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.258027] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633730) on tqpair=0x5cb9e0 00:26:41.769 [2024-05-14 04:23:56.258032] nvme_ctrlr.c:3771:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:41.769 [2024-05-14 04:23:56.258036] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:41.769 [2024-05-14 04:23:56.258044] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:41.769 [2024-05-14 04:23:56.258052] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:41.769 [2024-05-14 04:23:56.258061] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.258065] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.258068] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.258075] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.769 [2024-05-14 04:23:56.258089] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.769 [2024-05-14 04:23:56.258260] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:41.769 [2024-05-14 04:23:56.258267] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:41.769 [2024-05-14 04:23:56.258271] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.258275] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5cb9e0): datao=0, datal=4096, cccid=0 00:26:41.769 [2024-05-14 04:23:56.258280] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x633730) on tqpair(0x5cb9e0): expected_datao=0, payload_size=4096 00:26:41.769 [2024-05-14 04:23:56.258361] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.258367] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301299] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.769 [2024-05-14 04:23:56.301311] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.769 [2024-05-14 04:23:56.301315] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301319] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633730) on tqpair=0x5cb9e0 00:26:41.769 [2024-05-14 04:23:56.301328] nvme_ctrlr.c:1971:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:41.769 [2024-05-14 04:23:56.301337] nvme_ctrlr.c:1975:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:41.769 [2024-05-14 04:23:56.301341] nvme_ctrlr.c:1978:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:41.769 [2024-05-14 04:23:56.301346] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:41.769 [2024-05-14 04:23:56.301351] nvme_ctrlr.c:2017:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:41.769 [2024-05-14 04:23:56.301356] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:41.769 [2024-05-14 04:23:56.301364] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:41.769 [2024-05-14 04:23:56.301371] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301375] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301379] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.301386] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:41.769 [2024-05-14 04:23:56.301399] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.769 [2024-05-14 04:23:56.301649] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.769 [2024-05-14 04:23:56.301657] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.769 [2024-05-14 04:23:56.301660] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301664] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633730) on tqpair=0x5cb9e0 00:26:41.769 [2024-05-14 04:23:56.301672] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301676] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301680] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.301686] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:41.769 [2024-05-14 04:23:56.301692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301696] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301699] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.301708] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:41.769 [2024-05-14 04:23:56.301714] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301718] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301721] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.301727] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:41.769 [2024-05-14 04:23:56.301733] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301736] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301740] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.301745] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:41.769 [2024-05-14 04:23:56.301750] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:41.769 [2024-05-14 04:23:56.301761] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:41.769 [2024-05-14 04:23:56.301767] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301771] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.301774] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5cb9e0) 00:26:41.769 [2024-05-14 04:23:56.301781] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.769 [2024-05-14 04:23:56.301794] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633730, cid 0, qid 0 00:26:41.769 [2024-05-14 04:23:56.301799] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633890, cid 1, qid 0 00:26:41.769 [2024-05-14 04:23:56.301804] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6339f0, cid 2, qid 0 00:26:41.769 [2024-05-14 04:23:56.301808] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:41.769 [2024-05-14 04:23:56.301813] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633cb0, cid 4, qid 0 00:26:41.769 [2024-05-14 04:23:56.302102] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.769 [2024-05-14 04:23:56.302109] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.769 [2024-05-14 04:23:56.302112] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.769 [2024-05-14 04:23:56.302116] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633cb0) on tqpair=0x5cb9e0 00:26:41.770 [2024-05-14 04:23:56.302121] nvme_ctrlr.c:2889:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:41.770 [2024-05-14 04:23:56.302126] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:41.770 [2024-05-14 04:23:56.302137] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302141] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302145] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5cb9e0) 00:26:41.770 [2024-05-14 04:23:56.302151] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.770 [2024-05-14 04:23:56.302162] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633cb0, cid 4, qid 0 00:26:41.770 [2024-05-14 04:23:56.302510] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:41.770 [2024-05-14 04:23:56.302519] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:41.770 [2024-05-14 04:23:56.302525] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302530] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5cb9e0): datao=0, datal=4096, cccid=4 00:26:41.770 [2024-05-14 04:23:56.302534] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x633cb0) on tqpair(0x5cb9e0): expected_datao=0, payload_size=4096 00:26:41.770 [2024-05-14 04:23:56.302542] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302546] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302639] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.770 [2024-05-14 04:23:56.302646] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.770 [2024-05-14 04:23:56.302649] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302653] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633cb0) on tqpair=0x5cb9e0 00:26:41.770 [2024-05-14 04:23:56.302666] nvme_ctrlr.c:4023:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:41.770 [2024-05-14 04:23:56.302686] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302691] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302694] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5cb9e0) 00:26:41.770 [2024-05-14 04:23:56.302701] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.770 [2024-05-14 04:23:56.302709] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302712] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.302716] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x5cb9e0) 00:26:41.770 [2024-05-14 04:23:56.302722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:41.770 [2024-05-14 04:23:56.302739] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633cb0, cid 4, qid 0 00:26:41.770 [2024-05-14 04:23:56.302744] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633e10, cid 5, qid 0 00:26:41.770 [2024-05-14 04:23:56.303002] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:41.770 [2024-05-14 04:23:56.303009] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:41.770 [2024-05-14 04:23:56.303012] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.303016] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5cb9e0): datao=0, datal=1024, cccid=4 00:26:41.770 [2024-05-14 04:23:56.303020] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x633cb0) on tqpair(0x5cb9e0): expected_datao=0, payload_size=1024 00:26:41.770 [2024-05-14 04:23:56.303027] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.303031] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.303037] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.770 [2024-05-14 04:23:56.303043] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.770 [2024-05-14 04:23:56.303046] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.303050] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633e10) on tqpair=0x5cb9e0 00:26:41.770 [2024-05-14 04:23:56.343534] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.770 [2024-05-14 04:23:56.343545] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.770 [2024-05-14 04:23:56.343549] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.343553] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633cb0) on tqpair=0x5cb9e0 00:26:41.770 [2024-05-14 04:23:56.343565] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.343575] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.343579] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5cb9e0) 00:26:41.770 [2024-05-14 04:23:56.343586] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.770 [2024-05-14 04:23:56.343601] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633cb0, cid 4, qid 0 00:26:41.770 [2024-05-14 04:23:56.343844] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:41.770 [2024-05-14 04:23:56.343851] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:41.770 [2024-05-14 04:23:56.343855] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.343858] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5cb9e0): datao=0, datal=3072, cccid=4 00:26:41.770 [2024-05-14 04:23:56.343863] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x633cb0) on tqpair(0x5cb9e0): expected_datao=0, payload_size=3072 00:26:41.770 [2024-05-14 04:23:56.343870] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.343874] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.344019] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:41.770 [2024-05-14 04:23:56.344025] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:41.770 [2024-05-14 04:23:56.344029] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.344033] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633cb0) on tqpair=0x5cb9e0 00:26:41.770 [2024-05-14 04:23:56.344041] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.344045] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.344048] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5cb9e0) 00:26:41.770 [2024-05-14 04:23:56.344055] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.770 [2024-05-14 04:23:56.344069] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633cb0, cid 4, qid 0 00:26:41.770 [2024-05-14 04:23:56.347299] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:41.770 [2024-05-14 04:23:56.347307] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:41.770 [2024-05-14 04:23:56.347311] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.347314] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5cb9e0): datao=0, datal=8, cccid=4 00:26:41.770 [2024-05-14 04:23:56.347318] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x633cb0) on tqpair(0x5cb9e0): expected_datao=0, payload_size=8 00:26:41.770 [2024-05-14 04:23:56.347326] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:41.770 [2024-05-14 04:23:56.347329] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:42.036 [2024-05-14 04:23:56.386299] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.036 [2024-05-14 04:23:56.386308] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.036 [2024-05-14 04:23:56.386312] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.036 [2024-05-14 04:23:56.386316] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633cb0) on tqpair=0x5cb9e0 00:26:42.036 ===================================================== 00:26:42.036 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:42.036 ===================================================== 00:26:42.036 Controller Capabilities/Features 00:26:42.036 ================================ 00:26:42.036 Vendor ID: 0000 00:26:42.036 Subsystem Vendor ID: 0000 00:26:42.036 Serial Number: .................... 00:26:42.036 Model Number: ........................................ 00:26:42.036 Firmware Version: 24.01.1 00:26:42.036 Recommended Arb Burst: 0 00:26:42.036 IEEE OUI Identifier: 00 00 00 00:26:42.036 Multi-path I/O 00:26:42.036 May have multiple subsystem ports: No 00:26:42.036 May have multiple controllers: No 00:26:42.036 Associated with SR-IOV VF: No 00:26:42.036 Max Data Transfer Size: 131072 00:26:42.036 Max Number of Namespaces: 0 00:26:42.036 Max Number of I/O Queues: 1024 00:26:42.036 NVMe Specification Version (VS): 1.3 00:26:42.036 NVMe Specification Version (Identify): 1.3 00:26:42.036 Maximum Queue Entries: 128 00:26:42.036 Contiguous Queues Required: Yes 00:26:42.036 Arbitration Mechanisms Supported 00:26:42.036 Weighted Round Robin: Not Supported 00:26:42.036 Vendor Specific: Not Supported 00:26:42.036 Reset Timeout: 15000 ms 00:26:42.036 Doorbell Stride: 4 bytes 00:26:42.036 NVM Subsystem Reset: Not Supported 00:26:42.036 Command Sets Supported 00:26:42.036 NVM Command Set: Supported 00:26:42.036 Boot Partition: Not Supported 00:26:42.036 Memory Page Size Minimum: 4096 bytes 00:26:42.036 Memory Page Size Maximum: 4096 bytes 00:26:42.036 Persistent Memory Region: Not Supported 00:26:42.036 Optional Asynchronous Events Supported 00:26:42.036 Namespace Attribute Notices: Not Supported 00:26:42.036 Firmware Activation Notices: Not Supported 00:26:42.036 ANA Change Notices: Not Supported 00:26:42.036 PLE Aggregate Log Change Notices: Not Supported 00:26:42.036 LBA Status Info Alert Notices: Not Supported 00:26:42.036 EGE Aggregate Log Change Notices: Not Supported 00:26:42.036 Normal NVM Subsystem Shutdown event: Not Supported 00:26:42.036 Zone Descriptor Change Notices: Not Supported 00:26:42.036 Discovery Log Change Notices: Supported 00:26:42.036 Controller Attributes 00:26:42.036 128-bit Host Identifier: Not Supported 00:26:42.036 Non-Operational Permissive Mode: Not Supported 00:26:42.036 NVM Sets: Not Supported 00:26:42.036 Read Recovery Levels: Not Supported 00:26:42.036 Endurance Groups: Not Supported 00:26:42.036 Predictable Latency Mode: Not Supported 00:26:42.036 Traffic Based Keep ALive: Not Supported 00:26:42.036 Namespace Granularity: Not Supported 00:26:42.036 SQ Associations: Not Supported 00:26:42.036 UUID List: Not Supported 00:26:42.036 Multi-Domain Subsystem: Not Supported 00:26:42.036 Fixed Capacity Management: Not Supported 00:26:42.036 Variable Capacity Management: Not Supported 00:26:42.036 Delete Endurance Group: Not Supported 00:26:42.036 Delete NVM Set: Not Supported 00:26:42.036 Extended LBA Formats Supported: Not Supported 00:26:42.036 Flexible Data Placement Supported: Not Supported 00:26:42.036 00:26:42.036 Controller Memory Buffer Support 00:26:42.036 ================================ 00:26:42.036 Supported: No 00:26:42.036 00:26:42.036 Persistent Memory Region Support 00:26:42.036 ================================ 00:26:42.036 Supported: No 00:26:42.036 00:26:42.036 Admin Command Set Attributes 00:26:42.036 ============================ 00:26:42.036 Security Send/Receive: Not Supported 00:26:42.036 Format NVM: Not Supported 00:26:42.036 Firmware Activate/Download: Not Supported 00:26:42.036 Namespace Management: Not Supported 00:26:42.036 Device Self-Test: Not Supported 00:26:42.036 Directives: Not Supported 00:26:42.036 NVMe-MI: Not Supported 00:26:42.036 Virtualization Management: Not Supported 00:26:42.036 Doorbell Buffer Config: Not Supported 00:26:42.036 Get LBA Status Capability: Not Supported 00:26:42.036 Command & Feature Lockdown Capability: Not Supported 00:26:42.036 Abort Command Limit: 1 00:26:42.036 Async Event Request Limit: 4 00:26:42.036 Number of Firmware Slots: N/A 00:26:42.036 Firmware Slot 1 Read-Only: N/A 00:26:42.036 Firmware Activation Without Reset: N/A 00:26:42.036 Multiple Update Detection Support: N/A 00:26:42.036 Firmware Update Granularity: No Information Provided 00:26:42.036 Per-Namespace SMART Log: No 00:26:42.036 Asymmetric Namespace Access Log Page: Not Supported 00:26:42.036 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:42.036 Command Effects Log Page: Not Supported 00:26:42.036 Get Log Page Extended Data: Supported 00:26:42.036 Telemetry Log Pages: Not Supported 00:26:42.036 Persistent Event Log Pages: Not Supported 00:26:42.036 Supported Log Pages Log Page: May Support 00:26:42.036 Commands Supported & Effects Log Page: Not Supported 00:26:42.036 Feature Identifiers & Effects Log Page:May Support 00:26:42.036 NVMe-MI Commands & Effects Log Page: May Support 00:26:42.036 Data Area 4 for Telemetry Log: Not Supported 00:26:42.036 Error Log Page Entries Supported: 128 00:26:42.036 Keep Alive: Not Supported 00:26:42.036 00:26:42.036 NVM Command Set Attributes 00:26:42.036 ========================== 00:26:42.036 Submission Queue Entry Size 00:26:42.036 Max: 1 00:26:42.036 Min: 1 00:26:42.036 Completion Queue Entry Size 00:26:42.036 Max: 1 00:26:42.036 Min: 1 00:26:42.036 Number of Namespaces: 0 00:26:42.036 Compare Command: Not Supported 00:26:42.036 Write Uncorrectable Command: Not Supported 00:26:42.036 Dataset Management Command: Not Supported 00:26:42.036 Write Zeroes Command: Not Supported 00:26:42.036 Set Features Save Field: Not Supported 00:26:42.036 Reservations: Not Supported 00:26:42.036 Timestamp: Not Supported 00:26:42.036 Copy: Not Supported 00:26:42.036 Volatile Write Cache: Not Present 00:26:42.036 Atomic Write Unit (Normal): 1 00:26:42.036 Atomic Write Unit (PFail): 1 00:26:42.036 Atomic Compare & Write Unit: 1 00:26:42.036 Fused Compare & Write: Supported 00:26:42.036 Scatter-Gather List 00:26:42.036 SGL Command Set: Supported 00:26:42.036 SGL Keyed: Supported 00:26:42.036 SGL Bit Bucket Descriptor: Not Supported 00:26:42.036 SGL Metadata Pointer: Not Supported 00:26:42.036 Oversized SGL: Not Supported 00:26:42.036 SGL Metadata Address: Not Supported 00:26:42.036 SGL Offset: Supported 00:26:42.036 Transport SGL Data Block: Not Supported 00:26:42.036 Replay Protected Memory Block: Not Supported 00:26:42.036 00:26:42.036 Firmware Slot Information 00:26:42.036 ========================= 00:26:42.036 Active slot: 0 00:26:42.036 00:26:42.036 00:26:42.036 Error Log 00:26:42.036 ========= 00:26:42.036 00:26:42.036 Active Namespaces 00:26:42.036 ================= 00:26:42.036 Discovery Log Page 00:26:42.036 ================== 00:26:42.036 Generation Counter: 2 00:26:42.036 Number of Records: 2 00:26:42.036 Record Format: 0 00:26:42.036 00:26:42.036 Discovery Log Entry 0 00:26:42.036 ---------------------- 00:26:42.036 Transport Type: 3 (TCP) 00:26:42.036 Address Family: 1 (IPv4) 00:26:42.036 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:42.036 Entry Flags: 00:26:42.036 Duplicate Returned Information: 1 00:26:42.036 Explicit Persistent Connection Support for Discovery: 1 00:26:42.036 Transport Requirements: 00:26:42.036 Secure Channel: Not Required 00:26:42.036 Port ID: 0 (0x0000) 00:26:42.036 Controller ID: 65535 (0xffff) 00:26:42.036 Admin Max SQ Size: 128 00:26:42.036 Transport Service Identifier: 4420 00:26:42.036 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:42.036 Transport Address: 10.0.0.2 00:26:42.036 Discovery Log Entry 1 00:26:42.036 ---------------------- 00:26:42.036 Transport Type: 3 (TCP) 00:26:42.036 Address Family: 1 (IPv4) 00:26:42.036 Subsystem Type: 2 (NVM Subsystem) 00:26:42.036 Entry Flags: 00:26:42.036 Duplicate Returned Information: 0 00:26:42.036 Explicit Persistent Connection Support for Discovery: 0 00:26:42.036 Transport Requirements: 00:26:42.036 Secure Channel: Not Required 00:26:42.036 Port ID: 0 (0x0000) 00:26:42.037 Controller ID: 65535 (0xffff) 00:26:42.037 Admin Max SQ Size: 128 00:26:42.037 Transport Service Identifier: 4420 00:26:42.037 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:42.037 Transport Address: 10.0.0.2 [2024-05-14 04:23:56.386401] nvme_ctrlr.c:4206:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:42.037 [2024-05-14 04:23:56.386414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.037 [2024-05-14 04:23:56.386421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.037 [2024-05-14 04:23:56.386427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.037 [2024-05-14 04:23:56.386434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.037 [2024-05-14 04:23:56.386445] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.386448] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.386452] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.386459] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.386473] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.386775] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.386783] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.386786] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.386790] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.386797] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.386801] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.386804] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.386811] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.386825] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.387005] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.387011] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.387015] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387018] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.387023] nvme_ctrlr.c:1069:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:42.037 [2024-05-14 04:23:56.387028] nvme_ctrlr.c:1072:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:42.037 [2024-05-14 04:23:56.387037] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387041] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387044] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.387051] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.387061] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.387222] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.387228] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.387232] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387236] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.387246] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387250] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387253] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.387260] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.387270] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.387505] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.387513] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.387517] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387520] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.387530] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387534] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387537] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.387544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.387555] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.387742] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.387748] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.387752] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387755] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.387765] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387769] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.387772] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.387779] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.387789] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.387989] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.387995] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.387999] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388003] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.388013] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388016] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388020] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.388027] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.388037] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.388247] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.388253] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.388257] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388261] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.388270] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388274] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388277] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.388284] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.388301] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.388480] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.388486] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.388492] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388496] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.388506] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388510] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388513] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.388520] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.388531] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.388780] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.388786] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.388789] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388793] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.388803] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.388810] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.388817] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.388827] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.389044] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.389050] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.037 [2024-05-14 04:23:56.389053] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.389057] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.037 [2024-05-14 04:23:56.389067] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.389071] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.037 [2024-05-14 04:23:56.389075] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.037 [2024-05-14 04:23:56.389081] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.037 [2024-05-14 04:23:56.389092] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.037 [2024-05-14 04:23:56.389231] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.037 [2024-05-14 04:23:56.389237] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.038 [2024-05-14 04:23:56.389240] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389244] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.038 [2024-05-14 04:23:56.389254] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389257] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389261] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.038 [2024-05-14 04:23:56.389268] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.038 [2024-05-14 04:23:56.389278] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.038 [2024-05-14 04:23:56.389512] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.038 [2024-05-14 04:23:56.389519] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.038 [2024-05-14 04:23:56.389523] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389529] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.038 [2024-05-14 04:23:56.389539] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389543] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389546] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.038 [2024-05-14 04:23:56.389553] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.038 [2024-05-14 04:23:56.389564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.038 [2024-05-14 04:23:56.389762] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.038 [2024-05-14 04:23:56.389769] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.038 [2024-05-14 04:23:56.389772] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389776] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.038 [2024-05-14 04:23:56.389785] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389789] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389792] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.038 [2024-05-14 04:23:56.389799] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.038 [2024-05-14 04:23:56.389810] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.038 [2024-05-14 04:23:56.389976] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.038 [2024-05-14 04:23:56.389982] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.038 [2024-05-14 04:23:56.389985] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.389989] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.038 [2024-05-14 04:23:56.389999] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.390002] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.390006] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.038 [2024-05-14 04:23:56.390013] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.038 [2024-05-14 04:23:56.390023] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.038 [2024-05-14 04:23:56.390227] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.038 [2024-05-14 04:23:56.390233] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.038 [2024-05-14 04:23:56.390237] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.390241] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.038 [2024-05-14 04:23:56.390250] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.390254] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.390257] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5cb9e0) 00:26:42.038 [2024-05-14 04:23:56.390264] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.038 [2024-05-14 04:23:56.390275] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x633b50, cid 3, qid 0 00:26:42.038 [2024-05-14 04:23:56.394301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.038 [2024-05-14 04:23:56.394318] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.038 [2024-05-14 04:23:56.394321] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.394325] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x633b50) on tqpair=0x5cb9e0 00:26:42.038 [2024-05-14 04:23:56.394338] nvme_ctrlr.c:1191:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:26:42.038 00:26:42.038 04:23:56 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:42.038 [2024-05-14 04:23:56.430255] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:26:42.038 [2024-05-14 04:23:56.430310] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4074466 ] 00:26:42.038 EAL: No free 2048 kB hugepages reported on node 1 00:26:42.038 [2024-05-14 04:23:56.463835] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:42.038 [2024-05-14 04:23:56.463884] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:42.038 [2024-05-14 04:23:56.463889] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:42.038 [2024-05-14 04:23:56.463900] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:42.038 [2024-05-14 04:23:56.463907] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:42.038 [2024-05-14 04:23:56.464470] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:42.038 [2024-05-14 04:23:56.464493] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x90d9e0 0 00:26:42.038 [2024-05-14 04:23:56.474299] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:42.038 [2024-05-14 04:23:56.474316] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:42.038 [2024-05-14 04:23:56.474320] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:42.038 [2024-05-14 04:23:56.474323] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:42.038 [2024-05-14 04:23:56.474357] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.474363] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.474367] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.038 [2024-05-14 04:23:56.474379] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:42.038 [2024-05-14 04:23:56.474396] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.038 [2024-05-14 04:23:56.482301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.038 [2024-05-14 04:23:56.482310] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.038 [2024-05-14 04:23:56.482313] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.482318] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975730) on tqpair=0x90d9e0 00:26:42.038 [2024-05-14 04:23:56.482326] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:42.038 [2024-05-14 04:23:56.482332] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:42.038 [2024-05-14 04:23:56.482337] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:42.038 [2024-05-14 04:23:56.482350] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.482354] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.482357] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.038 [2024-05-14 04:23:56.482368] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.038 [2024-05-14 04:23:56.482381] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.038 [2024-05-14 04:23:56.482634] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.038 [2024-05-14 04:23:56.482644] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.038 [2024-05-14 04:23:56.482648] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.482652] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975730) on tqpair=0x90d9e0 00:26:42.038 [2024-05-14 04:23:56.482661] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:42.038 [2024-05-14 04:23:56.482669] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:42.038 [2024-05-14 04:23:56.482676] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.482680] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.482684] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.038 [2024-05-14 04:23:56.482691] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.038 [2024-05-14 04:23:56.482703] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.038 [2024-05-14 04:23:56.482917] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.038 [2024-05-14 04:23:56.482924] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.038 [2024-05-14 04:23:56.482927] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.482931] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975730) on tqpair=0x90d9e0 00:26:42.038 [2024-05-14 04:23:56.482937] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:42.038 [2024-05-14 04:23:56.482945] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:42.038 [2024-05-14 04:23:56.482952] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.482955] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.038 [2024-05-14 04:23:56.482959] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.038 [2024-05-14 04:23:56.482966] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.038 [2024-05-14 04:23:56.482977] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.038 [2024-05-14 04:23:56.483198] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.038 [2024-05-14 04:23:56.483204] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.039 [2024-05-14 04:23:56.483208] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.483211] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975730) on tqpair=0x90d9e0 00:26:42.039 [2024-05-14 04:23:56.483216] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:42.039 [2024-05-14 04:23:56.483226] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.483230] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.483234] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.483240] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.039 [2024-05-14 04:23:56.483251] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.039 [2024-05-14 04:23:56.483488] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.039 [2024-05-14 04:23:56.483495] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.039 [2024-05-14 04:23:56.483499] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.483503] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975730) on tqpair=0x90d9e0 00:26:42.039 [2024-05-14 04:23:56.483507] nvme_ctrlr.c:3736:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:42.039 [2024-05-14 04:23:56.483512] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:42.039 [2024-05-14 04:23:56.483520] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:42.039 [2024-05-14 04:23:56.483625] nvme_ctrlr.c:3929:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:42.039 [2024-05-14 04:23:56.483629] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:42.039 [2024-05-14 04:23:56.483637] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.483641] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.483644] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.483651] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.039 [2024-05-14 04:23:56.483663] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.039 [2024-05-14 04:23:56.483863] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.039 [2024-05-14 04:23:56.483870] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.039 [2024-05-14 04:23:56.483874] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.483877] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975730) on tqpair=0x90d9e0 00:26:42.039 [2024-05-14 04:23:56.483882] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:42.039 [2024-05-14 04:23:56.483891] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.483895] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.483899] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.483905] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.039 [2024-05-14 04:23:56.483916] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.039 [2024-05-14 04:23:56.484152] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.039 [2024-05-14 04:23:56.484158] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.039 [2024-05-14 04:23:56.484162] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.484165] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975730) on tqpair=0x90d9e0 00:26:42.039 [2024-05-14 04:23:56.484170] nvme_ctrlr.c:3771:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:42.039 [2024-05-14 04:23:56.484174] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:42.039 [2024-05-14 04:23:56.484182] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:42.039 [2024-05-14 04:23:56.484191] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:42.039 [2024-05-14 04:23:56.484202] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.484206] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.484209] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.484216] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.039 [2024-05-14 04:23:56.484227] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.039 [2024-05-14 04:23:56.484524] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:42.039 [2024-05-14 04:23:56.484533] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:42.039 [2024-05-14 04:23:56.484537] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.484540] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x90d9e0): datao=0, datal=4096, cccid=0 00:26:42.039 [2024-05-14 04:23:56.484545] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x975730) on tqpair(0x90d9e0): expected_datao=0, payload_size=4096 00:26:42.039 [2024-05-14 04:23:56.484553] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.484557] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.484750] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.039 [2024-05-14 04:23:56.484756] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.039 [2024-05-14 04:23:56.484760] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.484764] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975730) on tqpair=0x90d9e0 00:26:42.039 [2024-05-14 04:23:56.484771] nvme_ctrlr.c:1971:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:42.039 [2024-05-14 04:23:56.484780] nvme_ctrlr.c:1975:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:42.039 [2024-05-14 04:23:56.484784] nvme_ctrlr.c:1978:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:42.039 [2024-05-14 04:23:56.484788] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:42.039 [2024-05-14 04:23:56.484793] nvme_ctrlr.c:2017:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:42.039 [2024-05-14 04:23:56.484797] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:42.039 [2024-05-14 04:23:56.484806] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:42.039 [2024-05-14 04:23:56.484813] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.484817] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.484820] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.484827] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:42.039 [2024-05-14 04:23:56.484840] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.039 [2024-05-14 04:23:56.485074] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.039 [2024-05-14 04:23:56.485081] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.039 [2024-05-14 04:23:56.485084] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485088] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975730) on tqpair=0x90d9e0 00:26:42.039 [2024-05-14 04:23:56.485095] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485099] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485102] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.485111] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.039 [2024-05-14 04:23:56.485117] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485121] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485124] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.485130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.039 [2024-05-14 04:23:56.485136] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485139] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485143] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.485148] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.039 [2024-05-14 04:23:56.485154] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485158] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485161] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.485167] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.039 [2024-05-14 04:23:56.485171] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:42.039 [2024-05-14 04:23:56.485182] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:42.039 [2024-05-14 04:23:56.485189] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485192] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.039 [2024-05-14 04:23:56.485195] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x90d9e0) 00:26:42.039 [2024-05-14 04:23:56.485202] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.039 [2024-05-14 04:23:56.485215] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975730, cid 0, qid 0 00:26:42.039 [2024-05-14 04:23:56.485220] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975890, cid 1, qid 0 00:26:42.039 [2024-05-14 04:23:56.485225] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9759f0, cid 2, qid 0 00:26:42.039 [2024-05-14 04:23:56.485229] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.039 [2024-05-14 04:23:56.485234] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975cb0, cid 4, qid 0 00:26:42.039 [2024-05-14 04:23:56.485485] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.039 [2024-05-14 04:23:56.485492] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.040 [2024-05-14 04:23:56.485496] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.485500] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975cb0) on tqpair=0x90d9e0 00:26:42.040 [2024-05-14 04:23:56.485504] nvme_ctrlr.c:2889:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:42.040 [2024-05-14 04:23:56.485509] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.485518] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.485524] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.485533] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.485537] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.485540] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x90d9e0) 00:26:42.040 [2024-05-14 04:23:56.485546] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:42.040 [2024-05-14 04:23:56.485558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975cb0, cid 4, qid 0 00:26:42.040 [2024-05-14 04:23:56.485782] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.040 [2024-05-14 04:23:56.485788] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.040 [2024-05-14 04:23:56.485792] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.485795] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975cb0) on tqpair=0x90d9e0 00:26:42.040 [2024-05-14 04:23:56.485847] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.485856] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.485863] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.485867] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.485871] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x90d9e0) 00:26:42.040 [2024-05-14 04:23:56.485877] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.040 [2024-05-14 04:23:56.485888] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975cb0, cid 4, qid 0 00:26:42.040 [2024-05-14 04:23:56.486175] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:42.040 [2024-05-14 04:23:56.486183] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:42.040 [2024-05-14 04:23:56.486186] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.486190] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x90d9e0): datao=0, datal=4096, cccid=4 00:26:42.040 [2024-05-14 04:23:56.486194] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x975cb0) on tqpair(0x90d9e0): expected_datao=0, payload_size=4096 00:26:42.040 [2024-05-14 04:23:56.486202] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.486205] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.526527] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.040 [2024-05-14 04:23:56.526541] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.040 [2024-05-14 04:23:56.526545] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.526549] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975cb0) on tqpair=0x90d9e0 00:26:42.040 [2024-05-14 04:23:56.526560] nvme_ctrlr.c:4542:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:42.040 [2024-05-14 04:23:56.526575] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.526585] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.526592] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.526596] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.526599] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x90d9e0) 00:26:42.040 [2024-05-14 04:23:56.526607] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.040 [2024-05-14 04:23:56.526624] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975cb0, cid 4, qid 0 00:26:42.040 [2024-05-14 04:23:56.526824] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:42.040 [2024-05-14 04:23:56.526832] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:42.040 [2024-05-14 04:23:56.526836] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.526839] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x90d9e0): datao=0, datal=4096, cccid=4 00:26:42.040 [2024-05-14 04:23:56.526844] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x975cb0) on tqpair(0x90d9e0): expected_datao=0, payload_size=4096 00:26:42.040 [2024-05-14 04:23:56.526852] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.526855] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.567483] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.040 [2024-05-14 04:23:56.567495] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.040 [2024-05-14 04:23:56.567499] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.567502] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975cb0) on tqpair=0x90d9e0 00:26:42.040 [2024-05-14 04:23:56.567519] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.567529] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.567536] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.567540] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.567544] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x90d9e0) 00:26:42.040 [2024-05-14 04:23:56.567551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.040 [2024-05-14 04:23:56.567563] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975cb0, cid 4, qid 0 00:26:42.040 [2024-05-14 04:23:56.567746] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:42.040 [2024-05-14 04:23:56.567753] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:42.040 [2024-05-14 04:23:56.567757] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.567760] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x90d9e0): datao=0, datal=4096, cccid=4 00:26:42.040 [2024-05-14 04:23:56.567765] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x975cb0) on tqpair(0x90d9e0): expected_datao=0, payload_size=4096 00:26:42.040 [2024-05-14 04:23:56.567837] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.567842] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.612303] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.040 [2024-05-14 04:23:56.612312] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.040 [2024-05-14 04:23:56.612316] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.040 [2024-05-14 04:23:56.612320] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975cb0) on tqpair=0x90d9e0 00:26:42.040 [2024-05-14 04:23:56.612329] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.612337] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.612347] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.612353] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.612360] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.612365] nvme_ctrlr.c:2977:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:42.040 [2024-05-14 04:23:56.612370] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:42.040 [2024-05-14 04:23:56.612375] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:42.040 [2024-05-14 04:23:56.612389] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612393] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612397] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x90d9e0) 00:26:42.041 [2024-05-14 04:23:56.612404] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.041 [2024-05-14 04:23:56.612411] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612414] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612418] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x90d9e0) 00:26:42.041 [2024-05-14 04:23:56.612424] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.041 [2024-05-14 04:23:56.612438] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975cb0, cid 4, qid 0 00:26:42.041 [2024-05-14 04:23:56.612443] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975e10, cid 5, qid 0 00:26:42.041 [2024-05-14 04:23:56.612571] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.041 [2024-05-14 04:23:56.612578] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.041 [2024-05-14 04:23:56.612582] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612586] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975cb0) on tqpair=0x90d9e0 00:26:42.041 [2024-05-14 04:23:56.612592] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.041 [2024-05-14 04:23:56.612598] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.041 [2024-05-14 04:23:56.612602] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612605] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975e10) on tqpair=0x90d9e0 00:26:42.041 [2024-05-14 04:23:56.612615] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612618] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612622] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x90d9e0) 00:26:42.041 [2024-05-14 04:23:56.612628] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.041 [2024-05-14 04:23:56.612639] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975e10, cid 5, qid 0 00:26:42.041 [2024-05-14 04:23:56.612859] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.041 [2024-05-14 04:23:56.612865] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.041 [2024-05-14 04:23:56.612869] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612872] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975e10) on tqpair=0x90d9e0 00:26:42.041 [2024-05-14 04:23:56.612881] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612885] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.612888] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x90d9e0) 00:26:42.041 [2024-05-14 04:23:56.612895] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.041 [2024-05-14 04:23:56.612908] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975e10, cid 5, qid 0 00:26:42.041 [2024-05-14 04:23:56.613110] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.041 [2024-05-14 04:23:56.613117] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.041 [2024-05-14 04:23:56.613120] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613124] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975e10) on tqpair=0x90d9e0 00:26:42.041 [2024-05-14 04:23:56.613133] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613136] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613140] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x90d9e0) 00:26:42.041 [2024-05-14 04:23:56.613146] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.041 [2024-05-14 04:23:56.613156] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975e10, cid 5, qid 0 00:26:42.041 [2024-05-14 04:23:56.613392] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.041 [2024-05-14 04:23:56.613399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.041 [2024-05-14 04:23:56.613403] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613406] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975e10) on tqpair=0x90d9e0 00:26:42.041 [2024-05-14 04:23:56.613419] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613422] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613426] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x90d9e0) 00:26:42.041 [2024-05-14 04:23:56.613432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.041 [2024-05-14 04:23:56.613440] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613443] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613447] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x90d9e0) 00:26:42.041 [2024-05-14 04:23:56.613453] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.041 [2024-05-14 04:23:56.613460] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613464] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613467] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x90d9e0) 00:26:42.041 [2024-05-14 04:23:56.613473] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.041 [2024-05-14 04:23:56.613480] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613484] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613487] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x90d9e0) 00:26:42.041 [2024-05-14 04:23:56.613493] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.041 [2024-05-14 04:23:56.613506] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975e10, cid 5, qid 0 00:26:42.041 [2024-05-14 04:23:56.613511] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975cb0, cid 4, qid 0 00:26:42.041 [2024-05-14 04:23:56.613516] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975f70, cid 6, qid 0 00:26:42.041 [2024-05-14 04:23:56.613520] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9760d0, cid 7, qid 0 00:26:42.041 [2024-05-14 04:23:56.613823] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:42.041 [2024-05-14 04:23:56.613830] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:42.041 [2024-05-14 04:23:56.613833] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613837] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x90d9e0): datao=0, datal=8192, cccid=5 00:26:42.041 [2024-05-14 04:23:56.613842] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x975e10) on tqpair(0x90d9e0): expected_datao=0, payload_size=8192 00:26:42.041 [2024-05-14 04:23:56.613944] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613949] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613954] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:42.041 [2024-05-14 04:23:56.613960] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:42.041 [2024-05-14 04:23:56.613963] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613967] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x90d9e0): datao=0, datal=512, cccid=4 00:26:42.041 [2024-05-14 04:23:56.613971] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x975cb0) on tqpair(0x90d9e0): expected_datao=0, payload_size=512 00:26:42.041 [2024-05-14 04:23:56.613978] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613981] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613987] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:42.041 [2024-05-14 04:23:56.613993] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:42.041 [2024-05-14 04:23:56.613996] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.613999] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x90d9e0): datao=0, datal=512, cccid=6 00:26:42.041 [2024-05-14 04:23:56.614004] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x975f70) on tqpair(0x90d9e0): expected_datao=0, payload_size=512 00:26:42.041 [2024-05-14 04:23:56.614010] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.614014] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.614019] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:42.041 [2024-05-14 04:23:56.614025] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:42.041 [2024-05-14 04:23:56.614028] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.614032] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x90d9e0): datao=0, datal=4096, cccid=7 00:26:42.041 [2024-05-14 04:23:56.614036] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9760d0) on tqpair(0x90d9e0): expected_datao=0, payload_size=4096 00:26:42.041 [2024-05-14 04:23:56.614197] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:42.041 [2024-05-14 04:23:56.614201] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:42.304 [2024-05-14 04:23:56.654534] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.304 [2024-05-14 04:23:56.654547] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.304 [2024-05-14 04:23:56.654550] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.304 [2024-05-14 04:23:56.654554] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975e10) on tqpair=0x90d9e0 00:26:42.304 [2024-05-14 04:23:56.654570] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.304 [2024-05-14 04:23:56.654576] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.304 [2024-05-14 04:23:56.654579] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.304 [2024-05-14 04:23:56.654583] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975cb0) on tqpair=0x90d9e0 00:26:42.304 [2024-05-14 04:23:56.654591] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.304 [2024-05-14 04:23:56.654599] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.304 [2024-05-14 04:23:56.654603] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.304 [2024-05-14 04:23:56.654606] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975f70) on tqpair=0x90d9e0 00:26:42.304 [2024-05-14 04:23:56.654613] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.304 [2024-05-14 04:23:56.654619] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.304 [2024-05-14 04:23:56.654622] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.304 [2024-05-14 04:23:56.654626] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9760d0) on tqpair=0x90d9e0 00:26:42.304 ===================================================== 00:26:42.304 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:42.304 ===================================================== 00:26:42.304 Controller Capabilities/Features 00:26:42.304 ================================ 00:26:42.304 Vendor ID: 8086 00:26:42.304 Subsystem Vendor ID: 8086 00:26:42.304 Serial Number: SPDK00000000000001 00:26:42.305 Model Number: SPDK bdev Controller 00:26:42.305 Firmware Version: 24.01.1 00:26:42.305 Recommended Arb Burst: 6 00:26:42.305 IEEE OUI Identifier: e4 d2 5c 00:26:42.305 Multi-path I/O 00:26:42.305 May have multiple subsystem ports: Yes 00:26:42.305 May have multiple controllers: Yes 00:26:42.305 Associated with SR-IOV VF: No 00:26:42.305 Max Data Transfer Size: 131072 00:26:42.305 Max Number of Namespaces: 32 00:26:42.305 Max Number of I/O Queues: 127 00:26:42.305 NVMe Specification Version (VS): 1.3 00:26:42.305 NVMe Specification Version (Identify): 1.3 00:26:42.305 Maximum Queue Entries: 128 00:26:42.305 Contiguous Queues Required: Yes 00:26:42.305 Arbitration Mechanisms Supported 00:26:42.305 Weighted Round Robin: Not Supported 00:26:42.305 Vendor Specific: Not Supported 00:26:42.305 Reset Timeout: 15000 ms 00:26:42.305 Doorbell Stride: 4 bytes 00:26:42.305 NVM Subsystem Reset: Not Supported 00:26:42.305 Command Sets Supported 00:26:42.305 NVM Command Set: Supported 00:26:42.305 Boot Partition: Not Supported 00:26:42.305 Memory Page Size Minimum: 4096 bytes 00:26:42.305 Memory Page Size Maximum: 4096 bytes 00:26:42.305 Persistent Memory Region: Not Supported 00:26:42.305 Optional Asynchronous Events Supported 00:26:42.305 Namespace Attribute Notices: Supported 00:26:42.305 Firmware Activation Notices: Not Supported 00:26:42.305 ANA Change Notices: Not Supported 00:26:42.305 PLE Aggregate Log Change Notices: Not Supported 00:26:42.305 LBA Status Info Alert Notices: Not Supported 00:26:42.305 EGE Aggregate Log Change Notices: Not Supported 00:26:42.305 Normal NVM Subsystem Shutdown event: Not Supported 00:26:42.305 Zone Descriptor Change Notices: Not Supported 00:26:42.305 Discovery Log Change Notices: Not Supported 00:26:42.305 Controller Attributes 00:26:42.305 128-bit Host Identifier: Supported 00:26:42.305 Non-Operational Permissive Mode: Not Supported 00:26:42.305 NVM Sets: Not Supported 00:26:42.305 Read Recovery Levels: Not Supported 00:26:42.305 Endurance Groups: Not Supported 00:26:42.305 Predictable Latency Mode: Not Supported 00:26:42.305 Traffic Based Keep ALive: Not Supported 00:26:42.305 Namespace Granularity: Not Supported 00:26:42.305 SQ Associations: Not Supported 00:26:42.305 UUID List: Not Supported 00:26:42.305 Multi-Domain Subsystem: Not Supported 00:26:42.305 Fixed Capacity Management: Not Supported 00:26:42.305 Variable Capacity Management: Not Supported 00:26:42.305 Delete Endurance Group: Not Supported 00:26:42.305 Delete NVM Set: Not Supported 00:26:42.305 Extended LBA Formats Supported: Not Supported 00:26:42.305 Flexible Data Placement Supported: Not Supported 00:26:42.305 00:26:42.305 Controller Memory Buffer Support 00:26:42.305 ================================ 00:26:42.305 Supported: No 00:26:42.305 00:26:42.305 Persistent Memory Region Support 00:26:42.305 ================================ 00:26:42.305 Supported: No 00:26:42.305 00:26:42.305 Admin Command Set Attributes 00:26:42.305 ============================ 00:26:42.305 Security Send/Receive: Not Supported 00:26:42.305 Format NVM: Not Supported 00:26:42.305 Firmware Activate/Download: Not Supported 00:26:42.305 Namespace Management: Not Supported 00:26:42.305 Device Self-Test: Not Supported 00:26:42.305 Directives: Not Supported 00:26:42.305 NVMe-MI: Not Supported 00:26:42.305 Virtualization Management: Not Supported 00:26:42.305 Doorbell Buffer Config: Not Supported 00:26:42.305 Get LBA Status Capability: Not Supported 00:26:42.305 Command & Feature Lockdown Capability: Not Supported 00:26:42.305 Abort Command Limit: 4 00:26:42.305 Async Event Request Limit: 4 00:26:42.305 Number of Firmware Slots: N/A 00:26:42.305 Firmware Slot 1 Read-Only: N/A 00:26:42.305 Firmware Activation Without Reset: N/A 00:26:42.305 Multiple Update Detection Support: N/A 00:26:42.305 Firmware Update Granularity: No Information Provided 00:26:42.305 Per-Namespace SMART Log: No 00:26:42.305 Asymmetric Namespace Access Log Page: Not Supported 00:26:42.305 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:42.305 Command Effects Log Page: Supported 00:26:42.305 Get Log Page Extended Data: Supported 00:26:42.305 Telemetry Log Pages: Not Supported 00:26:42.305 Persistent Event Log Pages: Not Supported 00:26:42.305 Supported Log Pages Log Page: May Support 00:26:42.305 Commands Supported & Effects Log Page: Not Supported 00:26:42.305 Feature Identifiers & Effects Log Page:May Support 00:26:42.305 NVMe-MI Commands & Effects Log Page: May Support 00:26:42.305 Data Area 4 for Telemetry Log: Not Supported 00:26:42.305 Error Log Page Entries Supported: 128 00:26:42.305 Keep Alive: Supported 00:26:42.305 Keep Alive Granularity: 10000 ms 00:26:42.305 00:26:42.305 NVM Command Set Attributes 00:26:42.305 ========================== 00:26:42.305 Submission Queue Entry Size 00:26:42.305 Max: 64 00:26:42.305 Min: 64 00:26:42.305 Completion Queue Entry Size 00:26:42.305 Max: 16 00:26:42.305 Min: 16 00:26:42.305 Number of Namespaces: 32 00:26:42.305 Compare Command: Supported 00:26:42.305 Write Uncorrectable Command: Not Supported 00:26:42.305 Dataset Management Command: Supported 00:26:42.305 Write Zeroes Command: Supported 00:26:42.305 Set Features Save Field: Not Supported 00:26:42.305 Reservations: Supported 00:26:42.305 Timestamp: Not Supported 00:26:42.305 Copy: Supported 00:26:42.305 Volatile Write Cache: Present 00:26:42.305 Atomic Write Unit (Normal): 1 00:26:42.305 Atomic Write Unit (PFail): 1 00:26:42.305 Atomic Compare & Write Unit: 1 00:26:42.305 Fused Compare & Write: Supported 00:26:42.305 Scatter-Gather List 00:26:42.305 SGL Command Set: Supported 00:26:42.305 SGL Keyed: Supported 00:26:42.305 SGL Bit Bucket Descriptor: Not Supported 00:26:42.305 SGL Metadata Pointer: Not Supported 00:26:42.305 Oversized SGL: Not Supported 00:26:42.305 SGL Metadata Address: Not Supported 00:26:42.305 SGL Offset: Supported 00:26:42.305 Transport SGL Data Block: Not Supported 00:26:42.305 Replay Protected Memory Block: Not Supported 00:26:42.305 00:26:42.305 Firmware Slot Information 00:26:42.305 ========================= 00:26:42.305 Active slot: 1 00:26:42.305 Slot 1 Firmware Revision: 24.01.1 00:26:42.305 00:26:42.305 00:26:42.305 Commands Supported and Effects 00:26:42.305 ============================== 00:26:42.305 Admin Commands 00:26:42.305 -------------- 00:26:42.305 Get Log Page (02h): Supported 00:26:42.305 Identify (06h): Supported 00:26:42.305 Abort (08h): Supported 00:26:42.305 Set Features (09h): Supported 00:26:42.305 Get Features (0Ah): Supported 00:26:42.305 Asynchronous Event Request (0Ch): Supported 00:26:42.305 Keep Alive (18h): Supported 00:26:42.305 I/O Commands 00:26:42.305 ------------ 00:26:42.305 Flush (00h): Supported LBA-Change 00:26:42.305 Write (01h): Supported LBA-Change 00:26:42.305 Read (02h): Supported 00:26:42.305 Compare (05h): Supported 00:26:42.305 Write Zeroes (08h): Supported LBA-Change 00:26:42.305 Dataset Management (09h): Supported LBA-Change 00:26:42.305 Copy (19h): Supported LBA-Change 00:26:42.305 Unknown (79h): Supported LBA-Change 00:26:42.305 Unknown (7Ah): Supported 00:26:42.305 00:26:42.305 Error Log 00:26:42.305 ========= 00:26:42.305 00:26:42.305 Arbitration 00:26:42.305 =========== 00:26:42.305 Arbitration Burst: 1 00:26:42.305 00:26:42.305 Power Management 00:26:42.305 ================ 00:26:42.305 Number of Power States: 1 00:26:42.305 Current Power State: Power State #0 00:26:42.305 Power State #0: 00:26:42.305 Max Power: 0.00 W 00:26:42.305 Non-Operational State: Operational 00:26:42.305 Entry Latency: Not Reported 00:26:42.305 Exit Latency: Not Reported 00:26:42.305 Relative Read Throughput: 0 00:26:42.305 Relative Read Latency: 0 00:26:42.305 Relative Write Throughput: 0 00:26:42.305 Relative Write Latency: 0 00:26:42.305 Idle Power: Not Reported 00:26:42.305 Active Power: Not Reported 00:26:42.305 Non-Operational Permissive Mode: Not Supported 00:26:42.305 00:26:42.305 Health Information 00:26:42.305 ================== 00:26:42.305 Critical Warnings: 00:26:42.305 Available Spare Space: OK 00:26:42.305 Temperature: OK 00:26:42.305 Device Reliability: OK 00:26:42.305 Read Only: No 00:26:42.305 Volatile Memory Backup: OK 00:26:42.305 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:42.305 Temperature Threshold: [2024-05-14 04:23:56.654732] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.305 [2024-05-14 04:23:56.654737] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.305 [2024-05-14 04:23:56.654741] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x90d9e0) 00:26:42.305 [2024-05-14 04:23:56.654748] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.305 [2024-05-14 04:23:56.654761] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9760d0, cid 7, qid 0 00:26:42.305 [2024-05-14 04:23:56.654960] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.305 [2024-05-14 04:23:56.654967] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.654970] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.654974] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9760d0) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.655006] nvme_ctrlr.c:4206:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:42.306 [2024-05-14 04:23:56.655018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.306 [2024-05-14 04:23:56.655025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.306 [2024-05-14 04:23:56.655031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.306 [2024-05-14 04:23:56.655037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.306 [2024-05-14 04:23:56.655045] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655048] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655052] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.655059] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.655072] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.655273] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.655279] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.655283] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655287] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.655301] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655305] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655308] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.655315] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.655330] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.655582] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.655589] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.655592] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655596] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.655601] nvme_ctrlr.c:1069:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:42.306 [2024-05-14 04:23:56.655605] nvme_ctrlr.c:1072:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:42.306 [2024-05-14 04:23:56.655614] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655618] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655622] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.655629] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.655639] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.655893] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.655899] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.655903] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655906] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.655916] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655920] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.655924] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.655930] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.655940] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.656144] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.656150] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.656154] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.656157] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.656167] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.656170] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.656174] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.656181] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.656191] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.656434] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.656441] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.656445] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.656448] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.656458] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.656462] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.656465] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.656472] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.656485] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.656738] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.656745] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.656748] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.656752] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.656761] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.656765] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.656769] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.656776] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.656786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.657028] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.657034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.657037] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657041] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.657051] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657055] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657058] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.657065] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.657075] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.657314] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.657321] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.657324] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657328] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.657338] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657342] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657345] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.657352] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.657362] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.657608] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.657615] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.657618] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657622] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.657631] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657635] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657638] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.657645] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.657655] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.657861] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.657867] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.306 [2024-05-14 04:23:56.657871] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657874] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.306 [2024-05-14 04:23:56.657884] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657888] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.306 [2024-05-14 04:23:56.657891] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.306 [2024-05-14 04:23:56.657898] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.306 [2024-05-14 04:23:56.657908] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.306 [2024-05-14 04:23:56.658109] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.306 [2024-05-14 04:23:56.658115] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.307 [2024-05-14 04:23:56.658119] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.307 [2024-05-14 04:23:56.658122] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.307 [2024-05-14 04:23:56.658132] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.307 [2024-05-14 04:23:56.658135] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.307 [2024-05-14 04:23:56.658139] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.307 [2024-05-14 04:23:56.658146] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.307 [2024-05-14 04:23:56.658156] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.307 [2024-05-14 04:23:56.662302] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.307 [2024-05-14 04:23:56.662311] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.307 [2024-05-14 04:23:56.662314] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.307 [2024-05-14 04:23:56.662318] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.307 [2024-05-14 04:23:56.662328] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:42.307 [2024-05-14 04:23:56.662332] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:42.307 [2024-05-14 04:23:56.662335] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x90d9e0) 00:26:42.307 [2024-05-14 04:23:56.662342] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:42.307 [2024-05-14 04:23:56.662353] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x975b50, cid 3, qid 0 00:26:42.307 [2024-05-14 04:23:56.662595] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:42.307 [2024-05-14 04:23:56.662602] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:42.307 [2024-05-14 04:23:56.662606] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:42.307 [2024-05-14 04:23:56.662609] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x975b50) on tqpair=0x90d9e0 00:26:42.307 [2024-05-14 04:23:56.662617] nvme_ctrlr.c:1191:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:26:42.307 0 Kelvin (-273 Celsius) 00:26:42.307 Available Spare: 0% 00:26:42.307 Available Spare Threshold: 0% 00:26:42.307 Life Percentage Used: 0% 00:26:42.307 Data Units Read: 0 00:26:42.307 Data Units Written: 0 00:26:42.307 Host Read Commands: 0 00:26:42.307 Host Write Commands: 0 00:26:42.307 Controller Busy Time: 0 minutes 00:26:42.307 Power Cycles: 0 00:26:42.307 Power On Hours: 0 hours 00:26:42.307 Unsafe Shutdowns: 0 00:26:42.307 Unrecoverable Media Errors: 0 00:26:42.307 Lifetime Error Log Entries: 0 00:26:42.307 Warning Temperature Time: 0 minutes 00:26:42.307 Critical Temperature Time: 0 minutes 00:26:42.307 00:26:42.307 Number of Queues 00:26:42.307 ================ 00:26:42.307 Number of I/O Submission Queues: 127 00:26:42.307 Number of I/O Completion Queues: 127 00:26:42.307 00:26:42.307 Active Namespaces 00:26:42.307 ================= 00:26:42.307 Namespace ID:1 00:26:42.307 Error Recovery Timeout: Unlimited 00:26:42.307 Command Set Identifier: NVM (00h) 00:26:42.307 Deallocate: Supported 00:26:42.307 Deallocated/Unwritten Error: Not Supported 00:26:42.307 Deallocated Read Value: Unknown 00:26:42.307 Deallocate in Write Zeroes: Not Supported 00:26:42.307 Deallocated Guard Field: 0xFFFF 00:26:42.307 Flush: Supported 00:26:42.307 Reservation: Supported 00:26:42.307 Namespace Sharing Capabilities: Multiple Controllers 00:26:42.307 Size (in LBAs): 131072 (0GiB) 00:26:42.307 Capacity (in LBAs): 131072 (0GiB) 00:26:42.307 Utilization (in LBAs): 131072 (0GiB) 00:26:42.307 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:42.307 EUI64: ABCDEF0123456789 00:26:42.307 UUID: a5128f9d-0a7c-4905-8840-d191af422ef7 00:26:42.307 Thin Provisioning: Not Supported 00:26:42.307 Per-NS Atomic Units: Yes 00:26:42.307 Atomic Boundary Size (Normal): 0 00:26:42.307 Atomic Boundary Size (PFail): 0 00:26:42.307 Atomic Boundary Offset: 0 00:26:42.307 Maximum Single Source Range Length: 65535 00:26:42.307 Maximum Copy Length: 65535 00:26:42.307 Maximum Source Range Count: 1 00:26:42.307 NGUID/EUI64 Never Reused: No 00:26:42.307 Namespace Write Protected: No 00:26:42.307 Number of LBA Formats: 1 00:26:42.307 Current LBA Format: LBA Format #00 00:26:42.307 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:42.307 00:26:42.307 04:23:56 -- host/identify.sh@51 -- # sync 00:26:42.307 04:23:56 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:42.307 04:23:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:42.307 04:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:42.307 04:23:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:42.307 04:23:56 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:42.307 04:23:56 -- host/identify.sh@56 -- # nvmftestfini 00:26:42.307 04:23:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:42.307 04:23:56 -- nvmf/common.sh@116 -- # sync 00:26:42.307 04:23:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:42.307 04:23:56 -- nvmf/common.sh@119 -- # set +e 00:26:42.307 04:23:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:42.307 04:23:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:42.307 rmmod nvme_tcp 00:26:42.307 rmmod nvme_fabrics 00:26:42.307 rmmod nvme_keyring 00:26:42.307 04:23:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:42.307 04:23:56 -- nvmf/common.sh@123 -- # set -e 00:26:42.307 04:23:56 -- nvmf/common.sh@124 -- # return 0 00:26:42.307 04:23:56 -- nvmf/common.sh@477 -- # '[' -n 4074113 ']' 00:26:42.307 04:23:56 -- nvmf/common.sh@478 -- # killprocess 4074113 00:26:42.307 04:23:56 -- common/autotest_common.sh@926 -- # '[' -z 4074113 ']' 00:26:42.307 04:23:56 -- common/autotest_common.sh@930 -- # kill -0 4074113 00:26:42.307 04:23:56 -- common/autotest_common.sh@931 -- # uname 00:26:42.307 04:23:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:42.307 04:23:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4074113 00:26:42.307 04:23:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:42.307 04:23:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:42.307 04:23:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4074113' 00:26:42.307 killing process with pid 4074113 00:26:42.307 04:23:56 -- common/autotest_common.sh@945 -- # kill 4074113 00:26:42.307 [2024-05-14 04:23:56.811286] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:42.307 04:23:56 -- common/autotest_common.sh@950 -- # wait 4074113 00:26:42.568 04:23:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:42.568 04:23:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:42.568 04:23:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:42.568 04:23:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:42.568 04:23:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:42.568 04:23:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:42.568 04:23:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:42.568 04:23:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:44.485 04:23:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:44.485 00:26:44.485 real 0m10.986s 00:26:44.485 user 0m8.136s 00:26:44.485 sys 0m5.676s 00:26:44.485 04:23:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:44.485 04:23:59 -- common/autotest_common.sh@10 -- # set +x 00:26:44.485 ************************************ 00:26:44.485 END TEST nvmf_identify 00:26:44.485 ************************************ 00:26:44.485 04:23:59 -- nvmf/nvmf.sh@97 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:44.485 04:23:59 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:44.485 04:23:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:44.485 04:23:59 -- common/autotest_common.sh@10 -- # set +x 00:26:44.747 ************************************ 00:26:44.747 START TEST nvmf_perf 00:26:44.747 ************************************ 00:26:44.747 04:23:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:44.747 * Looking for test storage... 00:26:44.747 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:44.747 04:23:59 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:44.747 04:23:59 -- nvmf/common.sh@7 -- # uname -s 00:26:44.747 04:23:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:44.747 04:23:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:44.747 04:23:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:44.747 04:23:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:44.747 04:23:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:44.747 04:23:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:44.747 04:23:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:44.747 04:23:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:44.747 04:23:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:44.747 04:23:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:44.747 04:23:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:44.747 04:23:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:44.747 04:23:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:44.747 04:23:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:44.747 04:23:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:44.747 04:23:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:44.747 04:23:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:44.747 04:23:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:44.747 04:23:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:44.747 04:23:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.747 04:23:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.747 04:23:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.747 04:23:59 -- paths/export.sh@5 -- # export PATH 00:26:44.747 04:23:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.747 04:23:59 -- nvmf/common.sh@46 -- # : 0 00:26:44.747 04:23:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:44.747 04:23:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:44.747 04:23:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:44.747 04:23:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:44.747 04:23:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:44.747 04:23:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:44.747 04:23:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:44.747 04:23:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:44.747 04:23:59 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:44.747 04:23:59 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:44.747 04:23:59 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:44.747 04:23:59 -- host/perf.sh@17 -- # nvmftestinit 00:26:44.747 04:23:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:44.747 04:23:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:44.747 04:23:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:44.747 04:23:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:44.747 04:23:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:44.747 04:23:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:44.747 04:23:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:44.747 04:23:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:44.747 04:23:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:44.747 04:23:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:44.747 04:23:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:44.747 04:23:59 -- common/autotest_common.sh@10 -- # set +x 00:26:52.925 04:24:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:52.925 04:24:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:52.925 04:24:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:52.925 04:24:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:52.925 04:24:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:52.925 04:24:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:52.925 04:24:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:52.925 04:24:06 -- nvmf/common.sh@294 -- # net_devs=() 00:26:52.925 04:24:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:52.925 04:24:06 -- nvmf/common.sh@295 -- # e810=() 00:26:52.925 04:24:06 -- nvmf/common.sh@295 -- # local -ga e810 00:26:52.925 04:24:06 -- nvmf/common.sh@296 -- # x722=() 00:26:52.925 04:24:06 -- nvmf/common.sh@296 -- # local -ga x722 00:26:52.925 04:24:06 -- nvmf/common.sh@297 -- # mlx=() 00:26:52.925 04:24:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:52.925 04:24:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:52.925 04:24:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:52.925 04:24:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:52.925 04:24:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:52.925 04:24:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:52.925 04:24:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:26:52.925 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:26:52.925 04:24:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:52.925 04:24:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:26:52.925 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:26:52.925 04:24:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:52.925 04:24:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:52.925 04:24:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:52.925 04:24:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:52.925 04:24:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:52.925 04:24:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:26:52.925 Found net devices under 0000:4b:00.0: cvl_0_0 00:26:52.925 04:24:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:52.925 04:24:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:52.925 04:24:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:52.925 04:24:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:52.925 04:24:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:52.925 04:24:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:26:52.925 Found net devices under 0000:4b:00.1: cvl_0_1 00:26:52.925 04:24:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:52.925 04:24:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:52.925 04:24:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:52.925 04:24:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:52.925 04:24:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:52.925 04:24:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:52.925 04:24:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:52.925 04:24:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:52.925 04:24:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:52.925 04:24:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:52.925 04:24:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:52.926 04:24:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:52.926 04:24:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:52.926 04:24:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:52.926 04:24:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:52.926 04:24:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:52.926 04:24:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:52.926 04:24:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:52.926 04:24:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:52.926 04:24:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:52.926 04:24:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:52.926 04:24:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:52.926 04:24:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:52.926 04:24:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:52.926 04:24:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:52.926 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:52.926 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.457 ms 00:26:52.926 00:26:52.926 --- 10.0.0.2 ping statistics --- 00:26:52.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:52.926 rtt min/avg/max/mdev = 0.457/0.457/0.457/0.000 ms 00:26:52.926 04:24:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:52.926 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:52.926 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.507 ms 00:26:52.926 00:26:52.926 --- 10.0.0.1 ping statistics --- 00:26:52.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:52.926 rtt min/avg/max/mdev = 0.507/0.507/0.507/0.000 ms 00:26:52.926 04:24:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:52.926 04:24:06 -- nvmf/common.sh@410 -- # return 0 00:26:52.926 04:24:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:52.926 04:24:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:52.926 04:24:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:52.926 04:24:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:52.926 04:24:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:52.926 04:24:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:52.926 04:24:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:52.926 04:24:06 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:52.926 04:24:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:52.926 04:24:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:52.926 04:24:06 -- common/autotest_common.sh@10 -- # set +x 00:26:52.926 04:24:06 -- nvmf/common.sh@469 -- # nvmfpid=4078715 00:26:52.926 04:24:06 -- nvmf/common.sh@470 -- # waitforlisten 4078715 00:26:52.926 04:24:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:52.926 04:24:06 -- common/autotest_common.sh@819 -- # '[' -z 4078715 ']' 00:26:52.926 04:24:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:52.926 04:24:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:52.926 04:24:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:52.926 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:52.926 04:24:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:52.926 04:24:06 -- common/autotest_common.sh@10 -- # set +x 00:26:52.926 [2024-05-14 04:24:06.471685] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:26:52.926 [2024-05-14 04:24:06.471750] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:52.926 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.926 [2024-05-14 04:24:06.543738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:52.926 [2024-05-14 04:24:06.618466] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:52.926 [2024-05-14 04:24:06.618602] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:52.926 [2024-05-14 04:24:06.618612] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:52.926 [2024-05-14 04:24:06.618620] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:52.926 [2024-05-14 04:24:06.618757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:52.926 [2024-05-14 04:24:06.618859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:52.926 [2024-05-14 04:24:06.619003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:52.926 [2024-05-14 04:24:06.619005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:52.926 04:24:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:52.926 04:24:07 -- common/autotest_common.sh@852 -- # return 0 00:26:52.926 04:24:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:52.926 04:24:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:52.926 04:24:07 -- common/autotest_common.sh@10 -- # set +x 00:26:52.926 04:24:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:52.926 04:24:07 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:52.926 04:24:07 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:53.187 04:24:07 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:53.187 04:24:07 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:53.448 04:24:07 -- host/perf.sh@30 -- # local_nvme_trid=0000:65:00.0 00:26:53.448 04:24:07 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:53.709 04:24:08 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:53.709 04:24:08 -- host/perf.sh@33 -- # '[' -n 0000:65:00.0 ']' 00:26:53.709 04:24:08 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:53.709 04:24:08 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:53.709 04:24:08 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:53.709 [2024-05-14 04:24:08.262535] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:53.709 04:24:08 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:53.969 04:24:08 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:53.969 04:24:08 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:54.230 04:24:08 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:54.230 04:24:08 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:54.230 04:24:08 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:54.491 [2024-05-14 04:24:08.897009] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:54.491 04:24:08 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:54.752 04:24:09 -- host/perf.sh@52 -- # '[' -n 0000:65:00.0 ']' 00:26:54.752 04:24:09 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:65:00.0' 00:26:54.752 04:24:09 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:54.752 04:24:09 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:65:00.0' 00:26:56.140 Initializing NVMe Controllers 00:26:56.140 Attached to NVMe Controller at 0000:65:00.0 [144d:a80a] 00:26:56.140 Associating PCIE (0000:65:00.0) NSID 1 with lcore 0 00:26:56.140 Initialization complete. Launching workers. 00:26:56.140 ======================================================== 00:26:56.140 Latency(us) 00:26:56.140 Device Information : IOPS MiB/s Average min max 00:26:56.140 PCIE (0000:65:00.0) NSID 1 from core 0: 80671.75 315.12 396.03 13.22 6200.10 00:26:56.140 ======================================================== 00:26:56.140 Total : 80671.75 315.12 396.03 13.22 6200.10 00:26:56.140 00:26:56.140 04:24:10 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:56.140 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.083 Initializing NVMe Controllers 00:26:57.083 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:57.083 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:57.083 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:57.083 Initialization complete. Launching workers. 00:26:57.083 ======================================================== 00:26:57.083 Latency(us) 00:26:57.083 Device Information : IOPS MiB/s Average min max 00:26:57.083 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 76.00 0.30 13342.57 628.64 45418.94 00:26:57.083 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 41.00 0.16 24487.63 5987.29 47908.64 00:26:57.083 ======================================================== 00:26:57.083 Total : 117.00 0.46 17248.10 628.64 47908.64 00:26:57.083 00:26:57.083 04:24:11 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:57.083 EAL: No free 2048 kB hugepages reported on node 1 00:26:58.469 Initializing NVMe Controllers 00:26:58.469 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:58.469 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:58.469 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:58.469 Initialization complete. Launching workers. 00:26:58.469 ======================================================== 00:26:58.469 Latency(us) 00:26:58.469 Device Information : IOPS MiB/s Average min max 00:26:58.469 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7583.59 29.62 4219.87 777.59 11697.74 00:26:58.469 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3798.79 14.84 8425.43 7205.25 18862.92 00:26:58.469 ======================================================== 00:26:58.469 Total : 11382.38 44.46 5623.44 777.59 18862.92 00:26:58.469 00:26:58.469 04:24:12 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:58.469 04:24:12 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:58.469 04:24:12 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:58.469 EAL: No free 2048 kB hugepages reported on node 1 00:27:01.017 Initializing NVMe Controllers 00:27:01.017 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:01.017 Controller IO queue size 128, less than required. 00:27:01.017 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:01.017 Controller IO queue size 128, less than required. 00:27:01.017 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:01.017 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:01.017 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:01.017 Initialization complete. Launching workers. 00:27:01.017 ======================================================== 00:27:01.017 Latency(us) 00:27:01.017 Device Information : IOPS MiB/s Average min max 00:27:01.017 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 805.32 201.33 164060.79 83042.62 242431.84 00:27:01.017 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 547.88 136.97 242127.82 77656.33 320642.51 00:27:01.017 ======================================================== 00:27:01.017 Total : 1353.20 338.30 195668.27 77656.33 320642.51 00:27:01.017 00:27:01.017 04:24:15 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:27:01.017 EAL: No free 2048 kB hugepages reported on node 1 00:27:01.017 No valid NVMe controllers or AIO or URING devices found 00:27:01.017 Initializing NVMe Controllers 00:27:01.017 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:01.017 Controller IO queue size 128, less than required. 00:27:01.017 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:01.017 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:27:01.017 Controller IO queue size 128, less than required. 00:27:01.017 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:01.017 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:27:01.017 WARNING: Some requested NVMe devices were skipped 00:27:01.017 04:24:15 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:27:01.017 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.566 Initializing NVMe Controllers 00:27:03.566 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:03.566 Controller IO queue size 128, less than required. 00:27:03.566 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:03.566 Controller IO queue size 128, less than required. 00:27:03.566 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:03.566 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:03.566 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:03.566 Initialization complete. Launching workers. 00:27:03.566 00:27:03.566 ==================== 00:27:03.566 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:27:03.566 TCP transport: 00:27:03.566 polls: 40791 00:27:03.566 idle_polls: 16718 00:27:03.566 sock_completions: 24073 00:27:03.566 nvme_completions: 3313 00:27:03.566 submitted_requests: 5201 00:27:03.566 queued_requests: 1 00:27:03.566 00:27:03.566 ==================== 00:27:03.566 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:27:03.566 TCP transport: 00:27:03.566 polls: 41147 00:27:03.566 idle_polls: 15423 00:27:03.566 sock_completions: 25724 00:27:03.566 nvme_completions: 3085 00:27:03.566 submitted_requests: 4734 00:27:03.566 queued_requests: 1 00:27:03.566 ======================================================== 00:27:03.566 Latency(us) 00:27:03.566 Device Information : IOPS MiB/s Average min max 00:27:03.566 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 891.86 222.97 147105.57 74911.23 241599.40 00:27:03.566 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 834.87 208.72 157816.37 68576.30 217671.85 00:27:03.566 ======================================================== 00:27:03.566 Total : 1726.73 431.68 152284.21 68576.30 241599.40 00:27:03.566 00:27:03.566 04:24:18 -- host/perf.sh@66 -- # sync 00:27:03.566 04:24:18 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:03.827 04:24:18 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:27:03.827 04:24:18 -- host/perf.sh@71 -- # '[' -n 0000:65:00.0 ']' 00:27:03.827 04:24:18 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:27:04.771 04:24:19 -- host/perf.sh@72 -- # ls_guid=edce7988-22bd-4ad0-a629-0494fc250ad5 00:27:04.771 04:24:19 -- host/perf.sh@73 -- # get_lvs_free_mb edce7988-22bd-4ad0-a629-0494fc250ad5 00:27:04.771 04:24:19 -- common/autotest_common.sh@1343 -- # local lvs_uuid=edce7988-22bd-4ad0-a629-0494fc250ad5 00:27:04.771 04:24:19 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:04.771 04:24:19 -- common/autotest_common.sh@1345 -- # local fc 00:27:04.771 04:24:19 -- common/autotest_common.sh@1346 -- # local cs 00:27:04.771 04:24:19 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:05.032 04:24:19 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:05.032 { 00:27:05.032 "uuid": "edce7988-22bd-4ad0-a629-0494fc250ad5", 00:27:05.032 "name": "lvs_0", 00:27:05.032 "base_bdev": "Nvme0n1", 00:27:05.032 "total_data_clusters": 457407, 00:27:05.032 "free_clusters": 457407, 00:27:05.032 "block_size": 512, 00:27:05.032 "cluster_size": 4194304 00:27:05.032 } 00:27:05.032 ]' 00:27:05.032 04:24:19 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="edce7988-22bd-4ad0-a629-0494fc250ad5") .free_clusters' 00:27:05.032 04:24:19 -- common/autotest_common.sh@1348 -- # fc=457407 00:27:05.032 04:24:19 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="edce7988-22bd-4ad0-a629-0494fc250ad5") .cluster_size' 00:27:05.032 04:24:19 -- common/autotest_common.sh@1349 -- # cs=4194304 00:27:05.032 04:24:19 -- common/autotest_common.sh@1352 -- # free_mb=1829628 00:27:05.032 04:24:19 -- common/autotest_common.sh@1353 -- # echo 1829628 00:27:05.032 1829628 00:27:05.032 04:24:19 -- host/perf.sh@77 -- # '[' 1829628 -gt 20480 ']' 00:27:05.032 04:24:19 -- host/perf.sh@78 -- # free_mb=20480 00:27:05.032 04:24:19 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u edce7988-22bd-4ad0-a629-0494fc250ad5 lbd_0 20480 00:27:05.293 04:24:19 -- host/perf.sh@80 -- # lb_guid=29bc3831-3480-40f4-96e5-249749e05145 00:27:05.293 04:24:19 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 29bc3831-3480-40f4-96e5-249749e05145 lvs_n_0 00:27:07.209 04:24:21 -- host/perf.sh@83 -- # ls_nested_guid=50892668-5ecc-456b-b1b3-f02e8b845b60 00:27:07.209 04:24:21 -- host/perf.sh@84 -- # get_lvs_free_mb 50892668-5ecc-456b-b1b3-f02e8b845b60 00:27:07.209 04:24:21 -- common/autotest_common.sh@1343 -- # local lvs_uuid=50892668-5ecc-456b-b1b3-f02e8b845b60 00:27:07.209 04:24:21 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:07.209 04:24:21 -- common/autotest_common.sh@1345 -- # local fc 00:27:07.209 04:24:21 -- common/autotest_common.sh@1346 -- # local cs 00:27:07.209 04:24:21 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:07.209 04:24:21 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:07.209 { 00:27:07.209 "uuid": "edce7988-22bd-4ad0-a629-0494fc250ad5", 00:27:07.209 "name": "lvs_0", 00:27:07.209 "base_bdev": "Nvme0n1", 00:27:07.209 "total_data_clusters": 457407, 00:27:07.209 "free_clusters": 452287, 00:27:07.209 "block_size": 512, 00:27:07.209 "cluster_size": 4194304 00:27:07.209 }, 00:27:07.209 { 00:27:07.209 "uuid": "50892668-5ecc-456b-b1b3-f02e8b845b60", 00:27:07.209 "name": "lvs_n_0", 00:27:07.209 "base_bdev": "29bc3831-3480-40f4-96e5-249749e05145", 00:27:07.209 "total_data_clusters": 5114, 00:27:07.209 "free_clusters": 5114, 00:27:07.209 "block_size": 512, 00:27:07.209 "cluster_size": 4194304 00:27:07.209 } 00:27:07.209 ]' 00:27:07.209 04:24:21 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="50892668-5ecc-456b-b1b3-f02e8b845b60") .free_clusters' 00:27:07.209 04:24:21 -- common/autotest_common.sh@1348 -- # fc=5114 00:27:07.209 04:24:21 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="50892668-5ecc-456b-b1b3-f02e8b845b60") .cluster_size' 00:27:07.209 04:24:21 -- common/autotest_common.sh@1349 -- # cs=4194304 00:27:07.209 04:24:21 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:27:07.209 04:24:21 -- common/autotest_common.sh@1353 -- # echo 20456 00:27:07.209 20456 00:27:07.209 04:24:21 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:27:07.209 04:24:21 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 50892668-5ecc-456b-b1b3-f02e8b845b60 lbd_nest_0 20456 00:27:07.209 04:24:21 -- host/perf.sh@88 -- # lb_nested_guid=e888ac86-254e-4478-8730-74d42a1e35fa 00:27:07.209 04:24:21 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:07.470 04:24:21 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:27:07.470 04:24:21 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 e888ac86-254e-4478-8730-74d42a1e35fa 00:27:07.731 04:24:22 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:07.731 04:24:22 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:27:07.731 04:24:22 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:27:07.731 04:24:22 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:07.731 04:24:22 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:07.731 04:24:22 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:07.731 EAL: No free 2048 kB hugepages reported on node 1 00:27:20.040 Initializing NVMe Controllers 00:27:20.040 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:20.040 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:20.040 Initialization complete. Launching workers. 00:27:20.040 ======================================================== 00:27:20.040 Latency(us) 00:27:20.040 Device Information : IOPS MiB/s Average min max 00:27:20.040 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 48.28 0.02 20750.77 285.18 45262.10 00:27:20.040 ======================================================== 00:27:20.040 Total : 48.28 0.02 20750.77 285.18 45262.10 00:27:20.040 00:27:20.040 04:24:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:20.040 04:24:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:20.040 EAL: No free 2048 kB hugepages reported on node 1 00:27:30.041 Initializing NVMe Controllers 00:27:30.041 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:30.041 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:30.041 Initialization complete. Launching workers. 00:27:30.041 ======================================================== 00:27:30.041 Latency(us) 00:27:30.041 Device Information : IOPS MiB/s Average min max 00:27:30.041 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 74.40 9.30 13446.58 6005.62 51881.63 00:27:30.041 ======================================================== 00:27:30.041 Total : 74.40 9.30 13446.58 6005.62 51881.63 00:27:30.041 00:27:30.041 04:24:42 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:30.041 04:24:42 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:30.041 04:24:42 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:30.041 EAL: No free 2048 kB hugepages reported on node 1 00:27:40.045 Initializing NVMe Controllers 00:27:40.045 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:40.045 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:40.045 Initialization complete. Launching workers. 00:27:40.045 ======================================================== 00:27:40.045 Latency(us) 00:27:40.045 Device Information : IOPS MiB/s Average min max 00:27:40.045 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8398.10 4.10 3820.98 465.03 47923.33 00:27:40.045 ======================================================== 00:27:40.045 Total : 8398.10 4.10 3820.98 465.03 47923.33 00:27:40.045 00:27:40.045 04:24:53 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:40.045 04:24:53 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:40.045 EAL: No free 2048 kB hugepages reported on node 1 00:27:50.047 Initializing NVMe Controllers 00:27:50.047 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:50.047 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:50.047 Initialization complete. Launching workers. 00:27:50.047 ======================================================== 00:27:50.047 Latency(us) 00:27:50.047 Device Information : IOPS MiB/s Average min max 00:27:50.047 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1599.25 199.91 20019.98 1145.05 46389.81 00:27:50.047 ======================================================== 00:27:50.047 Total : 1599.25 199.91 20019.98 1145.05 46389.81 00:27:50.047 00:27:50.047 04:25:03 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:50.047 04:25:03 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:50.047 04:25:03 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:50.047 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.098 Initializing NVMe Controllers 00:28:00.098 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:00.098 Controller IO queue size 128, less than required. 00:28:00.098 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:00.098 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:00.098 Initialization complete. Launching workers. 00:28:00.098 ======================================================== 00:28:00.098 Latency(us) 00:28:00.098 Device Information : IOPS MiB/s Average min max 00:28:00.098 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15855.00 7.74 8077.57 1850.05 19391.51 00:28:00.098 ======================================================== 00:28:00.098 Total : 15855.00 7.74 8077.57 1850.05 19391.51 00:28:00.098 00:28:00.098 04:25:13 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:00.098 04:25:13 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:00.098 EAL: No free 2048 kB hugepages reported on node 1 00:28:10.102 Initializing NVMe Controllers 00:28:10.102 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:10.102 Controller IO queue size 128, less than required. 00:28:10.102 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:10.102 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:10.102 Initialization complete. Launching workers. 00:28:10.102 ======================================================== 00:28:10.102 Latency(us) 00:28:10.102 Device Information : IOPS MiB/s Average min max 00:28:10.102 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1137.20 142.15 113667.53 12389.15 236377.45 00:28:10.102 ======================================================== 00:28:10.102 Total : 1137.20 142.15 113667.53 12389.15 236377.45 00:28:10.102 00:28:10.102 04:25:24 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:10.102 04:25:24 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e888ac86-254e-4478-8730-74d42a1e35fa 00:28:11.488 04:25:25 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:11.748 04:25:26 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 29bc3831-3480-40f4-96e5-249749e05145 00:28:12.010 04:25:26 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:12.010 04:25:26 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:28:12.010 04:25:26 -- host/perf.sh@114 -- # nvmftestfini 00:28:12.010 04:25:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:12.010 04:25:26 -- nvmf/common.sh@116 -- # sync 00:28:12.010 04:25:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:12.010 04:25:26 -- nvmf/common.sh@119 -- # set +e 00:28:12.010 04:25:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:12.010 04:25:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:12.010 rmmod nvme_tcp 00:28:12.010 rmmod nvme_fabrics 00:28:12.010 rmmod nvme_keyring 00:28:12.010 04:25:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:12.010 04:25:26 -- nvmf/common.sh@123 -- # set -e 00:28:12.010 04:25:26 -- nvmf/common.sh@124 -- # return 0 00:28:12.010 04:25:26 -- nvmf/common.sh@477 -- # '[' -n 4078715 ']' 00:28:12.010 04:25:26 -- nvmf/common.sh@478 -- # killprocess 4078715 00:28:12.010 04:25:26 -- common/autotest_common.sh@926 -- # '[' -z 4078715 ']' 00:28:12.010 04:25:26 -- common/autotest_common.sh@930 -- # kill -0 4078715 00:28:12.010 04:25:26 -- common/autotest_common.sh@931 -- # uname 00:28:12.010 04:25:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:12.010 04:25:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4078715 00:28:12.271 04:25:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:12.271 04:25:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:12.271 04:25:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4078715' 00:28:12.271 killing process with pid 4078715 00:28:12.271 04:25:26 -- common/autotest_common.sh@945 -- # kill 4078715 00:28:12.271 04:25:26 -- common/autotest_common.sh@950 -- # wait 4078715 00:28:14.187 04:25:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:14.187 04:25:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:14.187 04:25:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:14.187 04:25:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:14.187 04:25:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:14.187 04:25:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:14.187 04:25:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:14.187 04:25:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:16.103 04:25:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:16.103 00:28:16.103 real 1m31.606s 00:28:16.103 user 5m24.746s 00:28:16.103 sys 0m13.143s 00:28:16.103 04:25:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:16.103 04:25:30 -- common/autotest_common.sh@10 -- # set +x 00:28:16.103 ************************************ 00:28:16.103 END TEST nvmf_perf 00:28:16.103 ************************************ 00:28:16.364 04:25:30 -- nvmf/nvmf.sh@98 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:28:16.364 04:25:30 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:16.364 04:25:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:16.364 04:25:30 -- common/autotest_common.sh@10 -- # set +x 00:28:16.364 ************************************ 00:28:16.364 START TEST nvmf_fio_host 00:28:16.364 ************************************ 00:28:16.364 04:25:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:28:16.364 * Looking for test storage... 00:28:16.364 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:16.364 04:25:30 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:16.364 04:25:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:16.364 04:25:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:16.364 04:25:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:16.364 04:25:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:16.364 04:25:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:16.364 04:25:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:16.364 04:25:30 -- paths/export.sh@5 -- # export PATH 00:28:16.364 04:25:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:16.364 04:25:30 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:16.364 04:25:30 -- nvmf/common.sh@7 -- # uname -s 00:28:16.364 04:25:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:16.364 04:25:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:16.364 04:25:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:16.364 04:25:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:16.364 04:25:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:16.364 04:25:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:16.364 04:25:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:16.364 04:25:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:16.364 04:25:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:16.364 04:25:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:16.364 04:25:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:28:16.364 04:25:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:28:16.364 04:25:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:16.364 04:25:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:16.364 04:25:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:16.364 04:25:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:16.364 04:25:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:16.364 04:25:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:16.364 04:25:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:16.364 04:25:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:16.365 04:25:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:16.365 04:25:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:16.365 04:25:30 -- paths/export.sh@5 -- # export PATH 00:28:16.365 04:25:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:16.365 04:25:30 -- nvmf/common.sh@46 -- # : 0 00:28:16.365 04:25:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:16.365 04:25:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:16.365 04:25:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:16.365 04:25:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:16.365 04:25:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:16.365 04:25:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:16.365 04:25:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:16.365 04:25:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:16.365 04:25:30 -- host/fio.sh@12 -- # nvmftestinit 00:28:16.365 04:25:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:16.365 04:25:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:16.365 04:25:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:16.365 04:25:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:16.365 04:25:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:16.365 04:25:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:16.365 04:25:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:16.365 04:25:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:16.365 04:25:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:16.365 04:25:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:16.365 04:25:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:16.365 04:25:30 -- common/autotest_common.sh@10 -- # set +x 00:28:24.510 04:25:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:24.510 04:25:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:24.510 04:25:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:24.510 04:25:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:24.510 04:25:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:24.510 04:25:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:24.510 04:25:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:24.510 04:25:37 -- nvmf/common.sh@294 -- # net_devs=() 00:28:24.510 04:25:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:24.510 04:25:37 -- nvmf/common.sh@295 -- # e810=() 00:28:24.510 04:25:37 -- nvmf/common.sh@295 -- # local -ga e810 00:28:24.510 04:25:37 -- nvmf/common.sh@296 -- # x722=() 00:28:24.510 04:25:37 -- nvmf/common.sh@296 -- # local -ga x722 00:28:24.510 04:25:37 -- nvmf/common.sh@297 -- # mlx=() 00:28:24.510 04:25:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:24.510 04:25:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:24.510 04:25:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:24.510 04:25:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:24.510 04:25:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:24.510 04:25:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:24.510 04:25:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:28:24.510 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:28:24.510 04:25:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:24.510 04:25:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:28:24.510 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:28:24.510 04:25:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:24.510 04:25:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:24.510 04:25:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:24.511 04:25:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:24.511 04:25:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:24.511 04:25:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:24.511 04:25:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:24.511 04:25:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:28:24.511 Found net devices under 0000:4b:00.0: cvl_0_0 00:28:24.511 04:25:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:24.511 04:25:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:24.511 04:25:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:24.511 04:25:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:24.511 04:25:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:24.511 04:25:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:28:24.511 Found net devices under 0000:4b:00.1: cvl_0_1 00:28:24.511 04:25:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:24.511 04:25:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:24.511 04:25:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:24.511 04:25:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:24.511 04:25:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:24.511 04:25:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:24.511 04:25:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:24.511 04:25:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:24.511 04:25:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:24.511 04:25:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:24.511 04:25:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:24.511 04:25:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:24.511 04:25:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:24.511 04:25:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:24.511 04:25:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:24.511 04:25:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:24.511 04:25:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:24.511 04:25:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:24.511 04:25:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:24.511 04:25:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:24.511 04:25:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:24.511 04:25:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:24.511 04:25:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:24.511 04:25:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:24.511 04:25:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:24.511 04:25:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:24.511 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:24.511 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.533 ms 00:28:24.511 00:28:24.511 --- 10.0.0.2 ping statistics --- 00:28:24.511 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:24.511 rtt min/avg/max/mdev = 0.533/0.533/0.533/0.000 ms 00:28:24.511 04:25:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:24.511 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:24.511 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.439 ms 00:28:24.511 00:28:24.511 --- 10.0.0.1 ping statistics --- 00:28:24.511 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:24.511 rtt min/avg/max/mdev = 0.439/0.439/0.439/0.000 ms 00:28:24.511 04:25:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:24.511 04:25:37 -- nvmf/common.sh@410 -- # return 0 00:28:24.511 04:25:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:24.511 04:25:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:24.511 04:25:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:24.511 04:25:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:24.511 04:25:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:24.511 04:25:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:24.511 04:25:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:24.511 04:25:37 -- host/fio.sh@14 -- # [[ y != y ]] 00:28:24.511 04:25:37 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:28:24.511 04:25:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:24.511 04:25:37 -- common/autotest_common.sh@10 -- # set +x 00:28:24.511 04:25:37 -- host/fio.sh@22 -- # nvmfpid=4099162 00:28:24.511 04:25:37 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:24.511 04:25:37 -- host/fio.sh@21 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:28:24.511 04:25:37 -- host/fio.sh@26 -- # waitforlisten 4099162 00:28:24.511 04:25:37 -- common/autotest_common.sh@819 -- # '[' -z 4099162 ']' 00:28:24.511 04:25:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:24.511 04:25:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:24.511 04:25:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:24.511 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:24.511 04:25:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:24.511 04:25:37 -- common/autotest_common.sh@10 -- # set +x 00:28:24.511 [2024-05-14 04:25:38.002498] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:28:24.511 [2024-05-14 04:25:38.002586] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:24.511 EAL: No free 2048 kB hugepages reported on node 1 00:28:24.511 [2024-05-14 04:25:38.073923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:24.511 [2024-05-14 04:25:38.147192] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:24.511 [2024-05-14 04:25:38.147330] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:24.511 [2024-05-14 04:25:38.147340] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:24.511 [2024-05-14 04:25:38.147349] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:24.511 [2024-05-14 04:25:38.147419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:24.511 [2024-05-14 04:25:38.147589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:24.511 [2024-05-14 04:25:38.147752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:24.511 [2024-05-14 04:25:38.147753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:24.511 04:25:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:24.511 04:25:38 -- common/autotest_common.sh@852 -- # return 0 00:28:24.511 04:25:38 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:24.511 04:25:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:24.511 04:25:38 -- common/autotest_common.sh@10 -- # set +x 00:28:24.511 [2024-05-14 04:25:38.779365] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:24.511 04:25:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:24.511 04:25:38 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:28:24.511 04:25:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:24.511 04:25:38 -- common/autotest_common.sh@10 -- # set +x 00:28:24.511 04:25:38 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:28:24.511 04:25:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:24.511 04:25:38 -- common/autotest_common.sh@10 -- # set +x 00:28:24.511 Malloc1 00:28:24.511 04:25:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:24.511 04:25:38 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:24.511 04:25:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:24.511 04:25:38 -- common/autotest_common.sh@10 -- # set +x 00:28:24.511 04:25:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:24.511 04:25:38 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:28:24.511 04:25:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:24.511 04:25:38 -- common/autotest_common.sh@10 -- # set +x 00:28:24.511 04:25:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:24.511 04:25:38 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:24.511 04:25:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:24.511 04:25:38 -- common/autotest_common.sh@10 -- # set +x 00:28:24.511 [2024-05-14 04:25:38.878875] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:24.511 04:25:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:24.511 04:25:38 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:24.511 04:25:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:24.511 04:25:38 -- common/autotest_common.sh@10 -- # set +x 00:28:24.511 04:25:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:24.511 04:25:38 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:28:24.511 04:25:38 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:24.511 04:25:38 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:24.511 04:25:38 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:24.511 04:25:38 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:24.511 04:25:38 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:24.511 04:25:38 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:24.511 04:25:38 -- common/autotest_common.sh@1320 -- # shift 00:28:24.511 04:25:38 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:24.511 04:25:38 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:24.511 04:25:38 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:24.511 04:25:38 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:24.511 04:25:38 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:24.511 04:25:38 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:24.511 04:25:38 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:24.511 04:25:38 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:24.511 04:25:38 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:24.511 04:25:38 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:24.511 04:25:38 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:24.511 04:25:38 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:24.511 04:25:38 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:24.512 04:25:38 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:24.512 04:25:38 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:24.772 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:24.772 fio-3.35 00:28:24.772 Starting 1 thread 00:28:24.772 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.315 00:28:27.315 test: (groupid=0, jobs=1): err= 0: pid=4099554: Tue May 14 04:25:41 2024 00:28:27.315 read: IOPS=11.7k, BW=45.5MiB/s (47.7MB/s)(91.2MiB/2003msec) 00:28:27.315 slat (usec): min=2, max=289, avg= 2.17, stdev= 2.61 00:28:27.315 clat (usec): min=2465, max=8948, avg=6316.84, stdev=962.99 00:28:27.315 lat (usec): min=2467, max=8950, avg=6319.01, stdev=962.94 00:28:27.315 clat percentiles (usec): 00:28:27.315 | 1.00th=[ 3752], 5.00th=[ 4490], 10.00th=[ 4817], 20.00th=[ 5473], 00:28:27.315 | 30.00th=[ 5997], 40.00th=[ 6325], 50.00th=[ 6521], 60.00th=[ 6718], 00:28:27.315 | 70.00th=[ 6915], 80.00th=[ 7111], 90.00th=[ 7373], 95.00th=[ 7570], 00:28:27.315 | 99.00th=[ 8029], 99.50th=[ 8225], 99.90th=[ 8586], 99.95th=[ 8848], 00:28:27.315 | 99.99th=[ 8979] 00:28:27.315 bw ( KiB/s): min=40328, max=57192, per=99.81%, avg=46512.00, stdev=7641.83, samples=4 00:28:27.315 iops : min=10082, max=14298, avg=11628.00, stdev=1910.46, samples=4 00:28:27.315 write: IOPS=11.6k, BW=45.2MiB/s (47.4MB/s)(90.5MiB/2003msec); 0 zone resets 00:28:27.315 slat (usec): min=2, max=243, avg= 2.26, stdev= 1.78 00:28:27.315 clat (usec): min=1877, max=6984, avg=4640.77, stdev=1115.43 00:28:27.315 lat (usec): min=1879, max=6986, avg=4643.03, stdev=1115.45 00:28:27.315 clat percentiles (usec): 00:28:27.315 | 1.00th=[ 2376], 5.00th=[ 2737], 10.00th=[ 2999], 20.00th=[ 3392], 00:28:27.315 | 30.00th=[ 3851], 40.00th=[ 4490], 50.00th=[ 5080], 60.00th=[ 5276], 00:28:27.315 | 70.00th=[ 5473], 80.00th=[ 5669], 90.00th=[ 5866], 95.00th=[ 6063], 00:28:27.315 | 99.00th=[ 6325], 99.50th=[ 6521], 99.90th=[ 6718], 99.95th=[ 6783], 00:28:27.315 | 99.99th=[ 6915] 00:28:27.315 bw ( KiB/s): min=40864, max=56208, per=99.95%, avg=46244.00, stdev=7217.00, samples=4 00:28:27.315 iops : min=10216, max=14052, avg=11561.00, stdev=1804.25, samples=4 00:28:27.315 lat (msec) : 2=0.02%, 4=17.56%, 10=82.42% 00:28:27.315 cpu : usr=64.09%, sys=27.72%, ctx=17, majf=0, minf=6 00:28:27.315 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:28:27.315 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:27.315 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:27.315 issued rwts: total=23336,23169,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:27.315 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:27.315 00:28:27.315 Run status group 0 (all jobs): 00:28:27.315 READ: bw=45.5MiB/s (47.7MB/s), 45.5MiB/s-45.5MiB/s (47.7MB/s-47.7MB/s), io=91.2MiB (95.6MB), run=2003-2003msec 00:28:27.315 WRITE: bw=45.2MiB/s (47.4MB/s), 45.2MiB/s-45.2MiB/s (47.4MB/s-47.4MB/s), io=90.5MiB (94.9MB), run=2003-2003msec 00:28:27.315 04:25:41 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:27.315 04:25:41 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:27.315 04:25:41 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:27.315 04:25:41 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:27.315 04:25:41 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:27.315 04:25:41 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:27.315 04:25:41 -- common/autotest_common.sh@1320 -- # shift 00:28:27.315 04:25:41 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:27.315 04:25:41 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:27.316 04:25:41 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:27.316 04:25:41 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:27.316 04:25:41 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:27.316 04:25:41 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:27.316 04:25:41 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:27.316 04:25:41 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:27.316 04:25:41 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:27.316 04:25:41 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:27.316 04:25:41 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:27.316 04:25:41 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:27.316 04:25:41 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:27.316 04:25:41 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:27.316 04:25:41 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:28:27.576 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:28:27.576 fio-3.35 00:28:27.576 Starting 1 thread 00:28:27.576 EAL: No free 2048 kB hugepages reported on node 1 00:28:30.138 00:28:30.138 test: (groupid=0, jobs=1): err= 0: pid=4100362: Tue May 14 04:25:44 2024 00:28:30.138 read: IOPS=8512, BW=133MiB/s (139MB/s)(268MiB/2014msec) 00:28:30.138 slat (usec): min=3, max=118, avg= 3.69, stdev= 1.94 00:28:30.139 clat (usec): min=1269, max=54374, avg=9515.93, stdev=4530.36 00:28:30.139 lat (usec): min=1273, max=54378, avg=9519.62, stdev=4530.67 00:28:30.139 clat percentiles (usec): 00:28:30.139 | 1.00th=[ 4359], 5.00th=[ 5407], 10.00th=[ 5997], 20.00th=[ 6915], 00:28:30.139 | 30.00th=[ 7570], 40.00th=[ 8291], 50.00th=[ 8848], 60.00th=[ 9503], 00:28:30.139 | 70.00th=[10290], 80.00th=[11076], 90.00th=[13042], 95.00th=[14877], 00:28:30.139 | 99.00th=[24773], 99.50th=[49546], 99.90th=[53216], 99.95th=[53740], 00:28:30.139 | 99.99th=[54264] 00:28:30.139 bw ( KiB/s): min=57344, max=76608, per=49.90%, avg=67960.00, stdev=9560.97, samples=4 00:28:30.139 iops : min= 3584, max= 4788, avg=4247.50, stdev=597.56, samples=4 00:28:30.139 write: IOPS=4872, BW=76.1MiB/s (79.8MB/s)(137MiB/1803msec); 0 zone resets 00:28:30.139 slat (usec): min=40, max=446, avg=41.25, stdev= 9.04 00:28:30.139 clat (usec): min=2796, max=28071, avg=9839.58, stdev=2386.32 00:28:30.139 lat (usec): min=2837, max=28115, avg=9880.83, stdev=2389.70 00:28:30.139 clat percentiles (usec): 00:28:30.139 | 1.00th=[ 6259], 5.00th=[ 6980], 10.00th=[ 7504], 20.00th=[ 8225], 00:28:30.139 | 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9503], 60.00th=[ 9896], 00:28:30.139 | 70.00th=[10552], 80.00th=[11076], 90.00th=[12125], 95.00th=[13173], 00:28:30.139 | 99.00th=[20579], 99.50th=[25297], 99.90th=[25560], 99.95th=[25560], 00:28:30.139 | 99.99th=[28181] 00:28:30.139 bw ( KiB/s): min=58880, max=79872, per=90.15%, avg=70280.00, stdev=10437.44, samples=4 00:28:30.139 iops : min= 3680, max= 4992, avg=4392.50, stdev=652.34, samples=4 00:28:30.139 lat (msec) : 2=0.04%, 4=0.38%, 10=64.37%, 20=34.05%, 50=0.86% 00:28:30.139 lat (msec) : 100=0.30% 00:28:30.139 cpu : usr=79.78%, sys=15.15%, ctx=12, majf=0, minf=5 00:28:30.139 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:28:30.139 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:30.139 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:30.139 issued rwts: total=17144,8785,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:30.139 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:30.139 00:28:30.139 Run status group 0 (all jobs): 00:28:30.139 READ: bw=133MiB/s (139MB/s), 133MiB/s-133MiB/s (139MB/s-139MB/s), io=268MiB (281MB), run=2014-2014msec 00:28:30.139 WRITE: bw=76.1MiB/s (79.8MB/s), 76.1MiB/s-76.1MiB/s (79.8MB/s-79.8MB/s), io=137MiB (144MB), run=1803-1803msec 00:28:30.139 04:25:44 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:30.139 04:25:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.139 04:25:44 -- common/autotest_common.sh@10 -- # set +x 00:28:30.139 04:25:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.139 04:25:44 -- host/fio.sh@47 -- # '[' 1 -eq 1 ']' 00:28:30.139 04:25:44 -- host/fio.sh@49 -- # bdfs=($(get_nvme_bdfs)) 00:28:30.139 04:25:44 -- host/fio.sh@49 -- # get_nvme_bdfs 00:28:30.139 04:25:44 -- common/autotest_common.sh@1498 -- # bdfs=() 00:28:30.139 04:25:44 -- common/autotest_common.sh@1498 -- # local bdfs 00:28:30.139 04:25:44 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:30.139 04:25:44 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:30.139 04:25:44 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:28:30.139 04:25:44 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:28:30.139 04:25:44 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:65:00.0 00:28:30.139 04:25:44 -- host/fio.sh@50 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:65:00.0 -i 10.0.0.2 00:28:30.139 04:25:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.139 04:25:44 -- common/autotest_common.sh@10 -- # set +x 00:28:30.400 Nvme0n1 00:28:30.400 04:25:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.400 04:25:44 -- host/fio.sh@51 -- # rpc_cmd bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:28:30.400 04:25:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.400 04:25:44 -- common/autotest_common.sh@10 -- # set +x 00:28:30.662 04:25:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.662 04:25:45 -- host/fio.sh@51 -- # ls_guid=608f3790-c9fc-4626-9d5f-e05eb60453d0 00:28:30.662 04:25:45 -- host/fio.sh@52 -- # get_lvs_free_mb 608f3790-c9fc-4626-9d5f-e05eb60453d0 00:28:30.662 04:25:45 -- common/autotest_common.sh@1343 -- # local lvs_uuid=608f3790-c9fc-4626-9d5f-e05eb60453d0 00:28:30.662 04:25:45 -- common/autotest_common.sh@1344 -- # local lvs_info 00:28:30.662 04:25:45 -- common/autotest_common.sh@1345 -- # local fc 00:28:30.662 04:25:45 -- common/autotest_common.sh@1346 -- # local cs 00:28:30.662 04:25:45 -- common/autotest_common.sh@1347 -- # rpc_cmd bdev_lvol_get_lvstores 00:28:30.662 04:25:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.662 04:25:45 -- common/autotest_common.sh@10 -- # set +x 00:28:30.662 04:25:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.662 04:25:45 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:28:30.662 { 00:28:30.662 "uuid": "608f3790-c9fc-4626-9d5f-e05eb60453d0", 00:28:30.662 "name": "lvs_0", 00:28:30.662 "base_bdev": "Nvme0n1", 00:28:30.662 "total_data_clusters": 1787, 00:28:30.662 "free_clusters": 1787, 00:28:30.662 "block_size": 512, 00:28:30.662 "cluster_size": 1073741824 00:28:30.662 } 00:28:30.662 ]' 00:28:30.662 04:25:45 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="608f3790-c9fc-4626-9d5f-e05eb60453d0") .free_clusters' 00:28:30.923 04:25:45 -- common/autotest_common.sh@1348 -- # fc=1787 00:28:30.924 04:25:45 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="608f3790-c9fc-4626-9d5f-e05eb60453d0") .cluster_size' 00:28:30.924 04:25:45 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:28:30.924 04:25:45 -- common/autotest_common.sh@1352 -- # free_mb=1829888 00:28:30.924 04:25:45 -- common/autotest_common.sh@1353 -- # echo 1829888 00:28:30.924 1829888 00:28:30.924 04:25:45 -- host/fio.sh@53 -- # rpc_cmd bdev_lvol_create -l lvs_0 lbd_0 1829888 00:28:30.924 04:25:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.924 04:25:45 -- common/autotest_common.sh@10 -- # set +x 00:28:30.924 ed8e699a-f790-403e-a2dc-c2bdb74df05f 00:28:30.924 04:25:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.924 04:25:45 -- host/fio.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:28:30.924 04:25:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.924 04:25:45 -- common/autotest_common.sh@10 -- # set +x 00:28:30.924 04:25:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.924 04:25:45 -- host/fio.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:28:30.924 04:25:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.924 04:25:45 -- common/autotest_common.sh@10 -- # set +x 00:28:30.924 04:25:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.924 04:25:45 -- host/fio.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:30.924 04:25:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.924 04:25:45 -- common/autotest_common.sh@10 -- # set +x 00:28:30.924 04:25:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.924 04:25:45 -- host/fio.sh@57 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:30.924 04:25:45 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:30.924 04:25:45 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:30.924 04:25:45 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:30.924 04:25:45 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:30.924 04:25:45 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:30.924 04:25:45 -- common/autotest_common.sh@1320 -- # shift 00:28:30.924 04:25:45 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:30.924 04:25:45 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:30.924 04:25:45 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:30.924 04:25:45 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:30.924 04:25:45 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:30.924 04:25:45 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:30.924 04:25:45 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:30.924 04:25:45 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:30.924 04:25:45 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:30.924 04:25:45 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:30.924 04:25:45 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:30.924 04:25:45 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:30.924 04:25:45 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:30.924 04:25:45 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:30.924 04:25:45 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:31.185 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:31.185 fio-3.35 00:28:31.185 Starting 1 thread 00:28:31.445 EAL: No free 2048 kB hugepages reported on node 1 00:28:33.989 00:28:33.989 test: (groupid=0, jobs=1): err= 0: pid=4101231: Tue May 14 04:25:48 2024 00:28:33.989 read: IOPS=11.0k, BW=42.9MiB/s (44.9MB/s)(85.9MiB/2004msec) 00:28:33.989 slat (nsec): min=2047, max=107980, avg=2210.96, stdev=986.90 00:28:33.989 clat (usec): min=2765, max=15059, avg=6601.41, stdev=857.90 00:28:33.989 lat (usec): min=2782, max=15063, avg=6603.62, stdev=857.94 00:28:33.989 clat percentiles (usec): 00:28:33.989 | 1.00th=[ 5014], 5.00th=[ 5473], 10.00th=[ 5669], 20.00th=[ 5997], 00:28:33.989 | 30.00th=[ 6194], 40.00th=[ 6390], 50.00th=[ 6521], 60.00th=[ 6718], 00:28:33.989 | 70.00th=[ 6915], 80.00th=[ 7177], 90.00th=[ 7504], 95.00th=[ 7898], 00:28:33.989 | 99.00th=[ 8979], 99.50th=[10552], 99.90th=[14877], 99.95th=[15008], 00:28:33.989 | 99.99th=[15008] 00:28:33.989 bw ( KiB/s): min=42360, max=44648, per=99.83%, avg=43820.00, stdev=1003.34, samples=4 00:28:33.989 iops : min=10590, max=11162, avg=10955.00, stdev=250.84, samples=4 00:28:33.989 write: IOPS=10.9k, BW=42.7MiB/s (44.8MB/s)(85.7MiB/2004msec); 0 zone resets 00:28:33.989 slat (nsec): min=2117, max=96477, avg=2313.39, stdev=698.62 00:28:33.989 clat (usec): min=2301, max=10168, avg=5002.86, stdev=595.71 00:28:33.989 lat (usec): min=2308, max=10182, avg=5005.17, stdev=595.76 00:28:33.989 clat percentiles (usec): 00:28:33.989 | 1.00th=[ 3523], 5.00th=[ 4047], 10.00th=[ 4293], 20.00th=[ 4555], 00:28:33.989 | 30.00th=[ 4752], 40.00th=[ 4883], 50.00th=[ 5014], 60.00th=[ 5145], 00:28:33.989 | 70.00th=[ 5276], 80.00th=[ 5473], 90.00th=[ 5669], 95.00th=[ 5866], 00:28:33.989 | 99.00th=[ 6325], 99.50th=[ 6652], 99.90th=[ 8717], 99.95th=[ 9110], 00:28:33.989 | 99.99th=[10028] 00:28:33.989 bw ( KiB/s): min=42824, max=44312, per=99.99%, avg=43772.00, stdev=651.84, samples=4 00:28:33.989 iops : min=10706, max=11078, avg=10943.00, stdev=162.96, samples=4 00:28:33.989 lat (msec) : 4=2.16%, 10=97.56%, 20=0.28% 00:28:33.989 cpu : usr=63.85%, sys=28.46%, ctx=22, majf=0, minf=6 00:28:33.989 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:28:33.989 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:33.989 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:33.989 issued rwts: total=21992,21931,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:33.990 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:33.990 00:28:33.990 Run status group 0 (all jobs): 00:28:33.990 READ: bw=42.9MiB/s (44.9MB/s), 42.9MiB/s-42.9MiB/s (44.9MB/s-44.9MB/s), io=85.9MiB (90.1MB), run=2004-2004msec 00:28:33.990 WRITE: bw=42.7MiB/s (44.8MB/s), 42.7MiB/s-42.7MiB/s (44.8MB/s-44.8MB/s), io=85.7MiB (89.8MB), run=2004-2004msec 00:28:33.990 04:25:48 -- host/fio.sh@59 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:33.990 04:25:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:33.990 04:25:48 -- common/autotest_common.sh@10 -- # set +x 00:28:33.990 04:25:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:33.990 04:25:48 -- host/fio.sh@62 -- # rpc_cmd bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:33.990 04:25:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:33.990 04:25:48 -- common/autotest_common.sh@10 -- # set +x 00:28:34.251 04:25:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.251 04:25:48 -- host/fio.sh@62 -- # ls_nested_guid=bf1b42e5-94ab-4372-8ecc-0ab29930c518 00:28:34.251 04:25:48 -- host/fio.sh@63 -- # get_lvs_free_mb bf1b42e5-94ab-4372-8ecc-0ab29930c518 00:28:34.251 04:25:48 -- common/autotest_common.sh@1343 -- # local lvs_uuid=bf1b42e5-94ab-4372-8ecc-0ab29930c518 00:28:34.251 04:25:48 -- common/autotest_common.sh@1344 -- # local lvs_info 00:28:34.251 04:25:48 -- common/autotest_common.sh@1345 -- # local fc 00:28:34.251 04:25:48 -- common/autotest_common.sh@1346 -- # local cs 00:28:34.251 04:25:48 -- common/autotest_common.sh@1347 -- # rpc_cmd bdev_lvol_get_lvstores 00:28:34.251 04:25:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.251 04:25:48 -- common/autotest_common.sh@10 -- # set +x 00:28:34.251 04:25:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.251 04:25:48 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:28:34.251 { 00:28:34.251 "uuid": "608f3790-c9fc-4626-9d5f-e05eb60453d0", 00:28:34.251 "name": "lvs_0", 00:28:34.251 "base_bdev": "Nvme0n1", 00:28:34.251 "total_data_clusters": 1787, 00:28:34.251 "free_clusters": 0, 00:28:34.251 "block_size": 512, 00:28:34.251 "cluster_size": 1073741824 00:28:34.251 }, 00:28:34.251 { 00:28:34.251 "uuid": "bf1b42e5-94ab-4372-8ecc-0ab29930c518", 00:28:34.251 "name": "lvs_n_0", 00:28:34.251 "base_bdev": "ed8e699a-f790-403e-a2dc-c2bdb74df05f", 00:28:34.251 "total_data_clusters": 457025, 00:28:34.251 "free_clusters": 457025, 00:28:34.251 "block_size": 512, 00:28:34.251 "cluster_size": 4194304 00:28:34.251 } 00:28:34.251 ]' 00:28:34.251 04:25:48 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="bf1b42e5-94ab-4372-8ecc-0ab29930c518") .free_clusters' 00:28:34.251 04:25:48 -- common/autotest_common.sh@1348 -- # fc=457025 00:28:34.251 04:25:48 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="bf1b42e5-94ab-4372-8ecc-0ab29930c518") .cluster_size' 00:28:34.511 04:25:48 -- common/autotest_common.sh@1349 -- # cs=4194304 00:28:34.511 04:25:48 -- common/autotest_common.sh@1352 -- # free_mb=1828100 00:28:34.511 04:25:48 -- common/autotest_common.sh@1353 -- # echo 1828100 00:28:34.511 1828100 00:28:34.511 04:25:48 -- host/fio.sh@64 -- # rpc_cmd bdev_lvol_create -l lvs_n_0 lbd_nest_0 1828100 00:28:34.511 04:25:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.511 04:25:48 -- common/autotest_common.sh@10 -- # set +x 00:28:35.479 10412aaa-5f05-427b-af10-e8ca1bd524c7 00:28:35.479 04:25:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.479 04:25:49 -- host/fio.sh@65 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:35.479 04:25:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.479 04:25:49 -- common/autotest_common.sh@10 -- # set +x 00:28:35.479 04:25:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.479 04:25:49 -- host/fio.sh@66 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:35.479 04:25:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.479 04:25:49 -- common/autotest_common.sh@10 -- # set +x 00:28:35.479 04:25:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.479 04:25:49 -- host/fio.sh@67 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:35.479 04:25:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.479 04:25:49 -- common/autotest_common.sh@10 -- # set +x 00:28:35.479 04:25:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.479 04:25:49 -- host/fio.sh@68 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:35.479 04:25:49 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:35.479 04:25:49 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:35.479 04:25:49 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:35.479 04:25:49 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:35.479 04:25:49 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:35.479 04:25:49 -- common/autotest_common.sh@1320 -- # shift 00:28:35.479 04:25:49 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:35.479 04:25:49 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:35.479 04:25:49 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:35.479 04:25:49 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:35.479 04:25:49 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:35.479 04:25:49 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:35.479 04:25:49 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:35.479 04:25:49 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:35.479 04:25:49 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:35.479 04:25:49 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:35.479 04:25:49 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:35.479 04:25:49 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:35.479 04:25:49 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:35.479 04:25:49 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:35.479 04:25:49 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:35.741 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:35.741 fio-3.35 00:28:35.741 Starting 1 thread 00:28:35.741 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.292 00:28:38.292 test: (groupid=0, jobs=1): err= 0: pid=4102254: Tue May 14 04:25:52 2024 00:28:38.292 read: IOPS=9686, BW=37.8MiB/s (39.7MB/s)(75.9MiB/2005msec) 00:28:38.292 slat (usec): min=2, max=107, avg= 2.24, stdev= 1.06 00:28:38.292 clat (usec): min=2795, max=12442, avg=7294.10, stdev=600.29 00:28:38.292 lat (usec): min=2814, max=12445, avg=7296.35, stdev=600.24 00:28:38.292 clat percentiles (usec): 00:28:38.292 | 1.00th=[ 5866], 5.00th=[ 6325], 10.00th=[ 6587], 20.00th=[ 6849], 00:28:38.292 | 30.00th=[ 6980], 40.00th=[ 7177], 50.00th=[ 7308], 60.00th=[ 7439], 00:28:38.292 | 70.00th=[ 7570], 80.00th=[ 7767], 90.00th=[ 8029], 95.00th=[ 8225], 00:28:38.292 | 99.00th=[ 8586], 99.50th=[ 8848], 99.90th=[10290], 99.95th=[11469], 00:28:38.292 | 99.99th=[12387] 00:28:38.292 bw ( KiB/s): min=37328, max=39544, per=99.90%, avg=38710.00, stdev=1010.44, samples=4 00:28:38.292 iops : min= 9332, max= 9886, avg=9677.50, stdev=252.61, samples=4 00:28:38.292 write: IOPS=9698, BW=37.9MiB/s (39.7MB/s)(76.0MiB/2005msec); 0 zone resets 00:28:38.292 slat (nsec): min=2148, max=95773, avg=2347.16, stdev=733.35 00:28:38.292 clat (usec): min=1454, max=10292, avg=5802.96, stdev=517.90 00:28:38.292 lat (usec): min=1461, max=10294, avg=5805.31, stdev=517.89 00:28:38.292 clat percentiles (usec): 00:28:38.292 | 1.00th=[ 4621], 5.00th=[ 5014], 10.00th=[ 5145], 20.00th=[ 5407], 00:28:38.292 | 30.00th=[ 5538], 40.00th=[ 5669], 50.00th=[ 5800], 60.00th=[ 5932], 00:28:38.292 | 70.00th=[ 6063], 80.00th=[ 6194], 90.00th=[ 6390], 95.00th=[ 6587], 00:28:38.292 | 99.00th=[ 6980], 99.50th=[ 7111], 99.90th=[ 8586], 99.95th=[10028], 00:28:38.292 | 99.99th=[10290] 00:28:38.292 bw ( KiB/s): min=38088, max=39256, per=99.94%, avg=38770.00, stdev=494.85, samples=4 00:28:38.292 iops : min= 9522, max= 9814, avg=9692.50, stdev=123.71, samples=4 00:28:38.292 lat (msec) : 2=0.01%, 4=0.12%, 10=99.78%, 20=0.09% 00:28:38.292 cpu : usr=53.79%, sys=36.53%, ctx=69, majf=0, minf=6 00:28:38.292 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:28:38.292 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:38.292 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:38.292 issued rwts: total=19422,19445,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:38.292 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:38.292 00:28:38.292 Run status group 0 (all jobs): 00:28:38.292 READ: bw=37.8MiB/s (39.7MB/s), 37.8MiB/s-37.8MiB/s (39.7MB/s-39.7MB/s), io=75.9MiB (79.6MB), run=2005-2005msec 00:28:38.292 WRITE: bw=37.9MiB/s (39.7MB/s), 37.9MiB/s-37.9MiB/s (39.7MB/s-39.7MB/s), io=76.0MiB (79.6MB), run=2005-2005msec 00:28:38.292 04:25:52 -- host/fio.sh@70 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:38.292 04:25:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.292 04:25:52 -- common/autotest_common.sh@10 -- # set +x 00:28:38.292 04:25:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.292 04:25:52 -- host/fio.sh@72 -- # sync 00:28:38.292 04:25:52 -- host/fio.sh@74 -- # rpc_cmd bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:38.292 04:25:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.292 04:25:52 -- common/autotest_common.sh@10 -- # set +x 00:28:40.205 04:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.205 04:25:54 -- host/fio.sh@75 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_n_0 00:28:40.205 04:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.205 04:25:54 -- common/autotest_common.sh@10 -- # set +x 00:28:40.205 04:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.205 04:25:54 -- host/fio.sh@76 -- # rpc_cmd bdev_lvol_delete lvs_0/lbd_0 00:28:40.205 04:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.205 04:25:54 -- common/autotest_common.sh@10 -- # set +x 00:28:40.465 04:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.465 04:25:54 -- host/fio.sh@77 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_0 00:28:40.465 04:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.465 04:25:54 -- common/autotest_common.sh@10 -- # set +x 00:28:40.465 04:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.465 04:25:54 -- host/fio.sh@78 -- # rpc_cmd bdev_nvme_detach_controller Nvme0 00:28:40.465 04:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.465 04:25:54 -- common/autotest_common.sh@10 -- # set +x 00:28:42.381 04:25:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:42.381 04:25:56 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:28:42.381 04:25:56 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:28:42.381 04:25:56 -- host/fio.sh@84 -- # nvmftestfini 00:28:42.381 04:25:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:42.381 04:25:56 -- nvmf/common.sh@116 -- # sync 00:28:42.381 04:25:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:42.381 04:25:56 -- nvmf/common.sh@119 -- # set +e 00:28:42.381 04:25:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:42.381 04:25:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:42.381 rmmod nvme_tcp 00:28:42.381 rmmod nvme_fabrics 00:28:42.381 rmmod nvme_keyring 00:28:42.381 04:25:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:42.381 04:25:56 -- nvmf/common.sh@123 -- # set -e 00:28:42.381 04:25:56 -- nvmf/common.sh@124 -- # return 0 00:28:42.381 04:25:56 -- nvmf/common.sh@477 -- # '[' -n 4099162 ']' 00:28:42.381 04:25:56 -- nvmf/common.sh@478 -- # killprocess 4099162 00:28:42.381 04:25:56 -- common/autotest_common.sh@926 -- # '[' -z 4099162 ']' 00:28:42.381 04:25:56 -- common/autotest_common.sh@930 -- # kill -0 4099162 00:28:42.381 04:25:56 -- common/autotest_common.sh@931 -- # uname 00:28:42.381 04:25:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:42.381 04:25:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4099162 00:28:42.381 04:25:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:42.381 04:25:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:42.381 04:25:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4099162' 00:28:42.381 killing process with pid 4099162 00:28:42.381 04:25:56 -- common/autotest_common.sh@945 -- # kill 4099162 00:28:42.381 04:25:56 -- common/autotest_common.sh@950 -- # wait 4099162 00:28:42.381 04:25:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:42.381 04:25:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:42.381 04:25:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:42.381 04:25:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:42.381 04:25:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:42.381 04:25:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:42.381 04:25:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:42.381 04:25:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:44.934 04:25:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:44.934 00:28:44.934 real 0m28.266s 00:28:44.934 user 2m15.179s 00:28:44.934 sys 0m9.389s 00:28:44.934 04:25:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:44.934 04:25:58 -- common/autotest_common.sh@10 -- # set +x 00:28:44.934 ************************************ 00:28:44.934 END TEST nvmf_fio_host 00:28:44.934 ************************************ 00:28:44.934 04:25:59 -- nvmf/nvmf.sh@99 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:44.934 04:25:59 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:44.934 04:25:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:44.934 04:25:59 -- common/autotest_common.sh@10 -- # set +x 00:28:44.934 ************************************ 00:28:44.934 START TEST nvmf_failover 00:28:44.934 ************************************ 00:28:44.934 04:25:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:44.934 * Looking for test storage... 00:28:44.934 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:44.934 04:25:59 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:44.934 04:25:59 -- nvmf/common.sh@7 -- # uname -s 00:28:44.934 04:25:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:44.934 04:25:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:44.934 04:25:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:44.934 04:25:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:44.934 04:25:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:44.934 04:25:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:44.934 04:25:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:44.934 04:25:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:44.934 04:25:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:44.934 04:25:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:44.934 04:25:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:28:44.934 04:25:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:28:44.934 04:25:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:44.934 04:25:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:44.934 04:25:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:44.934 04:25:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:44.934 04:25:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:44.934 04:25:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:44.934 04:25:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:44.934 04:25:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:44.934 04:25:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:44.934 04:25:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:44.934 04:25:59 -- paths/export.sh@5 -- # export PATH 00:28:44.934 04:25:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:44.934 04:25:59 -- nvmf/common.sh@46 -- # : 0 00:28:44.934 04:25:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:44.934 04:25:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:44.934 04:25:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:44.934 04:25:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:44.934 04:25:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:44.934 04:25:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:44.934 04:25:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:44.934 04:25:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:44.934 04:25:59 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:44.934 04:25:59 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:44.934 04:25:59 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:44.934 04:25:59 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:44.934 04:25:59 -- host/failover.sh@18 -- # nvmftestinit 00:28:44.934 04:25:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:44.934 04:25:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:44.934 04:25:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:44.934 04:25:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:44.934 04:25:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:44.934 04:25:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:44.934 04:25:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:44.934 04:25:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:44.934 04:25:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:44.934 04:25:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:44.934 04:25:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:44.934 04:25:59 -- common/autotest_common.sh@10 -- # set +x 00:28:51.556 04:26:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:51.556 04:26:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:51.556 04:26:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:51.556 04:26:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:51.556 04:26:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:51.556 04:26:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:51.556 04:26:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:51.556 04:26:06 -- nvmf/common.sh@294 -- # net_devs=() 00:28:51.556 04:26:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:51.556 04:26:06 -- nvmf/common.sh@295 -- # e810=() 00:28:51.556 04:26:06 -- nvmf/common.sh@295 -- # local -ga e810 00:28:51.556 04:26:06 -- nvmf/common.sh@296 -- # x722=() 00:28:51.556 04:26:06 -- nvmf/common.sh@296 -- # local -ga x722 00:28:51.556 04:26:06 -- nvmf/common.sh@297 -- # mlx=() 00:28:51.557 04:26:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:51.557 04:26:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:51.557 04:26:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:51.557 04:26:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:51.557 04:26:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:51.557 04:26:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:51.557 04:26:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:28:51.557 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:28:51.557 04:26:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:51.557 04:26:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:28:51.557 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:28:51.557 04:26:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:51.557 04:26:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:51.557 04:26:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:51.557 04:26:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:51.557 04:26:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:51.557 04:26:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:28:51.557 Found net devices under 0000:4b:00.0: cvl_0_0 00:28:51.557 04:26:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:51.557 04:26:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:51.557 04:26:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:51.557 04:26:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:51.557 04:26:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:51.557 04:26:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:28:51.557 Found net devices under 0000:4b:00.1: cvl_0_1 00:28:51.557 04:26:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:51.557 04:26:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:51.557 04:26:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:51.557 04:26:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:51.557 04:26:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:51.557 04:26:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:51.557 04:26:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:51.557 04:26:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:51.557 04:26:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:51.557 04:26:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:51.557 04:26:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:51.557 04:26:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:51.557 04:26:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:51.557 04:26:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:51.557 04:26:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:51.557 04:26:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:51.557 04:26:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:51.557 04:26:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:51.819 04:26:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:51.819 04:26:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:51.819 04:26:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:51.819 04:26:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:51.819 04:26:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:51.819 04:26:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:51.819 04:26:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:51.819 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:51.819 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.735 ms 00:28:51.819 00:28:51.819 --- 10.0.0.2 ping statistics --- 00:28:51.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:51.819 rtt min/avg/max/mdev = 0.735/0.735/0.735/0.000 ms 00:28:51.819 04:26:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:51.819 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:51.819 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.438 ms 00:28:51.819 00:28:51.819 --- 10.0.0.1 ping statistics --- 00:28:51.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:51.819 rtt min/avg/max/mdev = 0.438/0.438/0.438/0.000 ms 00:28:51.819 04:26:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:51.819 04:26:06 -- nvmf/common.sh@410 -- # return 0 00:28:51.819 04:26:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:51.819 04:26:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:51.819 04:26:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:51.819 04:26:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:51.819 04:26:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:51.819 04:26:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:51.819 04:26:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:52.080 04:26:06 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:52.080 04:26:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:52.080 04:26:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:52.080 04:26:06 -- common/autotest_common.sh@10 -- # set +x 00:28:52.080 04:26:06 -- nvmf/common.sh@469 -- # nvmfpid=4107593 00:28:52.080 04:26:06 -- nvmf/common.sh@470 -- # waitforlisten 4107593 00:28:52.080 04:26:06 -- common/autotest_common.sh@819 -- # '[' -z 4107593 ']' 00:28:52.080 04:26:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:52.080 04:26:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:52.080 04:26:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:52.080 04:26:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:52.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:52.080 04:26:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:52.080 04:26:06 -- common/autotest_common.sh@10 -- # set +x 00:28:52.080 [2024-05-14 04:26:06.480840] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:28:52.080 [2024-05-14 04:26:06.480900] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:52.080 EAL: No free 2048 kB hugepages reported on node 1 00:28:52.080 [2024-05-14 04:26:06.564290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:52.080 [2024-05-14 04:26:06.626964] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:52.080 [2024-05-14 04:26:06.627087] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:52.080 [2024-05-14 04:26:06.627094] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:52.080 [2024-05-14 04:26:06.627101] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:52.080 [2024-05-14 04:26:06.627218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:52.080 [2024-05-14 04:26:06.627365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:52.080 [2024-05-14 04:26:06.627549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:53.018 04:26:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:53.018 04:26:07 -- common/autotest_common.sh@852 -- # return 0 00:28:53.018 04:26:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:53.018 04:26:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:53.018 04:26:07 -- common/autotest_common.sh@10 -- # set +x 00:28:53.018 04:26:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:53.018 04:26:07 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:53.018 [2024-05-14 04:26:07.467434] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:53.018 04:26:07 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:53.279 Malloc0 00:28:53.279 04:26:07 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:53.279 04:26:07 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:53.538 04:26:08 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:53.799 [2024-05-14 04:26:08.157004] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:53.799 04:26:08 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:53.799 [2024-05-14 04:26:08.325446] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:53.799 04:26:08 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:54.059 [2024-05-14 04:26:08.493989] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:54.059 04:26:08 -- host/failover.sh@31 -- # bdevperf_pid=4108105 00:28:54.059 04:26:08 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:54.059 04:26:08 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:54.059 04:26:08 -- host/failover.sh@34 -- # waitforlisten 4108105 /var/tmp/bdevperf.sock 00:28:54.059 04:26:08 -- common/autotest_common.sh@819 -- # '[' -z 4108105 ']' 00:28:54.059 04:26:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:54.059 04:26:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:54.059 04:26:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:54.059 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:54.059 04:26:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:54.059 04:26:08 -- common/autotest_common.sh@10 -- # set +x 00:28:54.997 04:26:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:54.997 04:26:09 -- common/autotest_common.sh@852 -- # return 0 00:28:54.997 04:26:09 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:55.257 NVMe0n1 00:28:55.257 04:26:09 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:55.522 00:28:55.522 04:26:09 -- host/failover.sh@39 -- # run_test_pid=4108325 00:28:55.522 04:26:09 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:55.522 04:26:09 -- host/failover.sh@41 -- # sleep 1 00:28:56.459 04:26:10 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:56.722 [2024-05-14 04:26:11.139166] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139213] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139218] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139222] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139232] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139237] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139241] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139250] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139254] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139258] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139262] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139271] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139275] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139280] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139284] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139298] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139302] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139311] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139320] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139324] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139342] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139347] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139356] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 [2024-05-14 04:26:11.139370] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfee380 is same with the state(5) to be set 00:28:56.722 04:26:11 -- host/failover.sh@45 -- # sleep 3 00:29:00.017 04:26:14 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:00.017 00:29:00.017 04:26:14 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:29:00.018 [2024-05-14 04:26:14.551885] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551922] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551927] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551932] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551937] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551942] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551955] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551960] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551964] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551968] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551973] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551977] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551981] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551986] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551994] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.551999] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552007] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552017] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552022] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552027] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552031] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552035] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552040] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552044] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552049] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552053] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552067] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552076] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552080] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552084] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552089] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552093] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552102] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552106] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552111] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 [2024-05-14 04:26:14.552115] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfef230 is same with the state(5) to be set 00:29:00.018 04:26:14 -- host/failover.sh@50 -- # sleep 3 00:29:03.307 04:26:17 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:03.307 [2024-05-14 04:26:17.721820] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:03.307 04:26:17 -- host/failover.sh@55 -- # sleep 1 00:29:04.246 04:26:18 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:29:04.506 [2024-05-14 04:26:18.897450] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897495] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897500] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897505] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897509] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897518] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897523] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897531] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897535] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897540] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897548] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897553] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897557] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897566] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897570] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897575] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897579] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897583] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897592] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897596] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897600] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.506 [2024-05-14 04:26:18.897614] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897618] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897622] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897627] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897631] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897636] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897640] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897645] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897649] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897653] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897657] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897662] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897666] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897671] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897675] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897680] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897684] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897688] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897692] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897697] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897701] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897705] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897710] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897714] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897719] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897723] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897728] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897734] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897738] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897743] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 [2024-05-14 04:26:18.897747] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfeff20 is same with the state(5) to be set 00:29:04.507 04:26:18 -- host/failover.sh@59 -- # wait 4108325 00:29:11.095 0 00:29:11.095 04:26:25 -- host/failover.sh@61 -- # killprocess 4108105 00:29:11.095 04:26:25 -- common/autotest_common.sh@926 -- # '[' -z 4108105 ']' 00:29:11.095 04:26:25 -- common/autotest_common.sh@930 -- # kill -0 4108105 00:29:11.095 04:26:25 -- common/autotest_common.sh@931 -- # uname 00:29:11.095 04:26:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:11.095 04:26:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4108105 00:29:11.095 04:26:25 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:11.095 04:26:25 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:11.095 04:26:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4108105' 00:29:11.095 killing process with pid 4108105 00:29:11.095 04:26:25 -- common/autotest_common.sh@945 -- # kill 4108105 00:29:11.095 04:26:25 -- common/autotest_common.sh@950 -- # wait 4108105 00:29:11.095 04:26:25 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:11.095 [2024-05-14 04:26:08.568835] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:11.095 [2024-05-14 04:26:08.568893] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4108105 ] 00:29:11.095 EAL: No free 2048 kB hugepages reported on node 1 00:29:11.095 [2024-05-14 04:26:08.627497] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:11.095 [2024-05-14 04:26:08.689668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:11.095 Running I/O for 15 seconds... 00:29:11.095 [2024-05-14 04:26:11.139863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.095 [2024-05-14 04:26:11.139899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.095 [2024-05-14 04:26:11.139917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:36808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.095 [2024-05-14 04:26:11.139925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.095 [2024-05-14 04:26:11.139935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.095 [2024-05-14 04:26:11.139942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.095 [2024-05-14 04:26:11.139951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:36832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.095 [2024-05-14 04:26:11.139958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.095 [2024-05-14 04:26:11.139968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:36864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.095 [2024-05-14 04:26:11.139975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.095 [2024-05-14 04:26:11.139984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:36888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.095 [2024-05-14 04:26:11.139991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:36896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:36904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:36928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:36936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:36968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:36336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:36368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:36376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:36408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:36416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:36984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:36992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:37000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:37008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:37016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:37032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:37040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:37048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:37056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:37064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:37072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:37080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:37088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:37096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:37104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:37112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:37120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:37128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:37136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:37144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:37152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.096 [2024-05-14 04:26:11.140567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:37160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:36432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:36456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.096 [2024-05-14 04:26:11.140647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.096 [2024-05-14 04:26:11.140657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:36472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:36480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:36512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:36520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:36528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:36552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:36568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:36576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:37168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:37176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:37192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.140840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:37200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:37208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.140871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:37216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:37224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.140904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:37232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:37240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:37248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.140952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:37256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:37264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.140984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.140994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:37280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.141016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:37288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.141032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:37296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.141048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.141064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.141080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:36616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:36624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:36632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:36696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:36728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:37320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:37328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.141223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:37336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:37344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.097 [2024-05-14 04:26:11.141255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.097 [2024-05-14 04:26:11.141309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.097 [2024-05-14 04:26:11.141317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:37376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:36760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:36792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:36800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:36816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:36840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:36856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:36872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:37392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:37400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:37416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:37424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:37432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:37440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:37448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:37464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:37480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:37488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:37496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:37512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:37528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:37536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:37544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:37552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:37560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:37568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.098 [2024-05-14 04:26:11.141887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:36920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:36952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:36960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.098 [2024-05-14 04:26:11.141954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.098 [2024-05-14 04:26:11.141977] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:11.098 [2024-05-14 04:26:11.141984] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:11.099 [2024-05-14 04:26:11.141991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:36976 len:8 PRP1 0x0 PRP2 0x0 00:29:11.099 [2024-05-14 04:26:11.141998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:11.142036] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x19416d0 was disconnected and freed. reset controller. 00:29:11.099 [2024-05-14 04:26:11.142051] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:29:11.099 [2024-05-14 04:26:11.142070] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.099 [2024-05-14 04:26:11.142078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:11.142087] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.099 [2024-05-14 04:26:11.142094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:11.142102] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.099 [2024-05-14 04:26:11.142108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:11.142116] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.099 [2024-05-14 04:26:11.142123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:11.142131] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:11.099 [2024-05-14 04:26:11.144691] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:11.099 [2024-05-14 04:26:11.144712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1931130 (9): Bad file descriptor 00:29:11.099 [2024-05-14 04:26:11.216534] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:11.099 [2024-05-14 04:26:14.552780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:77536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:77544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:77560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:77568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:76920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:76944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:76952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:76960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:76976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:76984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.552984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:76992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.552991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:77024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:77032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:77048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:77064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:77072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:77080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:77088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:77584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:77592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:77616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:77640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:77648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.099 [2024-05-14 04:26:14.553186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:77656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.099 [2024-05-14 04:26:14.553202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:77664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.099 [2024-05-14 04:26:14.553219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:77672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.099 [2024-05-14 04:26:14.553235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:77680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.099 [2024-05-14 04:26:14.553250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:77688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.099 [2024-05-14 04:26:14.553268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:77696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:77704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.099 [2024-05-14 04:26:14.553305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:77712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.099 [2024-05-14 04:26:14.553321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:77720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.099 [2024-05-14 04:26:14.553337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.099 [2024-05-14 04:26:14.553346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:77728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:77736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:77744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:77752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.100 [2024-05-14 04:26:14.553401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:77760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:77104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:77112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:77120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:77144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:77152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:77160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:77168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:77768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:77776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:77784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.100 [2024-05-14 04:26:14.553580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:77792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.100 [2024-05-14 04:26:14.553596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:77800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:77808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:77176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:77184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:77200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:77224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:77240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:77248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:77256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:77264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:77816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:77824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:77832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:77840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.100 [2024-05-14 04:26:14.553821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.100 [2024-05-14 04:26:14.553830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:77848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.100 [2024-05-14 04:26:14.553837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:77856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:77272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:77280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:77304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:77312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:77320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:77328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:77352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:77360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.553992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:77864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.553999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:77872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.101 [2024-05-14 04:26:14.554015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:77880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:77888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.101 [2024-05-14 04:26:14.554046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:77896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.101 [2024-05-14 04:26:14.554062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:77904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:77912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:77920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:77928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:77936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:77944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:77384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:77392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:77400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:77416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:77448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:77456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:77464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:77488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:77952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:77960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:77968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.101 [2024-05-14 04:26:14.554343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:77976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:77984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.101 [2024-05-14 04:26:14.554375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:77992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:78000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:78008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.101 [2024-05-14 04:26:14.554424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:78016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.101 [2024-05-14 04:26:14.554439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:78024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.101 [2024-05-14 04:26:14.554455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:78032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.101 [2024-05-14 04:26:14.554471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:78040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.101 [2024-05-14 04:26:14.554486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.101 [2024-05-14 04:26:14.554497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:78048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:78056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:77528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:77552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:77576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:78064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.102 [2024-05-14 04:26:14.554583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:78072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:78080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.102 [2024-05-14 04:26:14.554617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:78088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.102 [2024-05-14 04:26:14.554633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:78096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:78104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.102 [2024-05-14 04:26:14.554665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:78112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.102 [2024-05-14 04:26:14.554680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:78120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:78128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:78136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.102 [2024-05-14 04:26:14.554729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:78144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:78152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.102 [2024-05-14 04:26:14.554761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:78160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:78168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:78176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.102 [2024-05-14 04:26:14.554809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:78184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.102 [2024-05-14 04:26:14.554825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:77600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:77608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:77624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:14.554873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554892] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:11.102 [2024-05-14 04:26:14.554899] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:11.102 [2024-05-14 04:26:14.554905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:77632 len:8 PRP1 0x0 PRP2 0x0 00:29:11.102 [2024-05-14 04:26:14.554915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554951] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1943660 was disconnected and freed. reset controller. 00:29:11.102 [2024-05-14 04:26:14.554960] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:29:11.102 [2024-05-14 04:26:14.554979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.102 [2024-05-14 04:26:14.554987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.554995] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.102 [2024-05-14 04:26:14.555002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.555009] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.102 [2024-05-14 04:26:14.555016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.555024] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.102 [2024-05-14 04:26:14.555031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:14.555038] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:11.102 [2024-05-14 04:26:14.557518] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:11.102 [2024-05-14 04:26:14.557540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1931130 (9): Bad file descriptor 00:29:11.102 [2024-05-14 04:26:14.641204] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:11.102 [2024-05-14 04:26:18.897968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:8920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:18.898008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:18.898028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:18.898038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:18.898049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:8296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:18.898060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:18.898072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:8312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:18.898081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:18.898093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:8320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:18.898103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:18.898114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:8328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:18.898128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:18.898139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:8344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:18.898145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:18.898152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:8360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.102 [2024-05-14 04:26:18.898157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.102 [2024-05-14 04:26:18.898164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:8368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:8384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:8408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:8448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:8944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:8952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:8960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:9008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:9016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:9040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:9048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:9064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:9080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:9096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:9120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:9136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:8472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:8488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:8520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:8536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:9144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:9152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:9160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:9168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:9176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:9192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:9200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.103 [2024-05-14 04:26:18.898572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:9208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.103 [2024-05-14 04:26:18.898585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:9216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.103 [2024-05-14 04:26:18.898597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:9224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.103 [2024-05-14 04:26:18.898609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:9232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:9240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.103 [2024-05-14 04:26:18.898635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:9248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:9256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.103 [2024-05-14 04:26:18.898667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.103 [2024-05-14 04:26:18.898672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:8600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:8608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:8616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:8632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:8656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:8664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:8672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:9264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.898771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:9272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:9280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:9288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.898808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:9304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.898833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:9312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:9320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:9328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.898869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:8704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:8744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:8752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:8760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:8768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:8792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:8800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:9336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.898983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.898990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:9344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.898995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.899002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.899008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.899015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:9360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.899020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.899027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:9368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.899033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.899040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:9376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.899046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.899053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:9384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.899059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.899066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:9392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.899072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.899079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:9400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.104 [2024-05-14 04:26:18.899085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.899093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.104 [2024-05-14 04:26:18.899100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.104 [2024-05-14 04:26:18.899107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:9416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:9424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:9432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:9440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:8816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:8840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:8856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:8880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:8888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:8904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:9448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:9456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:9464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:9472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:9480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:8928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:8936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:8968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:8976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:8984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:9000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:9488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:9496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:9504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:9512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:9520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:9528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:9536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:9544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:9552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:9560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:9568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:9576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:11.105 [2024-05-14 04:26:18.899592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:9584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:9056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:9072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.105 [2024-05-14 04:26:18.899646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.105 [2024-05-14 04:26:18.899653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:9088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.106 [2024-05-14 04:26:18.899659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.106 [2024-05-14 04:26:18.899666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:9104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.106 [2024-05-14 04:26:18.899672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.106 [2024-05-14 04:26:18.899679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:9112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.106 [2024-05-14 04:26:18.899685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.106 [2024-05-14 04:26:18.899692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:9128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.106 [2024-05-14 04:26:18.899698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.106 [2024-05-14 04:26:18.899716] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:11.106 [2024-05-14 04:26:18.899721] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:11.106 [2024-05-14 04:26:18.899727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9184 len:8 PRP1 0x0 PRP2 0x0 00:29:11.106 [2024-05-14 04:26:18.899733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.106 [2024-05-14 04:26:18.899767] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1947500 was disconnected and freed. reset controller. 00:29:11.106 [2024-05-14 04:26:18.899775] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:29:11.106 [2024-05-14 04:26:18.899791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.106 [2024-05-14 04:26:18.899797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.106 [2024-05-14 04:26:18.899804] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.106 [2024-05-14 04:26:18.899810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.106 [2024-05-14 04:26:18.899817] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.106 [2024-05-14 04:26:18.899825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.106 [2024-05-14 04:26:18.899831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:11.106 [2024-05-14 04:26:18.899836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:11.106 [2024-05-14 04:26:18.899842] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:11.106 [2024-05-14 04:26:18.902001] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:11.106 [2024-05-14 04:26:18.902022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1931130 (9): Bad file descriptor 00:29:11.106 [2024-05-14 04:26:18.985089] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:11.106 00:29:11.106 Latency(us) 00:29:11.106 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:11.106 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:11.106 Verification LBA range: start 0x0 length 0x4000 00:29:11.106 NVMe0n1 : 15.00 19702.12 76.96 869.94 0.00 6205.96 546.13 13325.65 00:29:11.106 =================================================================================================================== 00:29:11.106 Total : 19702.12 76.96 869.94 0.00 6205.96 546.13 13325.65 00:29:11.106 Received shutdown signal, test time was about 15.000000 seconds 00:29:11.106 00:29:11.106 Latency(us) 00:29:11.106 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:11.106 =================================================================================================================== 00:29:11.106 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:11.106 04:26:25 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:29:11.106 04:26:25 -- host/failover.sh@65 -- # count=3 00:29:11.106 04:26:25 -- host/failover.sh@67 -- # (( count != 3 )) 00:29:11.106 04:26:25 -- host/failover.sh@73 -- # bdevperf_pid=4111197 00:29:11.106 04:26:25 -- host/failover.sh@75 -- # waitforlisten 4111197 /var/tmp/bdevperf.sock 00:29:11.106 04:26:25 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:29:11.106 04:26:25 -- common/autotest_common.sh@819 -- # '[' -z 4111197 ']' 00:29:11.106 04:26:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:29:11.106 04:26:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:11.106 04:26:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:29:11.106 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:29:11.106 04:26:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:11.106 04:26:25 -- common/autotest_common.sh@10 -- # set +x 00:29:11.675 04:26:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:11.675 04:26:26 -- common/autotest_common.sh@852 -- # return 0 00:29:11.675 04:26:26 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:29:11.935 [2024-05-14 04:26:26.283854] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:11.935 04:26:26 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:29:11.935 [2024-05-14 04:26:26.452271] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:29:11.935 04:26:26 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:12.201 NVMe0n1 00:29:12.201 04:26:26 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:12.509 00:29:12.509 04:26:27 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:13.078 00:29:13.078 04:26:27 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:13.078 04:26:27 -- host/failover.sh@82 -- # grep -q NVMe0 00:29:13.078 04:26:27 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:13.337 04:26:27 -- host/failover.sh@87 -- # sleep 3 00:29:16.632 04:26:30 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:16.632 04:26:30 -- host/failover.sh@88 -- # grep -q NVMe0 00:29:16.632 04:26:30 -- host/failover.sh@90 -- # run_test_pid=4112327 00:29:16.632 04:26:30 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:29:16.632 04:26:30 -- host/failover.sh@92 -- # wait 4112327 00:29:17.573 0 00:29:17.573 04:26:32 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:17.573 [2024-05-14 04:26:25.382496] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:17.573 [2024-05-14 04:26:25.382569] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4111197 ] 00:29:17.573 EAL: No free 2048 kB hugepages reported on node 1 00:29:17.573 [2024-05-14 04:26:25.443090] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:17.573 [2024-05-14 04:26:25.505234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:17.573 [2024-05-14 04:26:27.720719] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:29:17.573 [2024-05-14 04:26:27.720764] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:17.573 [2024-05-14 04:26:27.720775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:17.573 [2024-05-14 04:26:27.720784] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:17.573 [2024-05-14 04:26:27.720791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:17.573 [2024-05-14 04:26:27.720799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:17.573 [2024-05-14 04:26:27.720806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:17.573 [2024-05-14 04:26:27.720814] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:17.573 [2024-05-14 04:26:27.720821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:17.573 [2024-05-14 04:26:27.720828] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:17.573 [2024-05-14 04:26:27.720850] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:17.573 [2024-05-14 04:26:27.720864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2364130 (9): Bad file descriptor 00:29:17.573 [2024-05-14 04:26:27.777191] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:17.573 Running I/O for 1 seconds... 00:29:17.573 00:29:17.573 Latency(us) 00:29:17.573 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:17.573 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:17.573 Verification LBA range: start 0x0 length 0x4000 00:29:17.573 NVMe0n1 : 1.00 19637.33 76.71 0.00 0.00 6488.30 1194.67 21517.65 00:29:17.573 =================================================================================================================== 00:29:17.573 Total : 19637.33 76.71 0.00 0.00 6488.30 1194.67 21517.65 00:29:17.574 04:26:32 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:17.574 04:26:32 -- host/failover.sh@95 -- # grep -q NVMe0 00:29:17.833 04:26:32 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:17.833 04:26:32 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:17.833 04:26:32 -- host/failover.sh@99 -- # grep -q NVMe0 00:29:18.094 04:26:32 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:29:18.354 04:26:32 -- host/failover.sh@101 -- # sleep 3 00:29:21.647 04:26:35 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:21.647 04:26:35 -- host/failover.sh@103 -- # grep -q NVMe0 00:29:21.647 04:26:35 -- host/failover.sh@108 -- # killprocess 4111197 00:29:21.647 04:26:35 -- common/autotest_common.sh@926 -- # '[' -z 4111197 ']' 00:29:21.647 04:26:35 -- common/autotest_common.sh@930 -- # kill -0 4111197 00:29:21.647 04:26:35 -- common/autotest_common.sh@931 -- # uname 00:29:21.647 04:26:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:21.647 04:26:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4111197 00:29:21.647 04:26:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:21.647 04:26:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:21.647 04:26:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4111197' 00:29:21.647 killing process with pid 4111197 00:29:21.647 04:26:35 -- common/autotest_common.sh@945 -- # kill 4111197 00:29:21.647 04:26:35 -- common/autotest_common.sh@950 -- # wait 4111197 00:29:21.647 04:26:36 -- host/failover.sh@110 -- # sync 00:29:21.647 04:26:36 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:21.647 04:26:36 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:29:21.647 04:26:36 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:21.647 04:26:36 -- host/failover.sh@116 -- # nvmftestfini 00:29:21.647 04:26:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:21.647 04:26:36 -- nvmf/common.sh@116 -- # sync 00:29:21.908 04:26:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:21.908 04:26:36 -- nvmf/common.sh@119 -- # set +e 00:29:21.908 04:26:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:21.908 04:26:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:21.908 rmmod nvme_tcp 00:29:21.908 rmmod nvme_fabrics 00:29:21.908 rmmod nvme_keyring 00:29:21.908 04:26:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:21.908 04:26:36 -- nvmf/common.sh@123 -- # set -e 00:29:21.908 04:26:36 -- nvmf/common.sh@124 -- # return 0 00:29:21.908 04:26:36 -- nvmf/common.sh@477 -- # '[' -n 4107593 ']' 00:29:21.908 04:26:36 -- nvmf/common.sh@478 -- # killprocess 4107593 00:29:21.908 04:26:36 -- common/autotest_common.sh@926 -- # '[' -z 4107593 ']' 00:29:21.908 04:26:36 -- common/autotest_common.sh@930 -- # kill -0 4107593 00:29:21.908 04:26:36 -- common/autotest_common.sh@931 -- # uname 00:29:21.908 04:26:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:21.908 04:26:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4107593 00:29:21.908 04:26:36 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:21.908 04:26:36 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:21.908 04:26:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4107593' 00:29:21.908 killing process with pid 4107593 00:29:21.908 04:26:36 -- common/autotest_common.sh@945 -- # kill 4107593 00:29:21.908 04:26:36 -- common/autotest_common.sh@950 -- # wait 4107593 00:29:21.908 04:26:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:21.908 04:26:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:21.908 04:26:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:21.908 04:26:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:21.908 04:26:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:21.908 04:26:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:21.908 04:26:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:21.908 04:26:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:24.451 04:26:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:24.451 00:29:24.451 real 0m39.504s 00:29:24.451 user 1m56.904s 00:29:24.451 sys 0m10.054s 00:29:24.451 04:26:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:24.451 04:26:38 -- common/autotest_common.sh@10 -- # set +x 00:29:24.451 ************************************ 00:29:24.451 END TEST nvmf_failover 00:29:24.451 ************************************ 00:29:24.451 04:26:38 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:24.451 04:26:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:24.451 04:26:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:24.451 04:26:38 -- common/autotest_common.sh@10 -- # set +x 00:29:24.451 ************************************ 00:29:24.451 START TEST nvmf_discovery 00:29:24.451 ************************************ 00:29:24.451 04:26:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:24.451 * Looking for test storage... 00:29:24.451 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:24.451 04:26:38 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:24.451 04:26:38 -- nvmf/common.sh@7 -- # uname -s 00:29:24.451 04:26:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:24.451 04:26:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:24.451 04:26:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:24.451 04:26:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:24.451 04:26:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:24.451 04:26:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:24.451 04:26:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:24.451 04:26:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:24.451 04:26:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:24.451 04:26:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:24.451 04:26:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:29:24.451 04:26:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:29:24.451 04:26:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:24.451 04:26:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:24.451 04:26:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:24.451 04:26:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:24.451 04:26:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:24.451 04:26:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:24.451 04:26:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:24.451 04:26:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.451 04:26:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.451 04:26:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.451 04:26:38 -- paths/export.sh@5 -- # export PATH 00:29:24.451 04:26:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.451 04:26:38 -- nvmf/common.sh@46 -- # : 0 00:29:24.451 04:26:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:24.451 04:26:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:24.451 04:26:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:24.451 04:26:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:24.451 04:26:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:24.451 04:26:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:24.451 04:26:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:24.451 04:26:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:24.451 04:26:38 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:29:24.451 04:26:38 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:29:24.451 04:26:38 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:29:24.451 04:26:38 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:29:24.451 04:26:38 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:29:24.451 04:26:38 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:29:24.451 04:26:38 -- host/discovery.sh@25 -- # nvmftestinit 00:29:24.451 04:26:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:24.451 04:26:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:24.451 04:26:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:24.451 04:26:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:24.451 04:26:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:24.451 04:26:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:24.451 04:26:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:24.451 04:26:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:24.451 04:26:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:24.451 04:26:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:24.451 04:26:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:24.451 04:26:38 -- common/autotest_common.sh@10 -- # set +x 00:29:31.043 04:26:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:31.043 04:26:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:31.043 04:26:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:31.043 04:26:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:31.043 04:26:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:31.043 04:26:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:31.043 04:26:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:31.043 04:26:45 -- nvmf/common.sh@294 -- # net_devs=() 00:29:31.043 04:26:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:31.043 04:26:45 -- nvmf/common.sh@295 -- # e810=() 00:29:31.043 04:26:45 -- nvmf/common.sh@295 -- # local -ga e810 00:29:31.043 04:26:45 -- nvmf/common.sh@296 -- # x722=() 00:29:31.043 04:26:45 -- nvmf/common.sh@296 -- # local -ga x722 00:29:31.043 04:26:45 -- nvmf/common.sh@297 -- # mlx=() 00:29:31.043 04:26:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:31.043 04:26:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:31.043 04:26:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:31.043 04:26:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:31.043 04:26:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:31.043 04:26:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:31.043 04:26:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:31.043 04:26:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:31.043 04:26:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:31.043 04:26:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:29:31.044 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:29:31.044 04:26:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:31.044 04:26:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:29:31.044 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:29:31.044 04:26:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:31.044 04:26:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:31.044 04:26:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:31.044 04:26:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:31.044 04:26:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:31.044 04:26:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:29:31.044 Found net devices under 0000:4b:00.0: cvl_0_0 00:29:31.044 04:26:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:31.044 04:26:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:31.044 04:26:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:31.044 04:26:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:31.044 04:26:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:31.044 04:26:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:29:31.044 Found net devices under 0000:4b:00.1: cvl_0_1 00:29:31.044 04:26:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:31.044 04:26:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:31.044 04:26:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:31.044 04:26:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:31.044 04:26:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:31.044 04:26:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:31.044 04:26:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:31.044 04:26:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:31.044 04:26:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:31.044 04:26:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:31.044 04:26:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:31.044 04:26:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:31.044 04:26:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:31.044 04:26:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:31.044 04:26:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:31.044 04:26:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:31.044 04:26:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:31.044 04:26:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:31.305 04:26:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:31.305 04:26:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:31.305 04:26:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:31.305 04:26:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:31.305 04:26:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:31.305 04:26:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:31.305 04:26:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:31.305 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:31.305 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.669 ms 00:29:31.305 00:29:31.305 --- 10.0.0.2 ping statistics --- 00:29:31.305 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:31.305 rtt min/avg/max/mdev = 0.669/0.669/0.669/0.000 ms 00:29:31.305 04:26:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:31.305 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:31.305 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.402 ms 00:29:31.305 00:29:31.305 --- 10.0.0.1 ping statistics --- 00:29:31.305 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:31.305 rtt min/avg/max/mdev = 0.402/0.402/0.402/0.000 ms 00:29:31.305 04:26:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:31.305 04:26:45 -- nvmf/common.sh@410 -- # return 0 00:29:31.305 04:26:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:31.305 04:26:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:31.305 04:26:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:31.305 04:26:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:31.305 04:26:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:31.305 04:26:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:31.305 04:26:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:31.305 04:26:45 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:29:31.305 04:26:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:31.305 04:26:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:31.305 04:26:45 -- common/autotest_common.sh@10 -- # set +x 00:29:31.566 04:26:45 -- nvmf/common.sh@469 -- # nvmfpid=4117588 00:29:31.566 04:26:45 -- nvmf/common.sh@470 -- # waitforlisten 4117588 00:29:31.566 04:26:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:31.566 04:26:45 -- common/autotest_common.sh@819 -- # '[' -z 4117588 ']' 00:29:31.566 04:26:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:31.566 04:26:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:31.566 04:26:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:31.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:31.566 04:26:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:31.566 04:26:45 -- common/autotest_common.sh@10 -- # set +x 00:29:31.566 [2024-05-14 04:26:45.940958] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:31.566 [2024-05-14 04:26:45.941006] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:31.566 EAL: No free 2048 kB hugepages reported on node 1 00:29:31.566 [2024-05-14 04:26:46.022971] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:31.566 [2024-05-14 04:26:46.095676] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:31.566 [2024-05-14 04:26:46.095816] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:31.566 [2024-05-14 04:26:46.095826] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:31.566 [2024-05-14 04:26:46.095834] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:31.566 [2024-05-14 04:26:46.095861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:32.138 04:26:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:32.138 04:26:46 -- common/autotest_common.sh@852 -- # return 0 00:29:32.138 04:26:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:32.138 04:26:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:32.138 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:29:32.400 04:26:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:32.400 04:26:46 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:32.400 04:26:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.400 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:29:32.400 [2024-05-14 04:26:46.766947] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:32.400 04:26:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.400 04:26:46 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:29:32.400 04:26:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.400 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:29:32.400 [2024-05-14 04:26:46.779152] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:32.400 04:26:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.400 04:26:46 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:29:32.400 04:26:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.400 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:29:32.400 null0 00:29:32.400 04:26:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.400 04:26:46 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:29:32.400 04:26:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.400 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:29:32.400 null1 00:29:32.400 04:26:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.400 04:26:46 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:29:32.400 04:26:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.400 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:29:32.400 04:26:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.400 04:26:46 -- host/discovery.sh@45 -- # hostpid=4117643 00:29:32.400 04:26:46 -- host/discovery.sh@46 -- # waitforlisten 4117643 /tmp/host.sock 00:29:32.400 04:26:46 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:29:32.400 04:26:46 -- common/autotest_common.sh@819 -- # '[' -z 4117643 ']' 00:29:32.400 04:26:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:29:32.400 04:26:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:32.400 04:26:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:32.400 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:32.400 04:26:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:32.400 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:29:32.400 [2024-05-14 04:26:46.870360] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:32.400 [2024-05-14 04:26:46.870423] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4117643 ] 00:29:32.400 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.400 [2024-05-14 04:26:46.935771] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:32.660 [2024-05-14 04:26:47.008227] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:32.660 [2024-05-14 04:26:47.008361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:33.231 04:26:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:33.231 04:26:47 -- common/autotest_common.sh@852 -- # return 0 00:29:33.231 04:26:47 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:33.231 04:26:47 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:29:33.231 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.231 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.231 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.231 04:26:47 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:29:33.231 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.231 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.231 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.231 04:26:47 -- host/discovery.sh@72 -- # notify_id=0 00:29:33.231 04:26:47 -- host/discovery.sh@78 -- # get_subsystem_names 00:29:33.231 04:26:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:33.231 04:26:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:33.231 04:26:47 -- host/discovery.sh@59 -- # sort 00:29:33.231 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.231 04:26:47 -- host/discovery.sh@59 -- # xargs 00:29:33.231 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.231 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.231 04:26:47 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:29:33.231 04:26:47 -- host/discovery.sh@79 -- # get_bdev_list 00:29:33.231 04:26:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:33.231 04:26:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:33.231 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.231 04:26:47 -- host/discovery.sh@55 -- # sort 00:29:33.231 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.231 04:26:47 -- host/discovery.sh@55 -- # xargs 00:29:33.231 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.231 04:26:47 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:29:33.231 04:26:47 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:29:33.231 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.231 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.231 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.231 04:26:47 -- host/discovery.sh@82 -- # get_subsystem_names 00:29:33.231 04:26:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:33.231 04:26:47 -- host/discovery.sh@59 -- # xargs 00:29:33.231 04:26:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:33.231 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.231 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.231 04:26:47 -- host/discovery.sh@59 -- # sort 00:29:33.231 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.492 04:26:47 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:29:33.492 04:26:47 -- host/discovery.sh@83 -- # get_bdev_list 00:29:33.492 04:26:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:33.492 04:26:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:33.492 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.492 04:26:47 -- host/discovery.sh@55 -- # sort 00:29:33.492 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.492 04:26:47 -- host/discovery.sh@55 -- # xargs 00:29:33.492 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.492 04:26:47 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:29:33.492 04:26:47 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:29:33.492 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.492 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.492 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.492 04:26:47 -- host/discovery.sh@86 -- # get_subsystem_names 00:29:33.492 04:26:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:33.492 04:26:47 -- host/discovery.sh@59 -- # sort 00:29:33.492 04:26:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:33.492 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.492 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.492 04:26:47 -- host/discovery.sh@59 -- # xargs 00:29:33.492 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.492 04:26:47 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:29:33.492 04:26:47 -- host/discovery.sh@87 -- # get_bdev_list 00:29:33.492 04:26:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:33.492 04:26:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:33.492 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.492 04:26:47 -- host/discovery.sh@55 -- # sort 00:29:33.492 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.492 04:26:47 -- host/discovery.sh@55 -- # xargs 00:29:33.492 04:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.492 04:26:47 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:29:33.492 04:26:47 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:33.492 04:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.492 04:26:47 -- common/autotest_common.sh@10 -- # set +x 00:29:33.492 [2024-05-14 04:26:48.002313] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:33.492 04:26:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.492 04:26:48 -- host/discovery.sh@92 -- # get_subsystem_names 00:29:33.492 04:26:48 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:33.492 04:26:48 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:33.492 04:26:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.492 04:26:48 -- host/discovery.sh@59 -- # sort 00:29:33.492 04:26:48 -- common/autotest_common.sh@10 -- # set +x 00:29:33.492 04:26:48 -- host/discovery.sh@59 -- # xargs 00:29:33.492 04:26:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.492 04:26:48 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:29:33.492 04:26:48 -- host/discovery.sh@93 -- # get_bdev_list 00:29:33.492 04:26:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:33.492 04:26:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:33.492 04:26:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.492 04:26:48 -- host/discovery.sh@55 -- # sort 00:29:33.492 04:26:48 -- common/autotest_common.sh@10 -- # set +x 00:29:33.492 04:26:48 -- host/discovery.sh@55 -- # xargs 00:29:33.492 04:26:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.752 04:26:48 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:29:33.752 04:26:48 -- host/discovery.sh@94 -- # get_notification_count 00:29:33.752 04:26:48 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:33.752 04:26:48 -- host/discovery.sh@74 -- # jq '. | length' 00:29:33.752 04:26:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.752 04:26:48 -- common/autotest_common.sh@10 -- # set +x 00:29:33.753 04:26:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.753 04:26:48 -- host/discovery.sh@74 -- # notification_count=0 00:29:33.753 04:26:48 -- host/discovery.sh@75 -- # notify_id=0 00:29:33.753 04:26:48 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:29:33.753 04:26:48 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:29:33.753 04:26:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.753 04:26:48 -- common/autotest_common.sh@10 -- # set +x 00:29:33.753 04:26:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.753 04:26:48 -- host/discovery.sh@100 -- # sleep 1 00:29:34.323 [2024-05-14 04:26:48.707780] bdev_nvme.c:6753:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:34.323 [2024-05-14 04:26:48.707801] bdev_nvme.c:6833:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:34.323 [2024-05-14 04:26:48.707815] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:34.323 [2024-05-14 04:26:48.796087] bdev_nvme.c:6682:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:34.323 [2024-05-14 04:26:48.896965] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:34.323 [2024-05-14 04:26:48.896988] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:34.593 04:26:49 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:34.593 04:26:49 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:34.593 04:26:49 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:34.593 04:26:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:34.593 04:26:49 -- common/autotest_common.sh@10 -- # set +x 00:29:34.593 04:26:49 -- host/discovery.sh@59 -- # sort 00:29:34.593 04:26:49 -- host/discovery.sh@59 -- # xargs 00:29:34.903 04:26:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:34.903 04:26:49 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:34.903 04:26:49 -- host/discovery.sh@102 -- # get_bdev_list 00:29:34.903 04:26:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:34.903 04:26:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:34.903 04:26:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:34.903 04:26:49 -- host/discovery.sh@55 -- # sort 00:29:34.903 04:26:49 -- common/autotest_common.sh@10 -- # set +x 00:29:34.903 04:26:49 -- host/discovery.sh@55 -- # xargs 00:29:34.903 04:26:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:34.903 04:26:49 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:34.903 04:26:49 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:34.903 04:26:49 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:34.903 04:26:49 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:34.903 04:26:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:34.903 04:26:49 -- common/autotest_common.sh@10 -- # set +x 00:29:34.903 04:26:49 -- host/discovery.sh@63 -- # sort -n 00:29:34.903 04:26:49 -- host/discovery.sh@63 -- # xargs 00:29:34.903 04:26:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:34.903 04:26:49 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:34.903 04:26:49 -- host/discovery.sh@104 -- # get_notification_count 00:29:34.903 04:26:49 -- host/discovery.sh@74 -- # jq '. | length' 00:29:34.903 04:26:49 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:34.903 04:26:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:34.903 04:26:49 -- common/autotest_common.sh@10 -- # set +x 00:29:34.903 04:26:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:34.903 04:26:49 -- host/discovery.sh@74 -- # notification_count=1 00:29:34.903 04:26:49 -- host/discovery.sh@75 -- # notify_id=1 00:29:34.903 04:26:49 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:34.903 04:26:49 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:34.903 04:26:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:34.903 04:26:49 -- common/autotest_common.sh@10 -- # set +x 00:29:34.903 04:26:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:34.903 04:26:49 -- host/discovery.sh@109 -- # sleep 1 00:29:35.843 04:26:50 -- host/discovery.sh@110 -- # get_bdev_list 00:29:35.843 04:26:50 -- host/discovery.sh@55 -- # sort 00:29:35.843 04:26:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:35.843 04:26:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:35.843 04:26:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:35.843 04:26:50 -- common/autotest_common.sh@10 -- # set +x 00:29:35.843 04:26:50 -- host/discovery.sh@55 -- # xargs 00:29:35.843 04:26:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:35.843 04:26:50 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:35.843 04:26:50 -- host/discovery.sh@111 -- # get_notification_count 00:29:35.843 04:26:50 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:35.843 04:26:50 -- host/discovery.sh@74 -- # jq '. | length' 00:29:35.844 04:26:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:35.844 04:26:50 -- common/autotest_common.sh@10 -- # set +x 00:29:36.103 04:26:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:36.103 04:26:50 -- host/discovery.sh@74 -- # notification_count=1 00:29:36.103 04:26:50 -- host/discovery.sh@75 -- # notify_id=2 00:29:36.103 04:26:50 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:36.103 04:26:50 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:36.103 04:26:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:36.103 04:26:50 -- common/autotest_common.sh@10 -- # set +x 00:29:36.103 [2024-05-14 04:26:50.472886] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:36.103 [2024-05-14 04:26:50.473125] bdev_nvme.c:6735:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:36.103 [2024-05-14 04:26:50.473152] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:36.104 04:26:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:36.104 04:26:50 -- host/discovery.sh@117 -- # sleep 1 00:29:36.104 [2024-05-14 04:26:50.563319] bdev_nvme.c:6677:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:36.104 [2024-05-14 04:26:50.662284] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:36.104 [2024-05-14 04:26:50.662311] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:36.104 [2024-05-14 04:26:50.662317] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:37.045 04:26:51 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:37.045 04:26:51 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:37.045 04:26:51 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:37.045 04:26:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:37.045 04:26:51 -- host/discovery.sh@59 -- # sort 00:29:37.045 04:26:51 -- common/autotest_common.sh@10 -- # set +x 00:29:37.045 04:26:51 -- host/discovery.sh@59 -- # xargs 00:29:37.045 04:26:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:37.045 04:26:51 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:37.045 04:26:51 -- host/discovery.sh@119 -- # get_bdev_list 00:29:37.045 04:26:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:37.045 04:26:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:37.045 04:26:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:37.045 04:26:51 -- common/autotest_common.sh@10 -- # set +x 00:29:37.045 04:26:51 -- host/discovery.sh@55 -- # sort 00:29:37.045 04:26:51 -- host/discovery.sh@55 -- # xargs 00:29:37.045 04:26:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:37.045 04:26:51 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:37.045 04:26:51 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:37.045 04:26:51 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:37.045 04:26:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:37.045 04:26:51 -- common/autotest_common.sh@10 -- # set +x 00:29:37.045 04:26:51 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:37.045 04:26:51 -- host/discovery.sh@63 -- # sort -n 00:29:37.045 04:26:51 -- host/discovery.sh@63 -- # xargs 00:29:37.045 04:26:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:37.307 04:26:51 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:37.307 04:26:51 -- host/discovery.sh@121 -- # get_notification_count 00:29:37.307 04:26:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:37.307 04:26:51 -- host/discovery.sh@74 -- # jq '. | length' 00:29:37.307 04:26:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:37.307 04:26:51 -- common/autotest_common.sh@10 -- # set +x 00:29:37.307 04:26:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:37.307 04:26:51 -- host/discovery.sh@74 -- # notification_count=0 00:29:37.307 04:26:51 -- host/discovery.sh@75 -- # notify_id=2 00:29:37.307 04:26:51 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:37.307 04:26:51 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:37.307 04:26:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:37.307 04:26:51 -- common/autotest_common.sh@10 -- # set +x 00:29:37.307 [2024-05-14 04:26:51.693229] bdev_nvme.c:6735:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:37.307 [2024-05-14 04:26:51.693252] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:37.307 04:26:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:37.307 04:26:51 -- host/discovery.sh@127 -- # sleep 1 00:29:37.307 [2024-05-14 04:26:51.700917] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:37.307 [2024-05-14 04:26:51.700935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:37.307 [2024-05-14 04:26:51.700944] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:37.307 [2024-05-14 04:26:51.700952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:37.307 [2024-05-14 04:26:51.700960] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:37.307 [2024-05-14 04:26:51.700967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:37.307 [2024-05-14 04:26:51.700975] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:37.307 [2024-05-14 04:26:51.700982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:37.307 [2024-05-14 04:26:51.700989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1390f50 is same with the state(5) to be set 00:29:37.307 [2024-05-14 04:26:51.710929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1390f50 (9): Bad file descriptor 00:29:37.307 [2024-05-14 04:26:51.720973] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:37.307 [2024-05-14 04:26:51.721547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.722050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.722062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1390f50 with addr=10.0.0.2, port=4420 00:29:37.307 [2024-05-14 04:26:51.722072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1390f50 is same with the state(5) to be set 00:29:37.307 [2024-05-14 04:26:51.722090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1390f50 (9): Bad file descriptor 00:29:37.307 [2024-05-14 04:26:51.722124] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:37.307 [2024-05-14 04:26:51.722133] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:37.307 [2024-05-14 04:26:51.722142] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:37.307 [2024-05-14 04:26:51.722157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.307 [2024-05-14 04:26:51.731026] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:37.307 [2024-05-14 04:26:51.731250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.731780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.731821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1390f50 with addr=10.0.0.2, port=4420 00:29:37.307 [2024-05-14 04:26:51.731832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1390f50 is same with the state(5) to be set 00:29:37.307 [2024-05-14 04:26:51.731850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1390f50 (9): Bad file descriptor 00:29:37.307 [2024-05-14 04:26:51.731875] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:37.307 [2024-05-14 04:26:51.731882] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:37.307 [2024-05-14 04:26:51.731890] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:37.307 [2024-05-14 04:26:51.731905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.307 [2024-05-14 04:26:51.741081] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:37.307 [2024-05-14 04:26:51.741680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.742215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.742228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1390f50 with addr=10.0.0.2, port=4420 00:29:37.307 [2024-05-14 04:26:51.742237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1390f50 is same with the state(5) to be set 00:29:37.307 [2024-05-14 04:26:51.742255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1390f50 (9): Bad file descriptor 00:29:37.307 [2024-05-14 04:26:51.742309] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:37.307 [2024-05-14 04:26:51.742320] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:37.307 [2024-05-14 04:26:51.742327] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:37.307 [2024-05-14 04:26:51.742343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.307 [2024-05-14 04:26:51.751137] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:37.307 [2024-05-14 04:26:51.751695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.752191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.752203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1390f50 with addr=10.0.0.2, port=4420 00:29:37.307 [2024-05-14 04:26:51.752213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1390f50 is same with the state(5) to be set 00:29:37.307 [2024-05-14 04:26:51.752231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1390f50 (9): Bad file descriptor 00:29:37.307 [2024-05-14 04:26:51.752255] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:37.307 [2024-05-14 04:26:51.752263] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:37.307 [2024-05-14 04:26:51.752271] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:37.307 [2024-05-14 04:26:51.752285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.307 [2024-05-14 04:26:51.761189] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:37.307 [2024-05-14 04:26:51.761652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.762149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.762161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1390f50 with addr=10.0.0.2, port=4420 00:29:37.307 [2024-05-14 04:26:51.762175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1390f50 is same with the state(5) to be set 00:29:37.307 [2024-05-14 04:26:51.762193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1390f50 (9): Bad file descriptor 00:29:37.307 [2024-05-14 04:26:51.762220] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:37.307 [2024-05-14 04:26:51.762229] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:37.307 [2024-05-14 04:26:51.762236] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:37.307 [2024-05-14 04:26:51.762251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.307 [2024-05-14 04:26:51.771241] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:37.307 [2024-05-14 04:26:51.771705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.772171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.307 [2024-05-14 04:26:51.772180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1390f50 with addr=10.0.0.2, port=4420 00:29:37.307 [2024-05-14 04:26:51.772188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1390f50 is same with the state(5) to be set 00:29:37.308 [2024-05-14 04:26:51.772199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1390f50 (9): Bad file descriptor 00:29:37.308 [2024-05-14 04:26:51.772209] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:37.308 [2024-05-14 04:26:51.772215] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:37.308 [2024-05-14 04:26:51.772222] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:37.308 [2024-05-14 04:26:51.772232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.308 [2024-05-14 04:26:51.781300] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:37.308 [2024-05-14 04:26:51.781779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.308 [2024-05-14 04:26:51.782552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.308 [2024-05-14 04:26:51.782589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1390f50 with addr=10.0.0.2, port=4420 00:29:37.308 [2024-05-14 04:26:51.782601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1390f50 is same with the state(5) to be set 00:29:37.308 [2024-05-14 04:26:51.782620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1390f50 (9): Bad file descriptor 00:29:37.308 [2024-05-14 04:26:51.782654] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:37.308 [2024-05-14 04:26:51.782663] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:37.308 [2024-05-14 04:26:51.782670] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:37.308 [2024-05-14 04:26:51.782685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.308 [2024-05-14 04:26:51.783643] bdev_nvme.c:6540:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:37.308 [2024-05-14 04:26:51.783660] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:38.251 04:26:52 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:38.251 04:26:52 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:38.251 04:26:52 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:38.251 04:26:52 -- host/discovery.sh@59 -- # sort 00:29:38.251 04:26:52 -- host/discovery.sh@59 -- # xargs 00:29:38.251 04:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:38.251 04:26:52 -- common/autotest_common.sh@10 -- # set +x 00:29:38.251 04:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:38.251 04:26:52 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:38.251 04:26:52 -- host/discovery.sh@129 -- # get_bdev_list 00:29:38.251 04:26:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:38.251 04:26:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:38.251 04:26:52 -- host/discovery.sh@55 -- # sort 00:29:38.251 04:26:52 -- host/discovery.sh@55 -- # xargs 00:29:38.251 04:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:38.251 04:26:52 -- common/autotest_common.sh@10 -- # set +x 00:29:38.251 04:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:38.251 04:26:52 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:38.251 04:26:52 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:38.251 04:26:52 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:38.251 04:26:52 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:38.251 04:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:38.251 04:26:52 -- common/autotest_common.sh@10 -- # set +x 00:29:38.251 04:26:52 -- host/discovery.sh@63 -- # sort -n 00:29:38.251 04:26:52 -- host/discovery.sh@63 -- # xargs 00:29:38.251 04:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:38.512 04:26:52 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:38.512 04:26:52 -- host/discovery.sh@131 -- # get_notification_count 00:29:38.512 04:26:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:38.512 04:26:52 -- host/discovery.sh@74 -- # jq '. | length' 00:29:38.512 04:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:38.512 04:26:52 -- common/autotest_common.sh@10 -- # set +x 00:29:38.512 04:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:38.512 04:26:52 -- host/discovery.sh@74 -- # notification_count=0 00:29:38.512 04:26:52 -- host/discovery.sh@75 -- # notify_id=2 00:29:38.512 04:26:52 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:38.512 04:26:52 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:38.512 04:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:38.512 04:26:52 -- common/autotest_common.sh@10 -- # set +x 00:29:38.512 04:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:38.512 04:26:52 -- host/discovery.sh@135 -- # sleep 1 00:29:39.451 04:26:53 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:39.451 04:26:53 -- host/discovery.sh@59 -- # sort 00:29:39.451 04:26:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:39.451 04:26:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:39.451 04:26:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:39.451 04:26:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.451 04:26:53 -- host/discovery.sh@59 -- # xargs 00:29:39.451 04:26:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:39.451 04:26:53 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:39.451 04:26:53 -- host/discovery.sh@137 -- # get_bdev_list 00:29:39.451 04:26:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:39.451 04:26:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:39.451 04:26:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.451 04:26:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:39.451 04:26:53 -- host/discovery.sh@55 -- # sort 00:29:39.451 04:26:53 -- host/discovery.sh@55 -- # xargs 00:29:39.451 04:26:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:39.451 04:26:54 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:39.451 04:26:54 -- host/discovery.sh@138 -- # get_notification_count 00:29:39.451 04:26:54 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:39.451 04:26:54 -- host/discovery.sh@74 -- # jq '. | length' 00:29:39.451 04:26:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:39.451 04:26:54 -- common/autotest_common.sh@10 -- # set +x 00:29:39.451 04:26:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:39.711 04:26:54 -- host/discovery.sh@74 -- # notification_count=2 00:29:39.711 04:26:54 -- host/discovery.sh@75 -- # notify_id=4 00:29:39.711 04:26:54 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:39.711 04:26:54 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:39.711 04:26:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:39.711 04:26:54 -- common/autotest_common.sh@10 -- # set +x 00:29:40.654 [2024-05-14 04:26:55.123275] bdev_nvme.c:6753:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:40.654 [2024-05-14 04:26:55.123299] bdev_nvme.c:6833:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:40.654 [2024-05-14 04:26:55.123313] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:40.654 [2024-05-14 04:26:55.212596] bdev_nvme.c:6682:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:40.916 [2024-05-14 04:26:55.280751] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:40.916 [2024-05-14 04:26:55.280782] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:40.916 04:26:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.916 04:26:55 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:40.916 04:26:55 -- common/autotest_common.sh@640 -- # local es=0 00:29:40.916 04:26:55 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:40.916 04:26:55 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:29:40.916 04:26:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:40.916 04:26:55 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:29:40.916 04:26:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:40.916 04:26:55 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:40.916 04:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.916 04:26:55 -- common/autotest_common.sh@10 -- # set +x 00:29:40.916 request: 00:29:40.916 { 00:29:40.916 "name": "nvme", 00:29:40.916 "trtype": "tcp", 00:29:40.916 "traddr": "10.0.0.2", 00:29:40.916 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:40.916 "adrfam": "ipv4", 00:29:40.916 "trsvcid": "8009", 00:29:40.916 "wait_for_attach": true, 00:29:40.916 "method": "bdev_nvme_start_discovery", 00:29:40.916 "req_id": 1 00:29:40.916 } 00:29:40.916 Got JSON-RPC error response 00:29:40.916 response: 00:29:40.916 { 00:29:40.916 "code": -17, 00:29:40.916 "message": "File exists" 00:29:40.916 } 00:29:40.916 04:26:55 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:29:40.916 04:26:55 -- common/autotest_common.sh@643 -- # es=1 00:29:40.916 04:26:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:29:40.916 04:26:55 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:29:40.916 04:26:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:29:40.916 04:26:55 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:40.916 04:26:55 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:40.916 04:26:55 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:40.916 04:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.916 04:26:55 -- host/discovery.sh@67 -- # sort 00:29:40.916 04:26:55 -- common/autotest_common.sh@10 -- # set +x 00:29:40.916 04:26:55 -- host/discovery.sh@67 -- # xargs 00:29:40.916 04:26:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.916 04:26:55 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:40.916 04:26:55 -- host/discovery.sh@147 -- # get_bdev_list 00:29:40.916 04:26:55 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:40.916 04:26:55 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:40.916 04:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.916 04:26:55 -- host/discovery.sh@55 -- # sort 00:29:40.916 04:26:55 -- common/autotest_common.sh@10 -- # set +x 00:29:40.916 04:26:55 -- host/discovery.sh@55 -- # xargs 00:29:40.916 04:26:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.916 04:26:55 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:40.916 04:26:55 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:40.916 04:26:55 -- common/autotest_common.sh@640 -- # local es=0 00:29:40.916 04:26:55 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:40.916 04:26:55 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:29:40.916 04:26:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:40.916 04:26:55 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:29:40.916 04:26:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:40.916 04:26:55 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:40.916 04:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.916 04:26:55 -- common/autotest_common.sh@10 -- # set +x 00:29:40.916 request: 00:29:40.916 { 00:29:40.916 "name": "nvme_second", 00:29:40.916 "trtype": "tcp", 00:29:40.916 "traddr": "10.0.0.2", 00:29:40.916 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:40.916 "adrfam": "ipv4", 00:29:40.916 "trsvcid": "8009", 00:29:40.916 "wait_for_attach": true, 00:29:40.916 "method": "bdev_nvme_start_discovery", 00:29:40.916 "req_id": 1 00:29:40.916 } 00:29:40.916 Got JSON-RPC error response 00:29:40.916 response: 00:29:40.916 { 00:29:40.916 "code": -17, 00:29:40.916 "message": "File exists" 00:29:40.916 } 00:29:40.916 04:26:55 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:29:40.916 04:26:55 -- common/autotest_common.sh@643 -- # es=1 00:29:40.916 04:26:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:29:40.916 04:26:55 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:29:40.916 04:26:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:29:40.916 04:26:55 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:40.916 04:26:55 -- host/discovery.sh@67 -- # sort 00:29:40.916 04:26:55 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:40.916 04:26:55 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:40.916 04:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.916 04:26:55 -- common/autotest_common.sh@10 -- # set +x 00:29:40.916 04:26:55 -- host/discovery.sh@67 -- # xargs 00:29:40.916 04:26:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.916 04:26:55 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:40.916 04:26:55 -- host/discovery.sh@153 -- # get_bdev_list 00:29:40.916 04:26:55 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:40.916 04:26:55 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:40.916 04:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.916 04:26:55 -- common/autotest_common.sh@10 -- # set +x 00:29:40.916 04:26:55 -- host/discovery.sh@55 -- # sort 00:29:40.916 04:26:55 -- host/discovery.sh@55 -- # xargs 00:29:41.178 04:26:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.178 04:26:55 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:41.178 04:26:55 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:41.178 04:26:55 -- common/autotest_common.sh@640 -- # local es=0 00:29:41.178 04:26:55 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:41.178 04:26:55 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:29:41.178 04:26:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:41.178 04:26:55 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:29:41.178 04:26:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:29:41.178 04:26:55 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:41.178 04:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.178 04:26:55 -- common/autotest_common.sh@10 -- # set +x 00:29:42.120 [2024-05-14 04:26:56.548500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:42.120 [2024-05-14 04:26:56.549016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:42.120 [2024-05-14 04:26:56.549029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1388c80 with addr=10.0.0.2, port=8010 00:29:42.120 [2024-05-14 04:26:56.549043] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:42.120 [2024-05-14 04:26:56.549050] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:42.120 [2024-05-14 04:26:56.549057] bdev_nvme.c:6815:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:43.062 [2024-05-14 04:26:57.550720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:43.062 [2024-05-14 04:26:57.551200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:43.062 [2024-05-14 04:26:57.551210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x139c800 with addr=10.0.0.2, port=8010 00:29:43.062 [2024-05-14 04:26:57.551221] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:43.062 [2024-05-14 04:26:57.551227] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:43.062 [2024-05-14 04:26:57.551234] bdev_nvme.c:6815:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:44.005 [2024-05-14 04:26:58.552602] bdev_nvme.c:6796:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:44.005 request: 00:29:44.005 { 00:29:44.005 "name": "nvme_second", 00:29:44.005 "trtype": "tcp", 00:29:44.005 "traddr": "10.0.0.2", 00:29:44.005 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:44.005 "adrfam": "ipv4", 00:29:44.005 "trsvcid": "8010", 00:29:44.005 "attach_timeout_ms": 3000, 00:29:44.005 "method": "bdev_nvme_start_discovery", 00:29:44.005 "req_id": 1 00:29:44.005 } 00:29:44.005 Got JSON-RPC error response 00:29:44.005 response: 00:29:44.005 { 00:29:44.005 "code": -110, 00:29:44.005 "message": "Connection timed out" 00:29:44.005 } 00:29:44.005 04:26:58 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:29:44.005 04:26:58 -- common/autotest_common.sh@643 -- # es=1 00:29:44.005 04:26:58 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:29:44.005 04:26:58 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:29:44.005 04:26:58 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:29:44.005 04:26:58 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:44.005 04:26:58 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:44.005 04:26:58 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:44.005 04:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:44.005 04:26:58 -- host/discovery.sh@67 -- # sort 00:29:44.005 04:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:44.005 04:26:58 -- host/discovery.sh@67 -- # xargs 00:29:44.005 04:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:44.266 04:26:58 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:44.266 04:26:58 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:44.266 04:26:58 -- host/discovery.sh@162 -- # kill 4117643 00:29:44.266 04:26:58 -- host/discovery.sh@163 -- # nvmftestfini 00:29:44.266 04:26:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:44.266 04:26:58 -- nvmf/common.sh@116 -- # sync 00:29:44.266 04:26:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:44.266 04:26:58 -- nvmf/common.sh@119 -- # set +e 00:29:44.266 04:26:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:44.266 04:26:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:44.266 rmmod nvme_tcp 00:29:44.266 rmmod nvme_fabrics 00:29:44.266 rmmod nvme_keyring 00:29:44.266 04:26:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:44.266 04:26:58 -- nvmf/common.sh@123 -- # set -e 00:29:44.266 04:26:58 -- nvmf/common.sh@124 -- # return 0 00:29:44.266 04:26:58 -- nvmf/common.sh@477 -- # '[' -n 4117588 ']' 00:29:44.266 04:26:58 -- nvmf/common.sh@478 -- # killprocess 4117588 00:29:44.266 04:26:58 -- common/autotest_common.sh@926 -- # '[' -z 4117588 ']' 00:29:44.266 04:26:58 -- common/autotest_common.sh@930 -- # kill -0 4117588 00:29:44.266 04:26:58 -- common/autotest_common.sh@931 -- # uname 00:29:44.266 04:26:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:44.266 04:26:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4117588 00:29:44.266 04:26:58 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:44.266 04:26:58 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:44.266 04:26:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4117588' 00:29:44.266 killing process with pid 4117588 00:29:44.267 04:26:58 -- common/autotest_common.sh@945 -- # kill 4117588 00:29:44.267 04:26:58 -- common/autotest_common.sh@950 -- # wait 4117588 00:29:44.267 04:26:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:44.267 04:26:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:44.267 04:26:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:44.267 04:26:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:44.267 04:26:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:44.267 04:26:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:44.267 04:26:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:44.267 04:26:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:46.814 04:27:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:46.814 00:29:46.814 real 0m22.314s 00:29:46.814 user 0m28.321s 00:29:46.814 sys 0m6.646s 00:29:46.814 04:27:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:46.814 04:27:00 -- common/autotest_common.sh@10 -- # set +x 00:29:46.814 ************************************ 00:29:46.814 END TEST nvmf_discovery 00:29:46.814 ************************************ 00:29:46.814 04:27:00 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:46.814 04:27:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:46.814 04:27:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:46.814 04:27:00 -- common/autotest_common.sh@10 -- # set +x 00:29:46.814 ************************************ 00:29:46.814 START TEST nvmf_discovery_remove_ifc 00:29:46.814 ************************************ 00:29:46.814 04:27:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:46.814 * Looking for test storage... 00:29:46.814 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:46.814 04:27:01 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:46.814 04:27:01 -- nvmf/common.sh@7 -- # uname -s 00:29:46.814 04:27:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:46.814 04:27:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:46.814 04:27:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:46.814 04:27:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:46.814 04:27:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:46.814 04:27:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:46.814 04:27:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:46.814 04:27:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:46.814 04:27:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:46.814 04:27:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:46.814 04:27:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:29:46.814 04:27:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:29:46.814 04:27:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:46.814 04:27:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:46.814 04:27:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:46.814 04:27:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:46.814 04:27:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:46.814 04:27:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:46.814 04:27:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:46.814 04:27:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:46.814 04:27:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:46.814 04:27:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:46.814 04:27:01 -- paths/export.sh@5 -- # export PATH 00:29:46.814 04:27:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:46.814 04:27:01 -- nvmf/common.sh@46 -- # : 0 00:29:46.814 04:27:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:46.814 04:27:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:46.814 04:27:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:46.814 04:27:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:46.814 04:27:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:46.814 04:27:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:46.814 04:27:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:46.814 04:27:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:46.814 04:27:01 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:46.814 04:27:01 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:46.814 04:27:01 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:46.814 04:27:01 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:46.814 04:27:01 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:46.814 04:27:01 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:46.814 04:27:01 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:46.814 04:27:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:46.814 04:27:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:46.814 04:27:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:46.814 04:27:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:46.814 04:27:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:46.814 04:27:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:46.814 04:27:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:46.814 04:27:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:46.814 04:27:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:46.814 04:27:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:46.814 04:27:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:46.814 04:27:01 -- common/autotest_common.sh@10 -- # set +x 00:29:53.402 04:27:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:53.402 04:27:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:53.402 04:27:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:53.402 04:27:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:53.402 04:27:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:53.402 04:27:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:53.402 04:27:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:53.402 04:27:07 -- nvmf/common.sh@294 -- # net_devs=() 00:29:53.402 04:27:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:53.402 04:27:07 -- nvmf/common.sh@295 -- # e810=() 00:29:53.402 04:27:07 -- nvmf/common.sh@295 -- # local -ga e810 00:29:53.402 04:27:07 -- nvmf/common.sh@296 -- # x722=() 00:29:53.402 04:27:07 -- nvmf/common.sh@296 -- # local -ga x722 00:29:53.402 04:27:07 -- nvmf/common.sh@297 -- # mlx=() 00:29:53.402 04:27:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:53.402 04:27:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:53.402 04:27:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:53.402 04:27:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:53.402 04:27:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:53.402 04:27:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:53.402 04:27:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:53.402 04:27:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:53.402 04:27:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:53.402 04:27:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:53.403 04:27:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:53.403 04:27:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:53.403 04:27:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:53.403 04:27:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:53.403 04:27:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:53.403 04:27:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:53.403 04:27:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:29:53.403 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:29:53.403 04:27:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:53.403 04:27:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:29:53.403 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:29:53.403 04:27:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:53.403 04:27:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:53.403 04:27:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:53.403 04:27:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:53.403 04:27:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:53.403 04:27:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:29:53.403 Found net devices under 0000:4b:00.0: cvl_0_0 00:29:53.403 04:27:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:53.403 04:27:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:53.403 04:27:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:53.403 04:27:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:53.403 04:27:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:53.403 04:27:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:29:53.403 Found net devices under 0000:4b:00.1: cvl_0_1 00:29:53.403 04:27:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:53.403 04:27:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:53.403 04:27:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:53.403 04:27:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:53.403 04:27:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:53.403 04:27:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:53.403 04:27:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:53.403 04:27:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:53.403 04:27:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:53.403 04:27:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:53.403 04:27:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:53.403 04:27:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:53.403 04:27:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:53.403 04:27:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:53.403 04:27:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:53.403 04:27:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:53.403 04:27:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:53.403 04:27:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:53.665 04:27:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:53.665 04:27:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:53.665 04:27:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:53.665 04:27:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:53.665 04:27:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:53.665 04:27:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:53.665 04:27:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:53.665 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:53.665 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.621 ms 00:29:53.665 00:29:53.665 --- 10.0.0.2 ping statistics --- 00:29:53.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:53.665 rtt min/avg/max/mdev = 0.621/0.621/0.621/0.000 ms 00:29:53.665 04:27:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:53.665 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:53.665 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.420 ms 00:29:53.665 00:29:53.665 --- 10.0.0.1 ping statistics --- 00:29:53.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:53.665 rtt min/avg/max/mdev = 0.420/0.420/0.420/0.000 ms 00:29:53.665 04:27:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:53.665 04:27:08 -- nvmf/common.sh@410 -- # return 0 00:29:53.665 04:27:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:53.665 04:27:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:53.665 04:27:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:53.665 04:27:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:53.665 04:27:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:53.665 04:27:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:53.665 04:27:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:53.665 04:27:08 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:53.665 04:27:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:53.665 04:27:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:53.665 04:27:08 -- common/autotest_common.sh@10 -- # set +x 00:29:53.665 04:27:08 -- nvmf/common.sh@469 -- # nvmfpid=4124636 00:29:53.665 04:27:08 -- nvmf/common.sh@470 -- # waitforlisten 4124636 00:29:53.665 04:27:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:53.665 04:27:08 -- common/autotest_common.sh@819 -- # '[' -z 4124636 ']' 00:29:53.665 04:27:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:53.665 04:27:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:53.665 04:27:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:53.665 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:53.665 04:27:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:53.665 04:27:08 -- common/autotest_common.sh@10 -- # set +x 00:29:53.927 [2024-05-14 04:27:08.281697] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:53.927 [2024-05-14 04:27:08.281765] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:53.927 EAL: No free 2048 kB hugepages reported on node 1 00:29:53.927 [2024-05-14 04:27:08.368412] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:53.927 [2024-05-14 04:27:08.462532] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:53.927 [2024-05-14 04:27:08.462681] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:53.927 [2024-05-14 04:27:08.462692] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:53.927 [2024-05-14 04:27:08.462700] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:53.927 [2024-05-14 04:27:08.462723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:54.501 04:27:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:54.501 04:27:09 -- common/autotest_common.sh@852 -- # return 0 00:29:54.501 04:27:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:54.501 04:27:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:54.501 04:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:54.821 04:27:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:54.821 04:27:09 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:54.821 04:27:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:54.821 04:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:54.821 [2024-05-14 04:27:09.122494] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:54.821 [2024-05-14 04:27:09.130683] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:54.821 null0 00:29:54.821 [2024-05-14 04:27:09.162680] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:54.821 04:27:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:54.821 04:27:09 -- host/discovery_remove_ifc.sh@59 -- # hostpid=4125077 00:29:54.821 04:27:09 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 4125077 /tmp/host.sock 00:29:54.821 04:27:09 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:54.821 04:27:09 -- common/autotest_common.sh@819 -- # '[' -z 4125077 ']' 00:29:54.821 04:27:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:29:54.821 04:27:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:54.821 04:27:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:54.821 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:54.821 04:27:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:54.821 04:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:54.821 [2024-05-14 04:27:09.233356] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:54.821 [2024-05-14 04:27:09.233416] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4125077 ] 00:29:54.821 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.821 [2024-05-14 04:27:09.297047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:54.821 [2024-05-14 04:27:09.369097] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:54.821 [2024-05-14 04:27:09.369227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:55.766 04:27:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:55.766 04:27:10 -- common/autotest_common.sh@852 -- # return 0 00:29:55.766 04:27:10 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:55.766 04:27:10 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:55.766 04:27:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:55.766 04:27:10 -- common/autotest_common.sh@10 -- # set +x 00:29:55.766 04:27:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:55.766 04:27:10 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:55.766 04:27:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:55.766 04:27:10 -- common/autotest_common.sh@10 -- # set +x 00:29:55.766 04:27:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:55.766 04:27:10 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:55.766 04:27:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:55.766 04:27:10 -- common/autotest_common.sh@10 -- # set +x 00:29:56.709 [2024-05-14 04:27:11.142514] bdev_nvme.c:6753:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:56.709 [2024-05-14 04:27:11.142539] bdev_nvme.c:6833:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:56.709 [2024-05-14 04:27:11.142554] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:56.709 [2024-05-14 04:27:11.230830] bdev_nvme.c:6682:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:56.709 [2024-05-14 04:27:11.294532] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:56.709 [2024-05-14 04:27:11.294576] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:56.709 [2024-05-14 04:27:11.294601] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:56.709 [2024-05-14 04:27:11.294619] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:56.709 [2024-05-14 04:27:11.294640] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:56.709 04:27:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:56.709 04:27:11 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:56.970 04:27:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:56.970 04:27:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:56.970 [2024-05-14 04:27:11.301239] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x18534d0 was disconnected and freed. delete nvme_qpair. 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:56.971 04:27:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:56.971 04:27:11 -- common/autotest_common.sh@10 -- # set +x 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:56.971 04:27:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:56.971 04:27:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:56.971 04:27:11 -- common/autotest_common.sh@10 -- # set +x 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:56.971 04:27:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:56.971 04:27:11 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:58.356 04:27:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:58.356 04:27:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:58.356 04:27:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:58.356 04:27:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:58.356 04:27:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:58.356 04:27:12 -- common/autotest_common.sh@10 -- # set +x 00:29:58.356 04:27:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:58.356 04:27:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:58.356 04:27:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:58.356 04:27:12 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:59.300 04:27:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:59.300 04:27:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:59.300 04:27:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:59.300 04:27:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:59.300 04:27:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:59.300 04:27:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:59.300 04:27:13 -- common/autotest_common.sh@10 -- # set +x 00:29:59.300 04:27:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:59.300 04:27:13 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:59.300 04:27:13 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:00.241 04:27:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:00.241 04:27:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:00.241 04:27:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:00.241 04:27:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:00.241 04:27:14 -- common/autotest_common.sh@10 -- # set +x 00:30:00.241 04:27:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:00.241 04:27:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:00.241 04:27:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:00.241 04:27:14 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:00.241 04:27:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:01.185 04:27:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:01.185 04:27:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:01.185 04:27:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:01.185 04:27:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:01.185 04:27:15 -- common/autotest_common.sh@10 -- # set +x 00:30:01.185 04:27:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:01.185 04:27:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:01.185 04:27:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:01.185 04:27:15 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:01.185 04:27:15 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:02.573 [2024-05-14 04:27:16.734860] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:30:02.573 [2024-05-14 04:27:16.734900] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:02.573 [2024-05-14 04:27:16.734912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.573 [2024-05-14 04:27:16.734921] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:02.573 [2024-05-14 04:27:16.734928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.573 [2024-05-14 04:27:16.734937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:02.573 [2024-05-14 04:27:16.734944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.573 [2024-05-14 04:27:16.734952] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:02.573 [2024-05-14 04:27:16.734959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.573 [2024-05-14 04:27:16.734968] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:30:02.573 [2024-05-14 04:27:16.734975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.573 [2024-05-14 04:27:16.734982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1819b30 is same with the state(5) to be set 00:30:02.573 [2024-05-14 04:27:16.744882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1819b30 (9): Bad file descriptor 00:30:02.573 [2024-05-14 04:27:16.754924] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:30:02.573 04:27:16 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:02.573 04:27:16 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:02.573 04:27:16 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:02.573 04:27:16 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:02.573 04:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:02.573 04:27:16 -- common/autotest_common.sh@10 -- # set +x 00:30:02.573 04:27:16 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:03.517 [2024-05-14 04:27:17.819316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:30:04.459 [2024-05-14 04:27:18.843322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:30:04.459 [2024-05-14 04:27:18.843360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1819b30 with addr=10.0.0.2, port=4420 00:30:04.459 [2024-05-14 04:27:18.843372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1819b30 is same with the state(5) to be set 00:30:04.459 [2024-05-14 04:27:18.843701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1819b30 (9): Bad file descriptor 00:30:04.459 [2024-05-14 04:27:18.843722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.459 [2024-05-14 04:27:18.843739] bdev_nvme.c:6504:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:30:04.459 [2024-05-14 04:27:18.843764] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:04.459 [2024-05-14 04:27:18.843774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:04.460 [2024-05-14 04:27:18.843783] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:04.460 [2024-05-14 04:27:18.843790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:04.460 [2024-05-14 04:27:18.843798] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:04.460 [2024-05-14 04:27:18.843805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:04.460 [2024-05-14 04:27:18.843812] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:04.460 [2024-05-14 04:27:18.843819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:04.460 [2024-05-14 04:27:18.843827] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:30:04.460 [2024-05-14 04:27:18.843834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:04.460 [2024-05-14 04:27:18.843842] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:30:04.460 [2024-05-14 04:27:18.844392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1819f40 (9): Bad file descriptor 00:30:04.460 [2024-05-14 04:27:18.845403] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:30:04.460 [2024-05-14 04:27:18.845414] nvme_ctrlr.c:1135:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:30:04.460 04:27:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:04.460 04:27:18 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:30:04.460 04:27:18 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:05.404 04:27:19 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:05.404 04:27:19 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:05.404 04:27:19 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:05.404 04:27:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:05.404 04:27:19 -- common/autotest_common.sh@10 -- # set +x 00:30:05.404 04:27:19 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:05.404 04:27:19 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:05.404 04:27:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:05.404 04:27:19 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:30:05.404 04:27:19 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:05.404 04:27:19 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:05.665 04:27:20 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:30:05.665 04:27:20 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:05.665 04:27:20 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:05.665 04:27:20 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:05.665 04:27:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:05.665 04:27:20 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:05.665 04:27:20 -- common/autotest_common.sh@10 -- # set +x 00:30:05.665 04:27:20 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:05.665 04:27:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:05.665 04:27:20 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:30:05.665 04:27:20 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:06.609 [2024-05-14 04:27:20.897614] bdev_nvme.c:6753:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:30:06.609 [2024-05-14 04:27:20.897643] bdev_nvme.c:6833:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:30:06.610 [2024-05-14 04:27:20.897659] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:30:06.610 [2024-05-14 04:27:21.028072] bdev_nvme.c:6682:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:30:06.610 04:27:21 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:06.610 04:27:21 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:06.610 04:27:21 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:06.610 04:27:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.610 04:27:21 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:06.610 04:27:21 -- common/autotest_common.sh@10 -- # set +x 00:30:06.610 04:27:21 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:06.610 04:27:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.610 04:27:21 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:30:06.610 04:27:21 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:30:06.871 [2024-05-14 04:27:21.250821] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:30:06.871 [2024-05-14 04:27:21.250862] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:30:06.871 [2024-05-14 04:27:21.250881] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:30:06.871 [2024-05-14 04:27:21.250896] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:30:06.871 [2024-05-14 04:27:21.250904] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:30:06.871 [2024-05-14 04:27:21.255586] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1827580 was disconnected and freed. delete nvme_qpair. 00:30:07.816 04:27:22 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:30:07.816 04:27:22 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:30:07.816 04:27:22 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:30:07.816 04:27:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:07.816 04:27:22 -- host/discovery_remove_ifc.sh@29 -- # sort 00:30:07.816 04:27:22 -- common/autotest_common.sh@10 -- # set +x 00:30:07.816 04:27:22 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:30:07.817 04:27:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:07.817 04:27:22 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:30:07.817 04:27:22 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:30:07.817 04:27:22 -- host/discovery_remove_ifc.sh@90 -- # killprocess 4125077 00:30:07.817 04:27:22 -- common/autotest_common.sh@926 -- # '[' -z 4125077 ']' 00:30:07.817 04:27:22 -- common/autotest_common.sh@930 -- # kill -0 4125077 00:30:07.817 04:27:22 -- common/autotest_common.sh@931 -- # uname 00:30:07.817 04:27:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:07.817 04:27:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4125077 00:30:07.817 04:27:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:07.817 04:27:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:07.817 04:27:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4125077' 00:30:07.817 killing process with pid 4125077 00:30:07.817 04:27:22 -- common/autotest_common.sh@945 -- # kill 4125077 00:30:07.817 04:27:22 -- common/autotest_common.sh@950 -- # wait 4125077 00:30:07.817 04:27:22 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:30:07.817 04:27:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:07.817 04:27:22 -- nvmf/common.sh@116 -- # sync 00:30:07.817 04:27:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:07.817 04:27:22 -- nvmf/common.sh@119 -- # set +e 00:30:07.817 04:27:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:07.817 04:27:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:07.817 rmmod nvme_tcp 00:30:07.817 rmmod nvme_fabrics 00:30:08.078 rmmod nvme_keyring 00:30:08.078 04:27:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:08.078 04:27:22 -- nvmf/common.sh@123 -- # set -e 00:30:08.078 04:27:22 -- nvmf/common.sh@124 -- # return 0 00:30:08.078 04:27:22 -- nvmf/common.sh@477 -- # '[' -n 4124636 ']' 00:30:08.078 04:27:22 -- nvmf/common.sh@478 -- # killprocess 4124636 00:30:08.078 04:27:22 -- common/autotest_common.sh@926 -- # '[' -z 4124636 ']' 00:30:08.078 04:27:22 -- common/autotest_common.sh@930 -- # kill -0 4124636 00:30:08.078 04:27:22 -- common/autotest_common.sh@931 -- # uname 00:30:08.078 04:27:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:08.078 04:27:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4124636 00:30:08.078 04:27:22 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:08.078 04:27:22 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:08.078 04:27:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4124636' 00:30:08.078 killing process with pid 4124636 00:30:08.078 04:27:22 -- common/autotest_common.sh@945 -- # kill 4124636 00:30:08.078 04:27:22 -- common/autotest_common.sh@950 -- # wait 4124636 00:30:08.078 04:27:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:08.078 04:27:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:08.078 04:27:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:08.078 04:27:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:08.078 04:27:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:08.078 04:27:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:08.078 04:27:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:08.078 04:27:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:10.627 04:27:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:10.627 00:30:10.627 real 0m23.708s 00:30:10.627 user 0m27.892s 00:30:10.627 sys 0m6.578s 00:30:10.627 04:27:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:10.627 04:27:24 -- common/autotest_common.sh@10 -- # set +x 00:30:10.627 ************************************ 00:30:10.627 END TEST nvmf_discovery_remove_ifc 00:30:10.627 ************************************ 00:30:10.627 04:27:24 -- nvmf/nvmf.sh@105 -- # [[ tcp == \t\c\p ]] 00:30:10.627 04:27:24 -- nvmf/nvmf.sh@106 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:30:10.627 04:27:24 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:10.627 04:27:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:10.627 04:27:24 -- common/autotest_common.sh@10 -- # set +x 00:30:10.627 ************************************ 00:30:10.627 START TEST nvmf_digest 00:30:10.627 ************************************ 00:30:10.627 04:27:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:30:10.627 * Looking for test storage... 00:30:10.627 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:10.627 04:27:24 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:10.627 04:27:24 -- nvmf/common.sh@7 -- # uname -s 00:30:10.627 04:27:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:10.627 04:27:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:10.627 04:27:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:10.627 04:27:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:10.627 04:27:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:10.627 04:27:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:10.627 04:27:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:10.627 04:27:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:10.627 04:27:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:10.627 04:27:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:10.627 04:27:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:10.627 04:27:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:10.627 04:27:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:10.627 04:27:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:10.627 04:27:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:10.627 04:27:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:10.627 04:27:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:10.627 04:27:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:10.627 04:27:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:10.627 04:27:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:10.627 04:27:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:10.627 04:27:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:10.627 04:27:24 -- paths/export.sh@5 -- # export PATH 00:30:10.628 04:27:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:10.628 04:27:24 -- nvmf/common.sh@46 -- # : 0 00:30:10.628 04:27:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:10.628 04:27:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:10.628 04:27:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:10.628 04:27:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:10.628 04:27:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:10.628 04:27:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:10.628 04:27:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:10.628 04:27:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:10.628 04:27:24 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:30:10.628 04:27:24 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:30:10.628 04:27:24 -- host/digest.sh@16 -- # runtime=2 00:30:10.628 04:27:24 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:30:10.628 04:27:24 -- host/digest.sh@132 -- # nvmftestinit 00:30:10.628 04:27:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:10.628 04:27:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:10.628 04:27:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:10.628 04:27:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:10.628 04:27:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:10.628 04:27:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:10.628 04:27:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:10.628 04:27:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:10.628 04:27:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:10.628 04:27:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:10.628 04:27:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:10.628 04:27:24 -- common/autotest_common.sh@10 -- # set +x 00:30:17.280 04:27:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:17.280 04:27:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:17.280 04:27:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:17.280 04:27:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:17.280 04:27:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:17.280 04:27:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:17.280 04:27:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:17.280 04:27:31 -- nvmf/common.sh@294 -- # net_devs=() 00:30:17.280 04:27:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:17.280 04:27:31 -- nvmf/common.sh@295 -- # e810=() 00:30:17.280 04:27:31 -- nvmf/common.sh@295 -- # local -ga e810 00:30:17.280 04:27:31 -- nvmf/common.sh@296 -- # x722=() 00:30:17.280 04:27:31 -- nvmf/common.sh@296 -- # local -ga x722 00:30:17.280 04:27:31 -- nvmf/common.sh@297 -- # mlx=() 00:30:17.280 04:27:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:17.280 04:27:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:17.280 04:27:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:17.280 04:27:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:17.280 04:27:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:17.280 04:27:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:17.280 04:27:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:30:17.280 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:30:17.280 04:27:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:17.280 04:27:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:30:17.280 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:30:17.280 04:27:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:17.280 04:27:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:17.280 04:27:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:17.280 04:27:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:17.280 04:27:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:17.280 04:27:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:30:17.280 Found net devices under 0000:4b:00.0: cvl_0_0 00:30:17.280 04:27:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:17.280 04:27:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:17.280 04:27:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:17.280 04:27:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:17.280 04:27:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:17.280 04:27:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:30:17.280 Found net devices under 0000:4b:00.1: cvl_0_1 00:30:17.280 04:27:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:17.280 04:27:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:17.280 04:27:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:17.280 04:27:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:17.280 04:27:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:17.280 04:27:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:17.280 04:27:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:17.280 04:27:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:17.280 04:27:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:17.280 04:27:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:17.280 04:27:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:17.280 04:27:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:17.280 04:27:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:17.280 04:27:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:17.280 04:27:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:17.280 04:27:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:17.280 04:27:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:17.280 04:27:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:17.280 04:27:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:17.280 04:27:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:17.280 04:27:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:17.280 04:27:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:17.280 04:27:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:17.280 04:27:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:17.280 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:17.280 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.682 ms 00:30:17.280 00:30:17.280 --- 10.0.0.2 ping statistics --- 00:30:17.280 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:17.280 rtt min/avg/max/mdev = 0.682/0.682/0.682/0.000 ms 00:30:17.280 04:27:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:17.280 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:17.280 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.388 ms 00:30:17.280 00:30:17.280 --- 10.0.0.1 ping statistics --- 00:30:17.280 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:17.280 rtt min/avg/max/mdev = 0.388/0.388/0.388/0.000 ms 00:30:17.280 04:27:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:17.280 04:27:31 -- nvmf/common.sh@410 -- # return 0 00:30:17.280 04:27:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:17.280 04:27:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:17.280 04:27:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:17.280 04:27:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:17.280 04:27:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:17.280 04:27:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:17.280 04:27:31 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:30:17.280 04:27:31 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:30:17.280 04:27:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:17.280 04:27:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:17.280 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:30:17.280 ************************************ 00:30:17.280 START TEST nvmf_digest_clean 00:30:17.280 ************************************ 00:30:17.280 04:27:31 -- common/autotest_common.sh@1104 -- # run_digest 00:30:17.280 04:27:31 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:30:17.280 04:27:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:17.280 04:27:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:17.280 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:30:17.280 04:27:31 -- nvmf/common.sh@469 -- # nvmfpid=4131714 00:30:17.280 04:27:31 -- nvmf/common.sh@470 -- # waitforlisten 4131714 00:30:17.280 04:27:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:30:17.280 04:27:31 -- common/autotest_common.sh@819 -- # '[' -z 4131714 ']' 00:30:17.280 04:27:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:17.280 04:27:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:17.280 04:27:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:17.280 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:17.280 04:27:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:17.280 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:30:17.542 [2024-05-14 04:27:31.890434] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:17.542 [2024-05-14 04:27:31.890500] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:17.542 EAL: No free 2048 kB hugepages reported on node 1 00:30:17.542 [2024-05-14 04:27:31.960166] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:17.542 [2024-05-14 04:27:32.032173] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:17.542 [2024-05-14 04:27:32.032301] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:17.542 [2024-05-14 04:27:32.032309] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:17.542 [2024-05-14 04:27:32.032316] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:17.542 [2024-05-14 04:27:32.032332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:18.149 04:27:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:18.149 04:27:32 -- common/autotest_common.sh@852 -- # return 0 00:30:18.149 04:27:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:18.149 04:27:32 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:18.149 04:27:32 -- common/autotest_common.sh@10 -- # set +x 00:30:18.149 04:27:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:18.149 04:27:32 -- host/digest.sh@120 -- # common_target_config 00:30:18.149 04:27:32 -- host/digest.sh@43 -- # rpc_cmd 00:30:18.149 04:27:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:18.149 04:27:32 -- common/autotest_common.sh@10 -- # set +x 00:30:18.409 null0 00:30:18.409 [2024-05-14 04:27:32.758862] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:18.409 [2024-05-14 04:27:32.783057] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:18.409 04:27:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:18.409 04:27:32 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:30:18.409 04:27:32 -- host/digest.sh@77 -- # local rw bs qd 00:30:18.409 04:27:32 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:18.409 04:27:32 -- host/digest.sh@80 -- # rw=randread 00:30:18.410 04:27:32 -- host/digest.sh@80 -- # bs=4096 00:30:18.410 04:27:32 -- host/digest.sh@80 -- # qd=128 00:30:18.410 04:27:32 -- host/digest.sh@82 -- # bperfpid=4131904 00:30:18.410 04:27:32 -- host/digest.sh@83 -- # waitforlisten 4131904 /var/tmp/bperf.sock 00:30:18.410 04:27:32 -- common/autotest_common.sh@819 -- # '[' -z 4131904 ']' 00:30:18.410 04:27:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:18.410 04:27:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:18.410 04:27:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:18.410 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:18.410 04:27:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:18.410 04:27:32 -- common/autotest_common.sh@10 -- # set +x 00:30:18.410 04:27:32 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:30:18.410 [2024-05-14 04:27:32.831110] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:18.410 [2024-05-14 04:27:32.831155] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4131904 ] 00:30:18.410 EAL: No free 2048 kB hugepages reported on node 1 00:30:18.410 [2024-05-14 04:27:32.909406] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:18.410 [2024-05-14 04:27:32.975031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:19.202 04:27:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:19.202 04:27:33 -- common/autotest_common.sh@852 -- # return 0 00:30:19.202 04:27:33 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:19.202 04:27:33 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:19.202 04:27:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:19.202 04:27:33 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:19.202 04:27:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:19.770 nvme0n1 00:30:19.770 04:27:34 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:19.770 04:27:34 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:19.770 Running I/O for 2 seconds... 00:30:21.684 00:30:21.684 Latency(us) 00:30:21.684 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:21.684 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:30:21.684 nvme0n1 : 2.00 22477.05 87.80 0.00 0.00 5687.85 2935.47 15073.28 00:30:21.684 =================================================================================================================== 00:30:21.684 Total : 22477.05 87.80 0.00 0.00 5687.85 2935.47 15073.28 00:30:21.684 0 00:30:21.684 04:27:36 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:21.684 04:27:36 -- host/digest.sh@92 -- # get_accel_stats 00:30:21.684 04:27:36 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:21.684 04:27:36 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:21.684 | select(.opcode=="crc32c") 00:30:21.684 | "\(.module_name) \(.executed)"' 00:30:21.684 04:27:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:21.946 04:27:36 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:21.946 04:27:36 -- host/digest.sh@93 -- # exp_module=software 00:30:21.946 04:27:36 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:21.946 04:27:36 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:21.946 04:27:36 -- host/digest.sh@97 -- # killprocess 4131904 00:30:21.946 04:27:36 -- common/autotest_common.sh@926 -- # '[' -z 4131904 ']' 00:30:21.946 04:27:36 -- common/autotest_common.sh@930 -- # kill -0 4131904 00:30:21.946 04:27:36 -- common/autotest_common.sh@931 -- # uname 00:30:21.946 04:27:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:21.946 04:27:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4131904 00:30:21.946 04:27:36 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:21.946 04:27:36 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:21.946 04:27:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4131904' 00:30:21.946 killing process with pid 4131904 00:30:21.946 04:27:36 -- common/autotest_common.sh@945 -- # kill 4131904 00:30:21.946 Received shutdown signal, test time was about 2.000000 seconds 00:30:21.946 00:30:21.946 Latency(us) 00:30:21.946 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:21.946 =================================================================================================================== 00:30:21.946 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:21.946 04:27:36 -- common/autotest_common.sh@950 -- # wait 4131904 00:30:22.208 04:27:36 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:30:22.208 04:27:36 -- host/digest.sh@77 -- # local rw bs qd 00:30:22.208 04:27:36 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:22.208 04:27:36 -- host/digest.sh@80 -- # rw=randread 00:30:22.208 04:27:36 -- host/digest.sh@80 -- # bs=131072 00:30:22.208 04:27:36 -- host/digest.sh@80 -- # qd=16 00:30:22.208 04:27:36 -- host/digest.sh@82 -- # bperfpid=4132595 00:30:22.208 04:27:36 -- host/digest.sh@83 -- # waitforlisten 4132595 /var/tmp/bperf.sock 00:30:22.208 04:27:36 -- common/autotest_common.sh@819 -- # '[' -z 4132595 ']' 00:30:22.208 04:27:36 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:30:22.208 04:27:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:22.208 04:27:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:22.208 04:27:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:22.208 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:22.208 04:27:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:22.208 04:27:36 -- common/autotest_common.sh@10 -- # set +x 00:30:22.208 [2024-05-14 04:27:36.605454] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:22.208 [2024-05-14 04:27:36.605524] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4132595 ] 00:30:22.208 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:22.208 Zero copy mechanism will not be used. 00:30:22.208 EAL: No free 2048 kB hugepages reported on node 1 00:30:22.208 [2024-05-14 04:27:36.683142] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:22.208 [2024-05-14 04:27:36.742972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:22.780 04:27:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:22.780 04:27:37 -- common/autotest_common.sh@852 -- # return 0 00:30:22.780 04:27:37 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:22.780 04:27:37 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:22.780 04:27:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:23.042 04:27:37 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:23.042 04:27:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:23.303 nvme0n1 00:30:23.303 04:27:37 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:23.303 04:27:37 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:23.564 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:23.564 Zero copy mechanism will not be used. 00:30:23.564 Running I/O for 2 seconds... 00:30:25.480 00:30:25.480 Latency(us) 00:30:25.480 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.480 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:25.480 nvme0n1 : 2.01 1881.04 235.13 0.00 0.00 8500.21 5952.85 21080.75 00:30:25.480 =================================================================================================================== 00:30:25.480 Total : 1881.04 235.13 0.00 0.00 8500.21 5952.85 21080.75 00:30:25.480 0 00:30:25.480 04:27:39 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:25.480 04:27:39 -- host/digest.sh@92 -- # get_accel_stats 00:30:25.480 04:27:39 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:25.480 04:27:39 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:25.480 | select(.opcode=="crc32c") 00:30:25.480 | "\(.module_name) \(.executed)"' 00:30:25.480 04:27:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:25.741 04:27:40 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:25.741 04:27:40 -- host/digest.sh@93 -- # exp_module=software 00:30:25.741 04:27:40 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:25.741 04:27:40 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:25.741 04:27:40 -- host/digest.sh@97 -- # killprocess 4132595 00:30:25.741 04:27:40 -- common/autotest_common.sh@926 -- # '[' -z 4132595 ']' 00:30:25.741 04:27:40 -- common/autotest_common.sh@930 -- # kill -0 4132595 00:30:25.741 04:27:40 -- common/autotest_common.sh@931 -- # uname 00:30:25.741 04:27:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:25.741 04:27:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4132595 00:30:25.741 04:27:40 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:25.741 04:27:40 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:25.742 04:27:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4132595' 00:30:25.742 killing process with pid 4132595 00:30:25.742 04:27:40 -- common/autotest_common.sh@945 -- # kill 4132595 00:30:25.742 Received shutdown signal, test time was about 2.000000 seconds 00:30:25.742 00:30:25.742 Latency(us) 00:30:25.742 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.742 =================================================================================================================== 00:30:25.742 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:25.742 04:27:40 -- common/autotest_common.sh@950 -- # wait 4132595 00:30:25.742 04:27:40 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:30:25.742 04:27:40 -- host/digest.sh@77 -- # local rw bs qd 00:30:25.742 04:27:40 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:25.742 04:27:40 -- host/digest.sh@80 -- # rw=randwrite 00:30:25.742 04:27:40 -- host/digest.sh@80 -- # bs=4096 00:30:25.742 04:27:40 -- host/digest.sh@80 -- # qd=128 00:30:25.742 04:27:40 -- host/digest.sh@82 -- # bperfpid=4133286 00:30:25.742 04:27:40 -- host/digest.sh@83 -- # waitforlisten 4133286 /var/tmp/bperf.sock 00:30:25.742 04:27:40 -- common/autotest_common.sh@819 -- # '[' -z 4133286 ']' 00:30:25.742 04:27:40 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:30:25.742 04:27:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:25.742 04:27:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:25.742 04:27:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:25.742 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:25.742 04:27:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:25.742 04:27:40 -- common/autotest_common.sh@10 -- # set +x 00:30:25.742 [2024-05-14 04:27:40.304656] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:25.742 [2024-05-14 04:27:40.304724] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4133286 ] 00:30:26.002 EAL: No free 2048 kB hugepages reported on node 1 00:30:26.002 [2024-05-14 04:27:40.381137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:26.002 [2024-05-14 04:27:40.431132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:26.574 04:27:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:26.574 04:27:41 -- common/autotest_common.sh@852 -- # return 0 00:30:26.574 04:27:41 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:26.574 04:27:41 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:26.574 04:27:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:26.835 04:27:41 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:26.835 04:27:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:27.097 nvme0n1 00:30:27.097 04:27:41 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:27.097 04:27:41 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:27.097 Running I/O for 2 seconds... 00:30:29.646 00:30:29.646 Latency(us) 00:30:29.646 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:29.646 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:29.646 nvme0n1 : 2.01 22340.06 87.27 0.00 0.00 5719.85 2703.36 22828.37 00:30:29.646 =================================================================================================================== 00:30:29.646 Total : 22340.06 87.27 0.00 0.00 5719.85 2703.36 22828.37 00:30:29.646 0 00:30:29.646 04:27:43 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:29.646 04:27:43 -- host/digest.sh@92 -- # get_accel_stats 00:30:29.646 04:27:43 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:29.646 04:27:43 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:29.646 | select(.opcode=="crc32c") 00:30:29.646 | "\(.module_name) \(.executed)"' 00:30:29.646 04:27:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:29.646 04:27:43 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:29.646 04:27:43 -- host/digest.sh@93 -- # exp_module=software 00:30:29.646 04:27:43 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:29.646 04:27:43 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:29.646 04:27:43 -- host/digest.sh@97 -- # killprocess 4133286 00:30:29.646 04:27:43 -- common/autotest_common.sh@926 -- # '[' -z 4133286 ']' 00:30:29.646 04:27:43 -- common/autotest_common.sh@930 -- # kill -0 4133286 00:30:29.646 04:27:43 -- common/autotest_common.sh@931 -- # uname 00:30:29.646 04:27:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:29.646 04:27:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4133286 00:30:29.646 04:27:43 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:29.646 04:27:43 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:29.646 04:27:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4133286' 00:30:29.646 killing process with pid 4133286 00:30:29.646 04:27:43 -- common/autotest_common.sh@945 -- # kill 4133286 00:30:29.646 Received shutdown signal, test time was about 2.000000 seconds 00:30:29.646 00:30:29.646 Latency(us) 00:30:29.646 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:29.646 =================================================================================================================== 00:30:29.646 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:29.646 04:27:43 -- common/autotest_common.sh@950 -- # wait 4133286 00:30:29.646 04:27:44 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:30:29.646 04:27:44 -- host/digest.sh@77 -- # local rw bs qd 00:30:29.646 04:27:44 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:30:29.646 04:27:44 -- host/digest.sh@80 -- # rw=randwrite 00:30:29.646 04:27:44 -- host/digest.sh@80 -- # bs=131072 00:30:29.646 04:27:44 -- host/digest.sh@80 -- # qd=16 00:30:29.646 04:27:44 -- host/digest.sh@82 -- # bperfpid=4134017 00:30:29.646 04:27:44 -- host/digest.sh@83 -- # waitforlisten 4134017 /var/tmp/bperf.sock 00:30:29.646 04:27:44 -- common/autotest_common.sh@819 -- # '[' -z 4134017 ']' 00:30:29.646 04:27:44 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:30:29.646 04:27:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:29.646 04:27:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:29.646 04:27:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:29.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:29.646 04:27:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:29.646 04:27:44 -- common/autotest_common.sh@10 -- # set +x 00:30:29.646 [2024-05-14 04:27:44.053141] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:29.646 [2024-05-14 04:27:44.053195] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4134017 ] 00:30:29.646 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:29.646 Zero copy mechanism will not be used. 00:30:29.646 EAL: No free 2048 kB hugepages reported on node 1 00:30:29.646 [2024-05-14 04:27:44.128504] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:29.646 [2024-05-14 04:27:44.177063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:30.219 04:27:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:30.219 04:27:44 -- common/autotest_common.sh@852 -- # return 0 00:30:30.219 04:27:44 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:30:30.219 04:27:44 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:30:30.480 04:27:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:30:30.480 04:27:45 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:30.480 04:27:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:31.053 nvme0n1 00:30:31.053 04:27:45 -- host/digest.sh@91 -- # bperf_py perform_tests 00:30:31.053 04:27:45 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:31.053 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:31.053 Zero copy mechanism will not be used. 00:30:31.053 Running I/O for 2 seconds... 00:30:32.969 00:30:32.969 Latency(us) 00:30:32.969 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:32.969 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:32.969 nvme0n1 : 2.01 2870.83 358.85 0.00 0.00 5563.07 2894.51 8301.23 00:30:32.969 =================================================================================================================== 00:30:32.969 Total : 2870.83 358.85 0.00 0.00 5563.07 2894.51 8301.23 00:30:32.969 0 00:30:32.969 04:27:47 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:30:32.969 04:27:47 -- host/digest.sh@92 -- # get_accel_stats 00:30:32.969 04:27:47 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:30:32.969 04:27:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:30:32.969 04:27:47 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:30:32.969 | select(.opcode=="crc32c") 00:30:32.969 | "\(.module_name) \(.executed)"' 00:30:33.296 04:27:47 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:30:33.296 04:27:47 -- host/digest.sh@93 -- # exp_module=software 00:30:33.296 04:27:47 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:30:33.296 04:27:47 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:30:33.296 04:27:47 -- host/digest.sh@97 -- # killprocess 4134017 00:30:33.296 04:27:47 -- common/autotest_common.sh@926 -- # '[' -z 4134017 ']' 00:30:33.296 04:27:47 -- common/autotest_common.sh@930 -- # kill -0 4134017 00:30:33.296 04:27:47 -- common/autotest_common.sh@931 -- # uname 00:30:33.296 04:27:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:33.296 04:27:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4134017 00:30:33.296 04:27:47 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:33.296 04:27:47 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:33.296 04:27:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4134017' 00:30:33.296 killing process with pid 4134017 00:30:33.296 04:27:47 -- common/autotest_common.sh@945 -- # kill 4134017 00:30:33.296 Received shutdown signal, test time was about 2.000000 seconds 00:30:33.296 00:30:33.296 Latency(us) 00:30:33.296 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:33.296 =================================================================================================================== 00:30:33.296 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:33.296 04:27:47 -- common/autotest_common.sh@950 -- # wait 4134017 00:30:33.296 04:27:47 -- host/digest.sh@126 -- # killprocess 4131714 00:30:33.296 04:27:47 -- common/autotest_common.sh@926 -- # '[' -z 4131714 ']' 00:30:33.296 04:27:47 -- common/autotest_common.sh@930 -- # kill -0 4131714 00:30:33.296 04:27:47 -- common/autotest_common.sh@931 -- # uname 00:30:33.296 04:27:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:33.296 04:27:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4131714 00:30:33.296 04:27:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:33.296 04:27:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:33.296 04:27:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4131714' 00:30:33.296 killing process with pid 4131714 00:30:33.296 04:27:47 -- common/autotest_common.sh@945 -- # kill 4131714 00:30:33.296 04:27:47 -- common/autotest_common.sh@950 -- # wait 4131714 00:30:33.557 00:30:33.557 real 0m16.167s 00:30:33.557 user 0m31.712s 00:30:33.557 sys 0m3.158s 00:30:33.557 04:27:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:33.557 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:30:33.557 ************************************ 00:30:33.557 END TEST nvmf_digest_clean 00:30:33.557 ************************************ 00:30:33.557 04:27:48 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:30:33.557 04:27:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:33.557 04:27:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:33.557 04:27:48 -- common/autotest_common.sh@10 -- # set +x 00:30:33.557 ************************************ 00:30:33.557 START TEST nvmf_digest_error 00:30:33.557 ************************************ 00:30:33.557 04:27:48 -- common/autotest_common.sh@1104 -- # run_digest_error 00:30:33.557 04:27:48 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:30:33.557 04:27:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:33.557 04:27:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:33.557 04:27:48 -- common/autotest_common.sh@10 -- # set +x 00:30:33.557 04:27:48 -- nvmf/common.sh@469 -- # nvmfpid=4134986 00:30:33.557 04:27:48 -- nvmf/common.sh@470 -- # waitforlisten 4134986 00:30:33.557 04:27:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:30:33.557 04:27:48 -- common/autotest_common.sh@819 -- # '[' -z 4134986 ']' 00:30:33.557 04:27:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:33.557 04:27:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:33.557 04:27:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:33.558 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:33.558 04:27:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:33.558 04:27:48 -- common/autotest_common.sh@10 -- # set +x 00:30:33.558 [2024-05-14 04:27:48.098638] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:33.558 [2024-05-14 04:27:48.098692] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:33.558 EAL: No free 2048 kB hugepages reported on node 1 00:30:33.819 [2024-05-14 04:27:48.163691] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:33.819 [2024-05-14 04:27:48.224993] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:33.819 [2024-05-14 04:27:48.225116] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:33.819 [2024-05-14 04:27:48.225124] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:33.819 [2024-05-14 04:27:48.225131] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:33.819 [2024-05-14 04:27:48.225149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:34.391 04:27:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:34.391 04:27:48 -- common/autotest_common.sh@852 -- # return 0 00:30:34.391 04:27:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:34.391 04:27:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:34.391 04:27:48 -- common/autotest_common.sh@10 -- # set +x 00:30:34.391 04:27:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:34.391 04:27:48 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:30:34.391 04:27:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:34.391 04:27:48 -- common/autotest_common.sh@10 -- # set +x 00:30:34.391 [2024-05-14 04:27:48.895068] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:30:34.391 04:27:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:34.391 04:27:48 -- host/digest.sh@104 -- # common_target_config 00:30:34.391 04:27:48 -- host/digest.sh@43 -- # rpc_cmd 00:30:34.391 04:27:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:34.391 04:27:48 -- common/autotest_common.sh@10 -- # set +x 00:30:34.391 null0 00:30:34.391 [2024-05-14 04:27:48.975584] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:34.652 [2024-05-14 04:27:48.999798] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:34.652 04:27:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:34.652 04:27:49 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:30:34.652 04:27:49 -- host/digest.sh@54 -- # local rw bs qd 00:30:34.652 04:27:49 -- host/digest.sh@56 -- # rw=randread 00:30:34.652 04:27:49 -- host/digest.sh@56 -- # bs=4096 00:30:34.652 04:27:49 -- host/digest.sh@56 -- # qd=128 00:30:34.652 04:27:49 -- host/digest.sh@58 -- # bperfpid=4135050 00:30:34.652 04:27:49 -- host/digest.sh@60 -- # waitforlisten 4135050 /var/tmp/bperf.sock 00:30:34.652 04:27:49 -- common/autotest_common.sh@819 -- # '[' -z 4135050 ']' 00:30:34.652 04:27:49 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:30:34.652 04:27:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:34.652 04:27:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:34.652 04:27:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:34.652 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:34.652 04:27:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:34.652 04:27:49 -- common/autotest_common.sh@10 -- # set +x 00:30:34.652 [2024-05-14 04:27:49.058368] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:34.652 [2024-05-14 04:27:49.058431] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4135050 ] 00:30:34.652 EAL: No free 2048 kB hugepages reported on node 1 00:30:34.652 [2024-05-14 04:27:49.135406] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:34.652 [2024-05-14 04:27:49.187611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:35.224 04:27:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:35.224 04:27:49 -- common/autotest_common.sh@852 -- # return 0 00:30:35.224 04:27:49 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:35.224 04:27:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:35.485 04:27:49 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:35.485 04:27:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.485 04:27:49 -- common/autotest_common.sh@10 -- # set +x 00:30:35.485 04:27:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.485 04:27:49 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:35.485 04:27:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:35.747 nvme0n1 00:30:35.747 04:27:50 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:35.747 04:27:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:35.747 04:27:50 -- common/autotest_common.sh@10 -- # set +x 00:30:35.747 04:27:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:35.747 04:27:50 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:35.747 04:27:50 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:35.747 Running I/O for 2 seconds... 00:30:35.747 [2024-05-14 04:27:50.279355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:35.747 [2024-05-14 04:27:50.279384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5202 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:35.747 [2024-05-14 04:27:50.279398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:35.747 [2024-05-14 04:27:50.292328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:35.747 [2024-05-14 04:27:50.292349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:1569 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:35.747 [2024-05-14 04:27:50.292356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:35.747 [2024-05-14 04:27:50.305232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:35.747 [2024-05-14 04:27:50.305250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:35.747 [2024-05-14 04:27:50.305257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:35.747 [2024-05-14 04:27:50.317114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:35.747 [2024-05-14 04:27:50.317132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:17729 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:35.747 [2024-05-14 04:27:50.317139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:35.747 [2024-05-14 04:27:50.328827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:35.747 [2024-05-14 04:27:50.328845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20839 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:35.747 [2024-05-14 04:27:50.328852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.339926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.339943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:11782 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.339949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.352293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.352309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:15414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.352316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.363575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.363591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:11489 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.363598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.375084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.375101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2297 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.375107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.387365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.387388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.387394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.398656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.398673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2629 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.398679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.410998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.411015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:25414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.411021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.422179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.422195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.422201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.434275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.434294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19376 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.434301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.445529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.445545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:17517 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.445552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.458092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.458109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:6094 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.458115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.469383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.469399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:24798 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.469405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.480982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.480998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:6061 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.481004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.493261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.493278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:17887 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.493284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.504897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.504913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:25089 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.504920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.515942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.515958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:13072 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.515964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.528477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.528493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:12429 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.528500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.539975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.539991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11897 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.539997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.009 [2024-05-14 04:27:50.551480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.009 [2024-05-14 04:27:50.551496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:13212 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.009 [2024-05-14 04:27:50.551502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.010 [2024-05-14 04:27:50.563625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.010 [2024-05-14 04:27:50.563642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:8061 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.010 [2024-05-14 04:27:50.563649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.010 [2024-05-14 04:27:50.574353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.010 [2024-05-14 04:27:50.574369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:16486 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.010 [2024-05-14 04:27:50.574375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.010 [2024-05-14 04:27:50.587220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.010 [2024-05-14 04:27:50.587236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:14539 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.010 [2024-05-14 04:27:50.587245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.598380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.598397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:5770 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.598403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.610597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.610613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:9548 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.610619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.621912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.621927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:4218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.621933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.634302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.634317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:8213 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.634323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.645786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.645802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:17127 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.645808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.657228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.657244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:1877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.657250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.668548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.668564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:21307 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.668570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.680882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.680898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:7750 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.680905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.692175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.692195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:6400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.692201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.704307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.704323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:6686 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.704329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.715862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.715878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:10832 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.715884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.727229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.727246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8701 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.727252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.738786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.738803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24397 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.738809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.751073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.751089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:10720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.751095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.762339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.762355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:16522 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.762361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.773879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.773894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:6283 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.773901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.786248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.786264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:2173 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.272 [2024-05-14 04:27:50.786270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.272 [2024-05-14 04:27:50.797770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.272 [2024-05-14 04:27:50.797786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:19585 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.273 [2024-05-14 04:27:50.797792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.273 [2024-05-14 04:27:50.809152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.273 [2024-05-14 04:27:50.809168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19437 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.273 [2024-05-14 04:27:50.809174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.273 [2024-05-14 04:27:50.820693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.273 [2024-05-14 04:27:50.820709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:5102 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.273 [2024-05-14 04:27:50.820715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.273 [2024-05-14 04:27:50.833041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.273 [2024-05-14 04:27:50.833058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:361 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.273 [2024-05-14 04:27:50.833064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.273 [2024-05-14 04:27:50.844533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.273 [2024-05-14 04:27:50.844550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.273 [2024-05-14 04:27:50.844556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.273 [2024-05-14 04:27:50.855904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.273 [2024-05-14 04:27:50.855920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:18349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.273 [2024-05-14 04:27:50.855926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.868293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.868309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:16598 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.868315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.879746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.879762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.879768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.891144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.891161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10865 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.891170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.902676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.902693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:13869 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.902699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.915094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.915111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:5283 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.915117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.926618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.926634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:16598 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.926641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.938056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.938073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:23550 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.938081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.949452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.949468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20226 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.949474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.961744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.961761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:12130 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.961768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.973279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.973300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:10750 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.973307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.984582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.984598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21737 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.984604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:50.996836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:50.996852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21740 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:50.996858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:51.008162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:51.008179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:4567 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:51.008185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:51.020639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:51.020656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12336 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:51.020662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:51.032138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:51.032154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:7563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.535 [2024-05-14 04:27:51.032160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.535 [2024-05-14 04:27:51.043491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.535 [2024-05-14 04:27:51.043508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:20450 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.536 [2024-05-14 04:27:51.043514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.536 [2024-05-14 04:27:51.054874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.536 [2024-05-14 04:27:51.054890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:11119 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.536 [2024-05-14 04:27:51.054896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.536 [2024-05-14 04:27:51.067427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.536 [2024-05-14 04:27:51.067443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:1338 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.536 [2024-05-14 04:27:51.067449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.536 [2024-05-14 04:27:51.078526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.536 [2024-05-14 04:27:51.078542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:8168 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.536 [2024-05-14 04:27:51.078548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.536 [2024-05-14 04:27:51.090748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.536 [2024-05-14 04:27:51.090764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:7941 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.536 [2024-05-14 04:27:51.090773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.536 [2024-05-14 04:27:51.102177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.536 [2024-05-14 04:27:51.102194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:72 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.536 [2024-05-14 04:27:51.102200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.536 [2024-05-14 04:27:51.113539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.536 [2024-05-14 04:27:51.113556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:22805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.536 [2024-05-14 04:27:51.113562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.125871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.125889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:20922 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.125895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.137389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.137405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.137411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.148727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.148743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.148750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.160295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.160311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:12270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.160317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.172642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.172657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5736 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.172663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.184113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.184130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1622 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.184136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.195326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.195346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22449 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.195352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.207886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.207903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16415 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.207909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.219367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.219383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:21768 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.219389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.230781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.230798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:11961 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.230805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.242133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.242149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:7152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.242155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.254621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.254637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.798 [2024-05-14 04:27:51.254643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.798 [2024-05-14 04:27:51.266109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.798 [2024-05-14 04:27:51.266125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:10852 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.266130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.277368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.277385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:11192 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.277391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.289945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.289961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:13006 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.289967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.301235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.301251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:17643 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.301257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.312625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.312641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:754 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.312647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.323999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.324015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:11879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.324021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.336562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.336579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:14813 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.336585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.347982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.347997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:10029 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.348003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.359376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.359392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9433 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.359398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.370903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.370920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:16138 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.370926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:36.799 [2024-05-14 04:27:51.383321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:36.799 [2024-05-14 04:27:51.383337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:15196 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:36.799 [2024-05-14 04:27:51.383343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.394540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.394557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:21013 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.394566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.405908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.405925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5619 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.405932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.418237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.418252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:6931 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.418258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.429666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.429682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12346 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.429688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.441055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.441072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3311 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.441078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.453579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.453596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:18885 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.453602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.464963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.464979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:23334 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.464986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.476232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.476248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:6677 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.476254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.488745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.488762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:17720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.488768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.500189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.500208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:13191 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.500214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.511582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.511598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:21783 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.511603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.523919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.523935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22848 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.523942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.535270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.535287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:6298 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.535297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.546469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.546485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:17441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.546491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.558861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.558877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:7657 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.558883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.570343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.570359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:7863 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.570365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.581705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.581720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:6896 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.581726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.593070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.593087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23594 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.593094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.605394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.605410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:17360 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.605416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.616953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.616970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:1581 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.616976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.628303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.628320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:72 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.628327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.060 [2024-05-14 04:27:51.640818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.060 [2024-05-14 04:27:51.640834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:3563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.060 [2024-05-14 04:27:51.640840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.322 [2024-05-14 04:27:51.651881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.322 [2024-05-14 04:27:51.651899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:20526 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.322 [2024-05-14 04:27:51.651906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.322 [2024-05-14 04:27:51.664120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.322 [2024-05-14 04:27:51.664135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:2045 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.322 [2024-05-14 04:27:51.664142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.322 [2024-05-14 04:27:51.675644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.322 [2024-05-14 04:27:51.675660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:13019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.322 [2024-05-14 04:27:51.675666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.322 [2024-05-14 04:27:51.687034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.322 [2024-05-14 04:27:51.687050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:25433 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.322 [2024-05-14 04:27:51.687056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.322 [2024-05-14 04:27:51.698598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.322 [2024-05-14 04:27:51.698614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.322 [2024-05-14 04:27:51.698623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.322 [2024-05-14 04:27:51.710770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.322 [2024-05-14 04:27:51.710786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:11067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.322 [2024-05-14 04:27:51.710792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.322 [2024-05-14 04:27:51.722246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.722261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14614 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.722268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.733670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.733686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15389 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.733692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.745162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.745178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:19922 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.745184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.757520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.757536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:8100 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.757542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.768941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.768957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:25491 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.768962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.780423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.780439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:16270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.780445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.792570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.792586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:11215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.792592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.804050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.804066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:25512 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.804072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.815417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.815433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18208 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.815438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.827811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.827827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17077 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.827833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.839128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.839144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12722 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.839150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.850479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.850496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:25190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.850502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.862893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.862909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:3765 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.862915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.874368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.874385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:9800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.874392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.885752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.885768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:2766 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.885774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.897317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.897333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6575 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.897345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.323 [2024-05-14 04:27:51.909409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.323 [2024-05-14 04:27:51.909425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:8576 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.323 [2024-05-14 04:27:51.909431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.584 [2024-05-14 04:27:51.920862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.584 [2024-05-14 04:27:51.920878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.584 [2024-05-14 04:27:51.920885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:51.932205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:51.932222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21927 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:51.932228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:51.944396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:51.944412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:14337 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:51.944417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:51.955922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:51.955938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:8413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:51.955944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:51.967270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:51.967286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:19455 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:51.967302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:51.979762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:51.979778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18930 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:51.979784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:51.991070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:51.991086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:51.991092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.002284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.002306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:2646 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.002312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.014628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.014644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:24580 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.014650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.026033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.026049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:21136 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.026055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.037393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.037409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:16176 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.037415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.049900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.049916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13734 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.049922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.061101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.061117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:12339 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.061123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.072510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.072527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19350 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.072533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.084905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.084922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:9851 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.084928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.096274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.096294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:10939 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.096300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.107510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.107526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:12723 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.107533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.119855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.119871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:9287 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.119876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.131127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.131143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:5551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.131149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.143499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.143515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:22445 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.143521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.154936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.154951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:1373 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.154957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.585 [2024-05-14 04:27:52.166282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.585 [2024-05-14 04:27:52.166303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:19734 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.585 [2024-05-14 04:27:52.166309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.847 [2024-05-14 04:27:52.177864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.847 [2024-05-14 04:27:52.177881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:12473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.847 [2024-05-14 04:27:52.177887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.847 [2024-05-14 04:27:52.190213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.847 [2024-05-14 04:27:52.190229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:11979 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.847 [2024-05-14 04:27:52.190236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.847 [2024-05-14 04:27:52.201339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.847 [2024-05-14 04:27:52.201354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:5559 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.847 [2024-05-14 04:27:52.201364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.847 [2024-05-14 04:27:52.212829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.847 [2024-05-14 04:27:52.212844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25000 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.847 [2024-05-14 04:27:52.212850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.847 [2024-05-14 04:27:52.225153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.847 [2024-05-14 04:27:52.225169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:7226 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.847 [2024-05-14 04:27:52.225175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.847 [2024-05-14 04:27:52.236509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.847 [2024-05-14 04:27:52.236525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:142 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.847 [2024-05-14 04:27:52.236531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.847 [2024-05-14 04:27:52.248024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.847 [2024-05-14 04:27:52.248039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:4347 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.847 [2024-05-14 04:27:52.248046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.847 [2024-05-14 04:27:52.259704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8c5600) 00:30:37.847 [2024-05-14 04:27:52.259720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:37.847 [2024-05-14 04:27:52.259727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:37.847 00:30:37.847 Latency(us) 00:30:37.847 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:37.847 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:30:37.847 nvme0n1 : 2.04 21233.05 82.94 0.00 0.00 5901.92 3850.24 48059.73 00:30:37.847 =================================================================================================================== 00:30:37.847 Total : 21233.05 82.94 0.00 0.00 5901.92 3850.24 48059.73 00:30:37.847 0 00:30:37.847 04:27:52 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:37.847 04:27:52 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:37.847 04:27:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:37.847 04:27:52 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:37.847 | .driver_specific 00:30:37.847 | .nvme_error 00:30:37.847 | .status_code 00:30:37.847 | .command_transient_transport_error' 00:30:38.109 04:27:52 -- host/digest.sh@71 -- # (( 170 > 0 )) 00:30:38.109 04:27:52 -- host/digest.sh@73 -- # killprocess 4135050 00:30:38.109 04:27:52 -- common/autotest_common.sh@926 -- # '[' -z 4135050 ']' 00:30:38.109 04:27:52 -- common/autotest_common.sh@930 -- # kill -0 4135050 00:30:38.109 04:27:52 -- common/autotest_common.sh@931 -- # uname 00:30:38.109 04:27:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:38.109 04:27:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4135050 00:30:38.109 04:27:52 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:38.109 04:27:52 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:38.109 04:27:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4135050' 00:30:38.109 killing process with pid 4135050 00:30:38.109 04:27:52 -- common/autotest_common.sh@945 -- # kill 4135050 00:30:38.109 Received shutdown signal, test time was about 2.000000 seconds 00:30:38.109 00:30:38.109 Latency(us) 00:30:38.109 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:38.109 =================================================================================================================== 00:30:38.109 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:38.109 04:27:52 -- common/autotest_common.sh@950 -- # wait 4135050 00:30:38.109 04:27:52 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:30:38.109 04:27:52 -- host/digest.sh@54 -- # local rw bs qd 00:30:38.109 04:27:52 -- host/digest.sh@56 -- # rw=randread 00:30:38.109 04:27:52 -- host/digest.sh@56 -- # bs=131072 00:30:38.109 04:27:52 -- host/digest.sh@56 -- # qd=16 00:30:38.109 04:27:52 -- host/digest.sh@58 -- # bperfpid=4135739 00:30:38.109 04:27:52 -- host/digest.sh@60 -- # waitforlisten 4135739 /var/tmp/bperf.sock 00:30:38.109 04:27:52 -- common/autotest_common.sh@819 -- # '[' -z 4135739 ']' 00:30:38.109 04:27:52 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:30:38.109 04:27:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:38.109 04:27:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:38.109 04:27:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:38.109 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:38.109 04:27:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:38.109 04:27:52 -- common/autotest_common.sh@10 -- # set +x 00:30:38.370 [2024-05-14 04:27:52.699336] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:38.370 [2024-05-14 04:27:52.699415] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4135739 ] 00:30:38.370 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:38.370 Zero copy mechanism will not be used. 00:30:38.370 EAL: No free 2048 kB hugepages reported on node 1 00:30:38.370 [2024-05-14 04:27:52.774891] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:38.370 [2024-05-14 04:27:52.826129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:38.942 04:27:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:38.942 04:27:53 -- common/autotest_common.sh@852 -- # return 0 00:30:38.942 04:27:53 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:38.942 04:27:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:39.202 04:27:53 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:39.202 04:27:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:39.202 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:30:39.202 04:27:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:39.202 04:27:53 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:39.202 04:27:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:39.462 nvme0n1 00:30:39.462 04:27:53 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:39.462 04:27:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:39.462 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:30:39.462 04:27:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:39.462 04:27:53 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:39.462 04:27:53 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:39.462 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:39.462 Zero copy mechanism will not be used. 00:30:39.462 Running I/O for 2 seconds... 00:30:39.462 [2024-05-14 04:27:54.003478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.462 [2024-05-14 04:27:54.003511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.462 [2024-05-14 04:27:54.003520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:39.462 [2024-05-14 04:27:54.020379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.462 [2024-05-14 04:27:54.020400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.462 [2024-05-14 04:27:54.020407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:39.462 [2024-05-14 04:27:54.039099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.463 [2024-05-14 04:27:54.039117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.463 [2024-05-14 04:27:54.039124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:39.723 [2024-05-14 04:27:54.056913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.723 [2024-05-14 04:27:54.056930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.723 [2024-05-14 04:27:54.056937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:39.723 [2024-05-14 04:27:54.074222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.723 [2024-05-14 04:27:54.074239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.723 [2024-05-14 04:27:54.074246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:39.723 [2024-05-14 04:27:54.090823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.723 [2024-05-14 04:27:54.090841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.723 [2024-05-14 04:27:54.090847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.107174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.107191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.107198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.124497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.124513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.124520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.143862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.143879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.143885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.161635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.161652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.161658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.177950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.177967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.177973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.193312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.193329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.193335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.210520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.210536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.210543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.227944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.227960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.227967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.243757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.243773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.243780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.261255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.261272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.261278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.278015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.278035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.278042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:39.724 [2024-05-14 04:27:54.294530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.724 [2024-05-14 04:27:54.294546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.724 [2024-05-14 04:27:54.294553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:39.985 [2024-05-14 04:27:54.312491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.985 [2024-05-14 04:27:54.312507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.985 [2024-05-14 04:27:54.312513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:39.985 [2024-05-14 04:27:54.329166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.985 [2024-05-14 04:27:54.329183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.985 [2024-05-14 04:27:54.329189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:39.985 [2024-05-14 04:27:54.345844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.985 [2024-05-14 04:27:54.345860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.985 [2024-05-14 04:27:54.345866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:39.985 [2024-05-14 04:27:54.362490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.985 [2024-05-14 04:27:54.362507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.985 [2024-05-14 04:27:54.362513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:39.985 [2024-05-14 04:27:54.378911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.985 [2024-05-14 04:27:54.378928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.985 [2024-05-14 04:27:54.378934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:39.985 [2024-05-14 04:27:54.396020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.985 [2024-05-14 04:27:54.396037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.985 [2024-05-14 04:27:54.396043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:39.985 [2024-05-14 04:27:54.412611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.985 [2024-05-14 04:27:54.412628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.985 [2024-05-14 04:27:54.412634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:39.985 [2024-05-14 04:27:54.428796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.985 [2024-05-14 04:27:54.428813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.985 [2024-05-14 04:27:54.428819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:39.985 [2024-05-14 04:27:54.446143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.985 [2024-05-14 04:27:54.446159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.986 [2024-05-14 04:27:54.446165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:39.986 [2024-05-14 04:27:54.462986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.986 [2024-05-14 04:27:54.463002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.986 [2024-05-14 04:27:54.463009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:39.986 [2024-05-14 04:27:54.480494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.986 [2024-05-14 04:27:54.480511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.986 [2024-05-14 04:27:54.480518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:39.986 [2024-05-14 04:27:54.498242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.986 [2024-05-14 04:27:54.498259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.986 [2024-05-14 04:27:54.498264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:39.986 [2024-05-14 04:27:54.516607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.986 [2024-05-14 04:27:54.516623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.986 [2024-05-14 04:27:54.516630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:39.986 [2024-05-14 04:27:54.530841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.986 [2024-05-14 04:27:54.530858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.986 [2024-05-14 04:27:54.530864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:39.986 [2024-05-14 04:27:54.549929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.986 [2024-05-14 04:27:54.549946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.986 [2024-05-14 04:27:54.549952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:39.986 [2024-05-14 04:27:54.565852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:39.986 [2024-05-14 04:27:54.565869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:39.986 [2024-05-14 04:27:54.565878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.582357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.582374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.582380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.599578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.599595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.599601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.615952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.615969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.615975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.632522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.632539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.632545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.649313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.649330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.649336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.665688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.665705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.665712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.686165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.686182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.686188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.701068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.701085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.701091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.717033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.717053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.717059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.735304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.735321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.735327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.751806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.751824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.751830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.769457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.769474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.769480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.786029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.786046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.786052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.801336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.801353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.801359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.248 [2024-05-14 04:27:54.820044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.248 [2024-05-14 04:27:54.820061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.248 [2024-05-14 04:27:54.820067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.509 [2024-05-14 04:27:54.836178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.509 [2024-05-14 04:27:54.836196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.509 [2024-05-14 04:27:54.836203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.509 [2024-05-14 04:27:54.853504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.509 [2024-05-14 04:27:54.853521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.509 [2024-05-14 04:27:54.853527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.509 [2024-05-14 04:27:54.870423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.509 [2024-05-14 04:27:54.870439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.509 [2024-05-14 04:27:54.870445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.509 [2024-05-14 04:27:54.887384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.509 [2024-05-14 04:27:54.887401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.509 [2024-05-14 04:27:54.887407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.509 [2024-05-14 04:27:54.903365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.509 [2024-05-14 04:27:54.903381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:54.903387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:54.919822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:54.919839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:54.919846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:54.936939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:54.936956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:54.936962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:54.953391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:54.953407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:54.953413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:54.969586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:54.969603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:54.969609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:54.985974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:54.985991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:54.985997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:55.002217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:55.002237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:55.002243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:55.019765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:55.019782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:55.019789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:55.037575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:55.037592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:55.037598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:55.054237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:55.054254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:55.054260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:55.071246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:55.071263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:55.071269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.510 [2024-05-14 04:27:55.087344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.510 [2024-05-14 04:27:55.087360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.510 [2024-05-14 04:27:55.087367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.103412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.103430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.103436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.119122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.119139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.119146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.136488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.136505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.136511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.154254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.154271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.154277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.171748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.171764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.171770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.187310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.187327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.187333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.207657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.207673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.207679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.223073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.223089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.223095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.239882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.239898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.239904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.255940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.255956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.255962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.271885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.271902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.271908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.289480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.289497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.289506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.304687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.304703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.304709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.321541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.321557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.321563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.338656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.338672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.338678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:40.771 [2024-05-14 04:27:55.355909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:40.771 [2024-05-14 04:27:55.355925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:40.771 [2024-05-14 04:27:55.355931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.032 [2024-05-14 04:27:55.371329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.032 [2024-05-14 04:27:55.371345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.032 [2024-05-14 04:27:55.371351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.032 [2024-05-14 04:27:55.390932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.032 [2024-05-14 04:27:55.390949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.032 [2024-05-14 04:27:55.390955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.032 [2024-05-14 04:27:55.407474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.032 [2024-05-14 04:27:55.407489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.032 [2024-05-14 04:27:55.407496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.032 [2024-05-14 04:27:55.424688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.032 [2024-05-14 04:27:55.424705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.032 [2024-05-14 04:27:55.424711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.032 [2024-05-14 04:27:55.438604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.032 [2024-05-14 04:27:55.438624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.032 [2024-05-14 04:27:55.438630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.032 [2024-05-14 04:27:55.460740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.032 [2024-05-14 04:27:55.460758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.032 [2024-05-14 04:27:55.460764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.032 [2024-05-14 04:27:55.476567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.032 [2024-05-14 04:27:55.476584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.032 [2024-05-14 04:27:55.476590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.032 [2024-05-14 04:27:55.493283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.032 [2024-05-14 04:27:55.493304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.032 [2024-05-14 04:27:55.493310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.032 [2024-05-14 04:27:55.510296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.032 [2024-05-14 04:27:55.510313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.032 [2024-05-14 04:27:55.510319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.033 [2024-05-14 04:27:55.527588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.033 [2024-05-14 04:27:55.527606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.033 [2024-05-14 04:27:55.527611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.033 [2024-05-14 04:27:55.543842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.033 [2024-05-14 04:27:55.543859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.033 [2024-05-14 04:27:55.543866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.033 [2024-05-14 04:27:55.561557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.033 [2024-05-14 04:27:55.561574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.033 [2024-05-14 04:27:55.561580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.033 [2024-05-14 04:27:55.578723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.033 [2024-05-14 04:27:55.578741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.033 [2024-05-14 04:27:55.578747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.033 [2024-05-14 04:27:55.594882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.033 [2024-05-14 04:27:55.594900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.033 [2024-05-14 04:27:55.594906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.033 [2024-05-14 04:27:55.611318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.033 [2024-05-14 04:27:55.611335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.033 [2024-05-14 04:27:55.611341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.294 [2024-05-14 04:27:55.627506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.294 [2024-05-14 04:27:55.627524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.294 [2024-05-14 04:27:55.627531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.294 [2024-05-14 04:27:55.643287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.294 [2024-05-14 04:27:55.643307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.294 [2024-05-14 04:27:55.643313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.294 [2024-05-14 04:27:55.661500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.294 [2024-05-14 04:27:55.661518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.294 [2024-05-14 04:27:55.661524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.294 [2024-05-14 04:27:55.678720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.294 [2024-05-14 04:27:55.678737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.294 [2024-05-14 04:27:55.678743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.294 [2024-05-14 04:27:55.694974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.294 [2024-05-14 04:27:55.694991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.694997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.709055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.709073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.709079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.720973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.720993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.720999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.738325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.738342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.738348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.752210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.752227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.752233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.768622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.768639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.768645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.785615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.785633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.785639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.804616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.804634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.804640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.820205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.820222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.820228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.835214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.835231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.835237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.850803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.850821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.850827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.295 [2024-05-14 04:27:55.867850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.295 [2024-05-14 04:27:55.867868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.295 [2024-05-14 04:27:55.867874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.556 [2024-05-14 04:27:55.884786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.556 [2024-05-14 04:27:55.884804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.556 [2024-05-14 04:27:55.884810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.557 [2024-05-14 04:27:55.899588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.557 [2024-05-14 04:27:55.899606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.557 [2024-05-14 04:27:55.899613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.557 [2024-05-14 04:27:55.917828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.557 [2024-05-14 04:27:55.917846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.557 [2024-05-14 04:27:55.917852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.557 [2024-05-14 04:27:55.934404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.557 [2024-05-14 04:27:55.934421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.557 [2024-05-14 04:27:55.934428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:41.557 [2024-05-14 04:27:55.953179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.557 [2024-05-14 04:27:55.953197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.557 [2024-05-14 04:27:55.953203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:41.557 [2024-05-14 04:27:55.969397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.557 [2024-05-14 04:27:55.969414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.557 [2024-05-14 04:27:55.969420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:41.557 [2024-05-14 04:27:55.986108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x11ac000) 00:30:41.557 [2024-05-14 04:27:55.986125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:41.557 [2024-05-14 04:27:55.986132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:41.557 00:30:41.557 Latency(us) 00:30:41.557 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:41.557 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:41.557 nvme0n1 : 2.01 1845.31 230.66 0.00 0.00 8663.58 4915.20 22063.79 00:30:41.557 =================================================================================================================== 00:30:41.557 Total : 1845.31 230.66 0.00 0.00 8663.58 4915.20 22063.79 00:30:41.557 0 00:30:41.557 04:27:56 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:41.557 04:27:56 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:41.557 04:27:56 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:41.557 | .driver_specific 00:30:41.557 | .nvme_error 00:30:41.557 | .status_code 00:30:41.557 | .command_transient_transport_error' 00:30:41.557 04:27:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:41.819 04:27:56 -- host/digest.sh@71 -- # (( 119 > 0 )) 00:30:41.819 04:27:56 -- host/digest.sh@73 -- # killprocess 4135739 00:30:41.819 04:27:56 -- common/autotest_common.sh@926 -- # '[' -z 4135739 ']' 00:30:41.819 04:27:56 -- common/autotest_common.sh@930 -- # kill -0 4135739 00:30:41.819 04:27:56 -- common/autotest_common.sh@931 -- # uname 00:30:41.819 04:27:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:41.819 04:27:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4135739 00:30:41.819 04:27:56 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:41.819 04:27:56 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:41.819 04:27:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4135739' 00:30:41.819 killing process with pid 4135739 00:30:41.819 04:27:56 -- common/autotest_common.sh@945 -- # kill 4135739 00:30:41.819 Received shutdown signal, test time was about 2.000000 seconds 00:30:41.819 00:30:41.819 Latency(us) 00:30:41.819 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:41.819 =================================================================================================================== 00:30:41.819 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:41.819 04:27:56 -- common/autotest_common.sh@950 -- # wait 4135739 00:30:41.819 04:27:56 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:30:41.819 04:27:56 -- host/digest.sh@54 -- # local rw bs qd 00:30:41.819 04:27:56 -- host/digest.sh@56 -- # rw=randwrite 00:30:41.819 04:27:56 -- host/digest.sh@56 -- # bs=4096 00:30:41.819 04:27:56 -- host/digest.sh@56 -- # qd=128 00:30:41.819 04:27:56 -- host/digest.sh@58 -- # bperfpid=4136469 00:30:41.819 04:27:56 -- host/digest.sh@60 -- # waitforlisten 4136469 /var/tmp/bperf.sock 00:30:41.819 04:27:56 -- common/autotest_common.sh@819 -- # '[' -z 4136469 ']' 00:30:41.819 04:27:56 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:30:41.819 04:27:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:41.819 04:27:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:41.819 04:27:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:41.819 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:41.819 04:27:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:41.819 04:27:56 -- common/autotest_common.sh@10 -- # set +x 00:30:41.819 [2024-05-14 04:27:56.380684] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:41.819 [2024-05-14 04:27:56.380740] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4136469 ] 00:30:41.819 EAL: No free 2048 kB hugepages reported on node 1 00:30:42.081 [2024-05-14 04:27:56.456287] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:42.081 [2024-05-14 04:27:56.507913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:42.652 04:27:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:42.653 04:27:57 -- common/autotest_common.sh@852 -- # return 0 00:30:42.653 04:27:57 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:42.653 04:27:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:42.913 04:27:57 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:42.913 04:27:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:42.913 04:27:57 -- common/autotest_common.sh@10 -- # set +x 00:30:42.913 04:27:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:42.913 04:27:57 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:42.913 04:27:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:43.174 nvme0n1 00:30:43.174 04:27:57 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:43.174 04:27:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:43.174 04:27:57 -- common/autotest_common.sh@10 -- # set +x 00:30:43.174 04:27:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:43.174 04:27:57 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:43.174 04:27:57 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:43.174 Running I/O for 2 seconds... 00:30:43.174 [2024-05-14 04:27:57.664287] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc128 00:30:43.174 [2024-05-14 04:27:57.665485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:7058 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.174 [2024-05-14 04:27:57.665511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:43.175 [2024-05-14 04:27:57.676794] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.175 [2024-05-14 04:27:57.677124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.175 [2024-05-14 04:27:57.677142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.175 [2024-05-14 04:27:57.688876] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.175 [2024-05-14 04:27:57.689227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:16077 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.175 [2024-05-14 04:27:57.689243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.175 [2024-05-14 04:27:57.700954] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.175 [2024-05-14 04:27:57.701397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:9950 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.175 [2024-05-14 04:27:57.701413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.175 [2024-05-14 04:27:57.713071] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.175 [2024-05-14 04:27:57.713465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:15323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.175 [2024-05-14 04:27:57.713481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.175 [2024-05-14 04:27:57.725105] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.175 [2024-05-14 04:27:57.725369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:3674 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.175 [2024-05-14 04:27:57.725385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.175 [2024-05-14 04:27:57.737163] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.175 [2024-05-14 04:27:57.737518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:8898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.175 [2024-05-14 04:27:57.737534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.175 [2024-05-14 04:27:57.749238] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.175 [2024-05-14 04:27:57.749477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:15021 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.175 [2024-05-14 04:27:57.749492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.175 [2024-05-14 04:27:57.761388] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.175 [2024-05-14 04:27:57.761684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.175 [2024-05-14 04:27:57.761700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.436 [2024-05-14 04:27:57.773425] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.436 [2024-05-14 04:27:57.773774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:13794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.436 [2024-05-14 04:27:57.773790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.436 [2024-05-14 04:27:57.785515] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.436 [2024-05-14 04:27:57.785751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.436 [2024-05-14 04:27:57.785767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.436 [2024-05-14 04:27:57.797567] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.436 [2024-05-14 04:27:57.797920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:22784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.436 [2024-05-14 04:27:57.797935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.436 [2024-05-14 04:27:57.809584] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.436 [2024-05-14 04:27:57.809850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:6091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.809866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.821607] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.821951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:24565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.821966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.833685] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.833933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:23494 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.833951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.845732] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.845971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.845986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.857727] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.858070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:20712 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.858085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.869774] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.870124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:98 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.870139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.881833] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.882191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:4857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.882206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.893880] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.894117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:25025 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.894133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.905936] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.906167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:17682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.906182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.917961] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.918216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:21417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.918231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.930047] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.930424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.930440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.942120] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.942387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:1199 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.942403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.954172] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.954556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:1532 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.954572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.966197] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.966656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:10489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.966671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.978242] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.978624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:23952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.978639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:57.990303] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:57.990586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:10016 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:57.990601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:58.002325] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:58.002745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:7308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:58.002760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.437 [2024-05-14 04:27:58.014444] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.437 [2024-05-14 04:27:58.014851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3121 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.437 [2024-05-14 04:27:58.014867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.026483] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.026834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:3641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.026850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.038495] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.038937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:19084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.038952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.050520] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.050876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:6866 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.050891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.062631] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.062870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:16353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.062885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.074636] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.075041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:18677 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.075057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.086746] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.087092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:17945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.087107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.098789] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.099144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12819 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.099160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.110977] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.111370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:15176 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.111385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.123000] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.123266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:9696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.123281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.135028] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.135480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.135495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.147055] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.147296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:18627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.147314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.159067] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.159393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:17495 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.159409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.699 [2024-05-14 04:27:58.171144] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.699 [2024-05-14 04:27:58.171399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:20806 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.699 [2024-05-14 04:27:58.171414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.700 [2024-05-14 04:27:58.183187] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.700 [2024-05-14 04:27:58.183543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13990 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.700 [2024-05-14 04:27:58.183558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.700 [2024-05-14 04:27:58.195228] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.700 [2024-05-14 04:27:58.195589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:10374 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.700 [2024-05-14 04:27:58.195605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.700 [2024-05-14 04:27:58.207281] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.700 [2024-05-14 04:27:58.207535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.700 [2024-05-14 04:27:58.207550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.700 [2024-05-14 04:27:58.219300] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.700 [2024-05-14 04:27:58.219695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:24994 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.700 [2024-05-14 04:27:58.219711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.700 [2024-05-14 04:27:58.231336] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.700 [2024-05-14 04:27:58.231780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:14438 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.700 [2024-05-14 04:27:58.231796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.700 [2024-05-14 04:27:58.243364] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.700 [2024-05-14 04:27:58.243624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:1070 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.700 [2024-05-14 04:27:58.243639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.700 [2024-05-14 04:27:58.255408] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.700 [2024-05-14 04:27:58.255731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:14488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.700 [2024-05-14 04:27:58.255747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.700 [2024-05-14 04:27:58.267441] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.700 [2024-05-14 04:27:58.267825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17823 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.700 [2024-05-14 04:27:58.267841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.700 [2024-05-14 04:27:58.279478] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.700 [2024-05-14 04:27:58.279842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:13253 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.700 [2024-05-14 04:27:58.279857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.291525] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.291813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:25024 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.291828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.303583] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.303814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:6937 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.303829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.315636] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.316076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:25113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.316091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.327693] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.328026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:20060 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.328041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.339724] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.339986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:7277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.340002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.351791] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.352046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13791 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.352062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.363791] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.364154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:6172 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.364170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.375934] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.376189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:15217 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.376205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.387985] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.388344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:8859 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.388360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.400007] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.400342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:25161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.400358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.412086] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.412488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:24291 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.412503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.424134] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.424480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:3580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.424496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.436148] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.436512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3037 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.436527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.448179] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.448547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:18536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.448563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.460249] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.460521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:7641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.460539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.472529] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.472884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:9894 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.472900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.484573] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.484805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:25334 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.484820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.496617] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.496978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:21754 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.496993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.508643] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.508880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:2713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.508895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.520697] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.521079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.521094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.532732] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.533123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:25561 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.533138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:43.962 [2024-05-14 04:27:58.544816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:43.962 [2024-05-14 04:27:58.545173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:22384 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:43.962 [2024-05-14 04:27:58.545189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.556867] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.557228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:6897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.557244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.568867] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.569206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:22880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.569221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.580962] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.581237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:22956 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.581253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.593099] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.593352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:17383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.593367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.605086] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.605439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18138 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.605455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.617122] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.617366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:816 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.617381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.629185] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.629546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:1215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.629561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.641214] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.641573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:12593 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.641588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.653228] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.653574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:4736 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.653590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.665271] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.665518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:15004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.665533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.677336] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.677600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:8343 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.677615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.689363] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.689759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4813 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.689775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.701534] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.701879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:20543 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.701894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.713605] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.714035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:16058 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.714051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.224 [2024-05-14 04:27:58.725698] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.224 [2024-05-14 04:27:58.726231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:9704 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.224 [2024-05-14 04:27:58.726247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.225 [2024-05-14 04:27:58.737733] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.225 [2024-05-14 04:27:58.738007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:21225 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.225 [2024-05-14 04:27:58.738022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.225 [2024-05-14 04:27:58.749776] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.225 [2024-05-14 04:27:58.750145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:9892 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.225 [2024-05-14 04:27:58.750160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.225 [2024-05-14 04:27:58.761816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.225 [2024-05-14 04:27:58.762164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:22612 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.225 [2024-05-14 04:27:58.762180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.225 [2024-05-14 04:27:58.773927] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.225 [2024-05-14 04:27:58.774376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.225 [2024-05-14 04:27:58.774394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.225 [2024-05-14 04:27:58.786064] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.225 [2024-05-14 04:27:58.786305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:22630 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.225 [2024-05-14 04:27:58.786320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.225 [2024-05-14 04:27:58.798091] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.225 [2024-05-14 04:27:58.798495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:14952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.225 [2024-05-14 04:27:58.798511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.225 [2024-05-14 04:27:58.810116] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.225 [2024-05-14 04:27:58.810365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:16352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.225 [2024-05-14 04:27:58.810380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.822313] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.822737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:25011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.822753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.834326] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.834547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:10450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.834561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.846374] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.846710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:18551 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.846726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.858358] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.858704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13190 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.858719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.870363] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.870704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:6532 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.870719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.882407] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.882766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:7791 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.882781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.894445] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.894794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:25581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.894809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.906469] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.906828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:13597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.906843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.918548] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.918922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:24955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.918937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.930559] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.930951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:21035 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.930966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.942556] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.942907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1046 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.942922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.954560] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.954807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:14382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.954821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.966612] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.967025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:11836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.967040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.978657] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.978903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:10661 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.978918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:58.990666] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:58.991063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:3692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:58.991078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:59.002663] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:59.003003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:19438 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:59.003018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:59.014719] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:59.015093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:22939 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:59.015108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:59.026762] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:59.027113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:59.027129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:59.038841] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:59.039179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:15516 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:59.039194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:59.050854] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:59.051130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:3397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:59.051145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.487 [2024-05-14 04:27:59.062879] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.487 [2024-05-14 04:27:59.063164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:1179 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.487 [2024-05-14 04:27:59.063179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.074859] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.075172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:21955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.075188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.086974] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.087214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:11905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.087232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.099006] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.099362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:11469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.099377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.111003] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.111367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24944 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.111382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.123087] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.123458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:13078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.123473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.135113] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.135460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:18470 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.135475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.147124] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.147470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:6347 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.147485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.159122] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.159516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:1404 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.159531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.171126] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.171509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:3461 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.171524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.183099] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.183492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:25544 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.183508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.195119] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.195513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6967 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.195529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.207130] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.207574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:16212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.207589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.219183] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.219515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10272 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.219530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.231205] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.231480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:5072 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.231496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.243184] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.243633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:15289 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.243648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.255170] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.255462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:6332 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.255477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.267197] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.267560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:4775 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.267575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.279194] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.279601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.749 [2024-05-14 04:27:59.279616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.749 [2024-05-14 04:27:59.291259] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.749 [2024-05-14 04:27:59.291495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:8617 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.750 [2024-05-14 04:27:59.291510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.750 [2024-05-14 04:27:59.303253] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.750 [2024-05-14 04:27:59.303487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:19622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.750 [2024-05-14 04:27:59.303502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.750 [2024-05-14 04:27:59.315257] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.750 [2024-05-14 04:27:59.315498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:16265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.750 [2024-05-14 04:27:59.315514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:44.750 [2024-05-14 04:27:59.327284] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:44.750 [2024-05-14 04:27:59.327736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:18358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:44.750 [2024-05-14 04:27:59.327751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.011 [2024-05-14 04:27:59.339328] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.011 [2024-05-14 04:27:59.339618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:5645 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.011 [2024-05-14 04:27:59.339634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.351358] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.351711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:4407 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.351726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.363346] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.363726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:486 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.363741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.375329] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.375699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:5978 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.375714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.387392] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.387634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:18846 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.387649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.399396] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.399632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:12737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.399651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.411410] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.411791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:908 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.411807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.423455] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.423833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:21236 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.423848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.435461] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.435797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:12994 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.435812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.447490] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.447855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14537 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.447870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.459527] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.459877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:4860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.459892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.471708] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.472061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:9182 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.472077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.483734] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.484085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:22418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.484100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.495752] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.496073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:17920 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.496088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.507765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.508125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:9574 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.508143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.519744] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.520087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:15268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.520102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.531788] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.532152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6100 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.532167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.543800] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.544183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:17485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.544198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.555811] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.556079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:167 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.556095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.567824] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.568199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:18947 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.568214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.579848] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.580122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.580137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.012 [2024-05-14 04:27:59.591877] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.012 [2024-05-14 04:27:59.592213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:12224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.012 [2024-05-14 04:27:59.592228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.274 [2024-05-14 04:27:59.603866] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.274 [2024-05-14 04:27:59.604355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:21840 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.274 [2024-05-14 04:27:59.604370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.274 [2024-05-14 04:27:59.615934] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.274 [2024-05-14 04:27:59.616294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9957 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.274 [2024-05-14 04:27:59.616309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.274 [2024-05-14 04:27:59.628010] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.274 [2024-05-14 04:27:59.628303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:5696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.274 [2024-05-14 04:27:59.628319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.274 [2024-05-14 04:27:59.639964] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f1c10) with pdu=0x2000190fc560 00:30:45.274 [2024-05-14 04:27:59.640333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:16288 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:45.274 [2024-05-14 04:27:59.640348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:45.274 00:30:45.274 Latency(us) 00:30:45.274 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:45.274 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:45.274 nvme0n1 : 2.01 21102.97 82.43 0.00 0.00 6054.71 2826.24 16711.68 00:30:45.274 =================================================================================================================== 00:30:45.274 Total : 21102.97 82.43 0.00 0.00 6054.71 2826.24 16711.68 00:30:45.274 0 00:30:45.274 04:27:59 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:45.274 04:27:59 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:45.274 04:27:59 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:45.274 | .driver_specific 00:30:45.274 | .nvme_error 00:30:45.274 | .status_code 00:30:45.274 | .command_transient_transport_error' 00:30:45.274 04:27:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:45.274 04:27:59 -- host/digest.sh@71 -- # (( 165 > 0 )) 00:30:45.274 04:27:59 -- host/digest.sh@73 -- # killprocess 4136469 00:30:45.274 04:27:59 -- common/autotest_common.sh@926 -- # '[' -z 4136469 ']' 00:30:45.274 04:27:59 -- common/autotest_common.sh@930 -- # kill -0 4136469 00:30:45.274 04:27:59 -- common/autotest_common.sh@931 -- # uname 00:30:45.274 04:27:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:45.274 04:27:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4136469 00:30:45.535 04:27:59 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:45.535 04:27:59 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:45.535 04:27:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4136469' 00:30:45.535 killing process with pid 4136469 00:30:45.535 04:27:59 -- common/autotest_common.sh@945 -- # kill 4136469 00:30:45.535 Received shutdown signal, test time was about 2.000000 seconds 00:30:45.535 00:30:45.535 Latency(us) 00:30:45.535 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:45.535 =================================================================================================================== 00:30:45.535 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:45.535 04:27:59 -- common/autotest_common.sh@950 -- # wait 4136469 00:30:45.535 04:27:59 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:45.535 04:27:59 -- host/digest.sh@54 -- # local rw bs qd 00:30:45.535 04:27:59 -- host/digest.sh@56 -- # rw=randwrite 00:30:45.535 04:27:59 -- host/digest.sh@56 -- # bs=131072 00:30:45.535 04:28:00 -- host/digest.sh@56 -- # qd=16 00:30:45.535 04:28:00 -- host/digest.sh@58 -- # bperfpid=4137211 00:30:45.535 04:28:00 -- host/digest.sh@60 -- # waitforlisten 4137211 /var/tmp/bperf.sock 00:30:45.535 04:28:00 -- common/autotest_common.sh@819 -- # '[' -z 4137211 ']' 00:30:45.535 04:28:00 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:45.535 04:28:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:45.535 04:28:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:45.535 04:28:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:45.535 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:45.535 04:28:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:45.535 04:28:00 -- common/autotest_common.sh@10 -- # set +x 00:30:45.535 [2024-05-14 04:28:00.043221] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:45.535 [2024-05-14 04:28:00.043281] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4137211 ] 00:30:45.535 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:45.535 Zero copy mechanism will not be used. 00:30:45.535 EAL: No free 2048 kB hugepages reported on node 1 00:30:45.535 [2024-05-14 04:28:00.118408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:45.797 [2024-05-14 04:28:00.170328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:46.417 04:28:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:46.417 04:28:00 -- common/autotest_common.sh@852 -- # return 0 00:30:46.417 04:28:00 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:46.417 04:28:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:46.417 04:28:00 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:46.417 04:28:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:46.417 04:28:00 -- common/autotest_common.sh@10 -- # set +x 00:30:46.417 04:28:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:46.417 04:28:00 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:46.417 04:28:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:46.678 nvme0n1 00:30:46.678 04:28:01 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:46.678 04:28:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:46.678 04:28:01 -- common/autotest_common.sh@10 -- # set +x 00:30:46.678 04:28:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:46.678 04:28:01 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:46.678 04:28:01 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:46.939 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:46.939 Zero copy mechanism will not be used. 00:30:46.939 Running I/O for 2 seconds... 00:30:46.939 [2024-05-14 04:28:01.369908] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:46.939 [2024-05-14 04:28:01.370445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.939 [2024-05-14 04:28:01.370470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.939 [2024-05-14 04:28:01.388563] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:46.939 [2024-05-14 04:28:01.389078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.939 [2024-05-14 04:28:01.389096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.939 [2024-05-14 04:28:01.406197] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:46.939 [2024-05-14 04:28:01.406663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.939 [2024-05-14 04:28:01.406679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.939 [2024-05-14 04:28:01.423209] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:46.939 [2024-05-14 04:28:01.423545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.939 [2024-05-14 04:28:01.423561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.939 [2024-05-14 04:28:01.440845] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:46.939 [2024-05-14 04:28:01.441303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.939 [2024-05-14 04:28:01.441319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:46.939 [2024-05-14 04:28:01.458878] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:46.939 [2024-05-14 04:28:01.459398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.939 [2024-05-14 04:28:01.459414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:46.939 [2024-05-14 04:28:01.476753] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:46.939 [2024-05-14 04:28:01.477427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.939 [2024-05-14 04:28:01.477443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:46.939 [2024-05-14 04:28:01.495841] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:46.939 [2024-05-14 04:28:01.496356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.939 [2024-05-14 04:28:01.496372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:46.939 [2024-05-14 04:28:01.513625] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:46.939 [2024-05-14 04:28:01.514085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:46.939 [2024-05-14 04:28:01.514101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.532395] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.532879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.532895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.550506] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.550841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.550857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.568524] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.569074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.569089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.585838] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.586398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.586414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.604331] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.604730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.604746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.622180] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.622737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.622754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.641819] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.642222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.642237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.660472] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.660984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.661000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.677743] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.678231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.678247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.695459] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.696034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.696050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.714909] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.715390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.715406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.732921] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.733472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.733488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.751929] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.752399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.752415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.769507] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.200 [2024-05-14 04:28:01.769955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.200 [2024-05-14 04:28:01.769971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.200 [2024-05-14 04:28:01.787656] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.461 [2024-05-14 04:28:01.788094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.461 [2024-05-14 04:28:01.788111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.461 [2024-05-14 04:28:01.805902] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.461 [2024-05-14 04:28:01.806500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.461 [2024-05-14 04:28:01.806516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.461 [2024-05-14 04:28:01.823924] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.461 [2024-05-14 04:28:01.824380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.461 [2024-05-14 04:28:01.824396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.461 [2024-05-14 04:28:01.842454] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.461 [2024-05-14 04:28:01.842868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:01.842884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:01.860353] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:01.860861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:01.860880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:01.879065] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:01.879586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:01.879602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:01.896937] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:01.897569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:01.897584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:01.916138] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:01.916616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:01.916632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:01.935724] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:01.936239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:01.936255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:01.954318] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:01.954685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:01.954701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:01.972594] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:01.973160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:01.973175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:01.991648] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:01.992044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:01.992060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:02.009338] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:02.009819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:02.009834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:02.027946] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:02.028567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:02.028583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.462 [2024-05-14 04:28:02.046133] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.462 [2024-05-14 04:28:02.046705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.462 [2024-05-14 04:28:02.046721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.064437] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.064901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.064917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.082515] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.083098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.083114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.102517] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.103013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.103029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.120250] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.120647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.120663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.136613] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.137156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.137172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.155395] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.155969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.155985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.174695] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.175268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.175284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.194365] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.194950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.194965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.213761] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.214171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.214187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.231386] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.231838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.231855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.250515] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.250877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.250893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.269772] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.270177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.270193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.287241] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.287522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.287536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.724 [2024-05-14 04:28:02.305039] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.724 [2024-05-14 04:28:02.305584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.724 [2024-05-14 04:28:02.305600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.985 [2024-05-14 04:28:02.324190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.324650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.324665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.342835] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.343258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.343278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.361310] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.361654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.361670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.380272] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.380724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.380739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.399500] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.400066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.400082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.418241] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.418782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.418797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.437296] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.437924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.437940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.456570] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.457038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.457053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.473565] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.474069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.474085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.493055] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.493405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.493421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.511096] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.511632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.511648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.530011] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.530447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.530463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.548313] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.548805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.548821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:47.986 [2024-05-14 04:28:02.566129] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:47.986 [2024-05-14 04:28:02.566657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:47.986 [2024-05-14 04:28:02.566673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.583976] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.584434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.584449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.602625] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.603054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.603070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.620573] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.620969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.620984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.639039] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.639558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.639574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.657017] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.657480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.657496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.676258] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.676772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.676788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.694523] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.695125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.695141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.711794] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.712168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.712183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.729158] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.729727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.729743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.747939] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.748443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.748459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.765973] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.766409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.766424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.784385] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.784872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.784887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.802963] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.803316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.803331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.248 [2024-05-14 04:28:02.821899] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.248 [2024-05-14 04:28:02.822500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.248 [2024-05-14 04:28:02.822518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.509 [2024-05-14 04:28:02.841665] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.509 [2024-05-14 04:28:02.842077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.509 [2024-05-14 04:28:02.842093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.509 [2024-05-14 04:28:02.860405] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.509 [2024-05-14 04:28:02.860874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.509 [2024-05-14 04:28:02.860889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.509 [2024-05-14 04:28:02.880079] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.509 [2024-05-14 04:28:02.880502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.509 [2024-05-14 04:28:02.880518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.509 [2024-05-14 04:28:02.899514] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:02.900003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:02.900019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:02.917664] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:02.918181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:02.918197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:02.935586] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:02.936082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:02.936097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:02.953392] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:02.953834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:02.953849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:02.971385] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:02.971792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:02.971807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:02.991061] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:02.991487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:02.991503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:03.008812] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:03.009318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:03.009333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:03.027145] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:03.027783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:03.027800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:03.045468] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:03.046043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:03.046059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:03.063656] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:03.064110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:03.064126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.510 [2024-05-14 04:28:03.082103] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.510 [2024-05-14 04:28:03.082613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.510 [2024-05-14 04:28:03.082629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.101424] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.101873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.101888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.119335] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.119836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.119851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.137975] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.138487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.138506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.156303] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.156673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.156689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.174311] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.174810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.174825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.192142] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.192559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.192575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.209847] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.210659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.210675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.229738] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.230069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.230085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.248317] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.248819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.248835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.266910] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.267348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.267363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.284987] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.285429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.285445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.303761] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.304189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.304205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:48.772 [2024-05-14 04:28:03.321748] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x17f2080) with pdu=0x2000190fef90 00:30:48.772 [2024-05-14 04:28:03.322145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:48.772 [2024-05-14 04:28:03.322160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:48.772 00:30:48.772 Latency(us) 00:30:48.772 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:48.772 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:48.772 nvme0n1 : 2.01 1661.84 207.73 0.00 0.00 9603.18 7372.80 35607.89 00:30:48.772 =================================================================================================================== 00:30:48.772 Total : 1661.84 207.73 0.00 0.00 9603.18 7372.80 35607.89 00:30:48.772 0 00:30:48.772 04:28:03 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:49.033 04:28:03 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:49.033 04:28:03 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:49.033 | .driver_specific 00:30:49.033 | .nvme_error 00:30:49.033 | .status_code 00:30:49.033 | .command_transient_transport_error' 00:30:49.033 04:28:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:49.033 04:28:03 -- host/digest.sh@71 -- # (( 107 > 0 )) 00:30:49.033 04:28:03 -- host/digest.sh@73 -- # killprocess 4137211 00:30:49.033 04:28:03 -- common/autotest_common.sh@926 -- # '[' -z 4137211 ']' 00:30:49.033 04:28:03 -- common/autotest_common.sh@930 -- # kill -0 4137211 00:30:49.033 04:28:03 -- common/autotest_common.sh@931 -- # uname 00:30:49.033 04:28:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:49.033 04:28:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4137211 00:30:49.033 04:28:03 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:49.033 04:28:03 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:49.033 04:28:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4137211' 00:30:49.033 killing process with pid 4137211 00:30:49.033 04:28:03 -- common/autotest_common.sh@945 -- # kill 4137211 00:30:49.033 Received shutdown signal, test time was about 2.000000 seconds 00:30:49.033 00:30:49.033 Latency(us) 00:30:49.033 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:49.033 =================================================================================================================== 00:30:49.033 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:49.033 04:28:03 -- common/autotest_common.sh@950 -- # wait 4137211 00:30:49.294 04:28:03 -- host/digest.sh@115 -- # killprocess 4134986 00:30:49.294 04:28:03 -- common/autotest_common.sh@926 -- # '[' -z 4134986 ']' 00:30:49.294 04:28:03 -- common/autotest_common.sh@930 -- # kill -0 4134986 00:30:49.294 04:28:03 -- common/autotest_common.sh@931 -- # uname 00:30:49.294 04:28:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:49.294 04:28:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4134986 00:30:49.294 04:28:03 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:49.294 04:28:03 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:49.294 04:28:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4134986' 00:30:49.294 killing process with pid 4134986 00:30:49.294 04:28:03 -- common/autotest_common.sh@945 -- # kill 4134986 00:30:49.294 04:28:03 -- common/autotest_common.sh@950 -- # wait 4134986 00:30:49.294 00:30:49.294 real 0m15.831s 00:30:49.294 user 0m31.267s 00:30:49.294 sys 0m3.021s 00:30:49.294 04:28:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:49.294 04:28:03 -- common/autotest_common.sh@10 -- # set +x 00:30:49.294 ************************************ 00:30:49.294 END TEST nvmf_digest_error 00:30:49.294 ************************************ 00:30:49.554 04:28:03 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:49.554 04:28:03 -- host/digest.sh@139 -- # nvmftestfini 00:30:49.554 04:28:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:49.554 04:28:03 -- nvmf/common.sh@116 -- # sync 00:30:49.554 04:28:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:49.554 04:28:03 -- nvmf/common.sh@119 -- # set +e 00:30:49.554 04:28:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:49.554 04:28:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:49.554 rmmod nvme_tcp 00:30:49.554 rmmod nvme_fabrics 00:30:49.554 rmmod nvme_keyring 00:30:49.554 04:28:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:49.554 04:28:03 -- nvmf/common.sh@123 -- # set -e 00:30:49.554 04:28:03 -- nvmf/common.sh@124 -- # return 0 00:30:49.554 04:28:03 -- nvmf/common.sh@477 -- # '[' -n 4134986 ']' 00:30:49.554 04:28:03 -- nvmf/common.sh@478 -- # killprocess 4134986 00:30:49.554 04:28:03 -- common/autotest_common.sh@926 -- # '[' -z 4134986 ']' 00:30:49.554 04:28:03 -- common/autotest_common.sh@930 -- # kill -0 4134986 00:30:49.554 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (4134986) - No such process 00:30:49.554 04:28:03 -- common/autotest_common.sh@953 -- # echo 'Process with pid 4134986 is not found' 00:30:49.554 Process with pid 4134986 is not found 00:30:49.554 04:28:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:49.554 04:28:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:49.554 04:28:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:49.554 04:28:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:49.554 04:28:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:49.554 04:28:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:49.554 04:28:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:49.554 04:28:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:52.102 04:28:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:52.102 00:30:52.102 real 0m41.332s 00:30:52.102 user 1m4.959s 00:30:52.102 sys 0m11.429s 00:30:52.102 04:28:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:52.102 04:28:06 -- common/autotest_common.sh@10 -- # set +x 00:30:52.102 ************************************ 00:30:52.102 END TEST nvmf_digest 00:30:52.102 ************************************ 00:30:52.102 04:28:06 -- nvmf/nvmf.sh@109 -- # [[ 0 -eq 1 ]] 00:30:52.102 04:28:06 -- nvmf/nvmf.sh@114 -- # [[ 0 -eq 1 ]] 00:30:52.102 04:28:06 -- nvmf/nvmf.sh@119 -- # [[ phy == phy ]] 00:30:52.102 04:28:06 -- nvmf/nvmf.sh@121 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:52.102 04:28:06 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:52.102 04:28:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:52.102 04:28:06 -- common/autotest_common.sh@10 -- # set +x 00:30:52.102 ************************************ 00:30:52.102 START TEST nvmf_bdevperf 00:30:52.102 ************************************ 00:30:52.102 04:28:06 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:52.102 * Looking for test storage... 00:30:52.102 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:52.102 04:28:06 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:52.102 04:28:06 -- nvmf/common.sh@7 -- # uname -s 00:30:52.102 04:28:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:52.102 04:28:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:52.102 04:28:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:52.102 04:28:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:52.102 04:28:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:52.102 04:28:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:52.102 04:28:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:52.102 04:28:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:52.102 04:28:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:52.102 04:28:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:52.102 04:28:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:52.102 04:28:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:52.102 04:28:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:52.102 04:28:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:52.102 04:28:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:52.102 04:28:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:52.102 04:28:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:52.102 04:28:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:52.102 04:28:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:52.102 04:28:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.102 04:28:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.102 04:28:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.102 04:28:06 -- paths/export.sh@5 -- # export PATH 00:30:52.102 04:28:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.102 04:28:06 -- nvmf/common.sh@46 -- # : 0 00:30:52.102 04:28:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:52.102 04:28:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:52.102 04:28:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:52.102 04:28:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:52.102 04:28:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:52.102 04:28:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:52.102 04:28:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:52.102 04:28:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:52.103 04:28:06 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:52.103 04:28:06 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:52.103 04:28:06 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:52.103 04:28:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:52.103 04:28:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:52.103 04:28:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:52.103 04:28:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:52.103 04:28:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:52.103 04:28:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:52.103 04:28:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:52.103 04:28:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:52.103 04:28:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:52.103 04:28:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:52.103 04:28:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:52.103 04:28:06 -- common/autotest_common.sh@10 -- # set +x 00:30:58.695 04:28:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:58.695 04:28:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:58.695 04:28:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:58.695 04:28:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:58.695 04:28:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:58.695 04:28:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:58.695 04:28:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:58.695 04:28:12 -- nvmf/common.sh@294 -- # net_devs=() 00:30:58.695 04:28:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:58.695 04:28:12 -- nvmf/common.sh@295 -- # e810=() 00:30:58.695 04:28:12 -- nvmf/common.sh@295 -- # local -ga e810 00:30:58.695 04:28:12 -- nvmf/common.sh@296 -- # x722=() 00:30:58.695 04:28:12 -- nvmf/common.sh@296 -- # local -ga x722 00:30:58.695 04:28:12 -- nvmf/common.sh@297 -- # mlx=() 00:30:58.695 04:28:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:58.695 04:28:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:58.695 04:28:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:58.695 04:28:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:58.695 04:28:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:58.695 04:28:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:58.695 04:28:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:58.695 04:28:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:58.696 04:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:58.696 04:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:30:58.696 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:30:58.696 04:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:58.696 04:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:30:58.696 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:30:58.696 04:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:58.696 04:28:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:58.696 04:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:58.696 04:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:58.696 04:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:58.696 04:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:30:58.696 Found net devices under 0000:4b:00.0: cvl_0_0 00:30:58.696 04:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:58.696 04:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:58.696 04:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:58.696 04:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:58.696 04:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:58.696 04:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:30:58.696 Found net devices under 0000:4b:00.1: cvl_0_1 00:30:58.696 04:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:58.696 04:28:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:58.696 04:28:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:58.696 04:28:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:58.696 04:28:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:58.696 04:28:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:58.696 04:28:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:58.696 04:28:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:58.696 04:28:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:58.696 04:28:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:58.696 04:28:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:58.696 04:28:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:58.696 04:28:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:58.696 04:28:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:58.696 04:28:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:58.696 04:28:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:58.696 04:28:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:58.696 04:28:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:58.696 04:28:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:58.696 04:28:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:58.696 04:28:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:58.696 04:28:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:58.696 04:28:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:58.696 04:28:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:58.696 04:28:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:58.696 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:58.696 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.863 ms 00:30:58.696 00:30:58.696 --- 10.0.0.2 ping statistics --- 00:30:58.696 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:58.696 rtt min/avg/max/mdev = 0.863/0.863/0.863/0.000 ms 00:30:58.696 04:28:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:58.696 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:58.696 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.412 ms 00:30:58.696 00:30:58.696 --- 10.0.0.1 ping statistics --- 00:30:58.696 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:58.696 rtt min/avg/max/mdev = 0.412/0.412/0.412/0.000 ms 00:30:58.696 04:28:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:58.696 04:28:13 -- nvmf/common.sh@410 -- # return 0 00:30:58.696 04:28:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:58.696 04:28:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:58.696 04:28:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:58.696 04:28:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:58.696 04:28:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:58.696 04:28:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:58.696 04:28:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:58.958 04:28:13 -- host/bdevperf.sh@25 -- # tgt_init 00:30:58.958 04:28:13 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:58.958 04:28:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:58.958 04:28:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:58.958 04:28:13 -- common/autotest_common.sh@10 -- # set +x 00:30:58.958 04:28:13 -- nvmf/common.sh@469 -- # nvmfpid=4142164 00:30:58.958 04:28:13 -- nvmf/common.sh@470 -- # waitforlisten 4142164 00:30:58.958 04:28:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:58.958 04:28:13 -- common/autotest_common.sh@819 -- # '[' -z 4142164 ']' 00:30:58.958 04:28:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:58.958 04:28:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:58.958 04:28:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:58.958 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:58.958 04:28:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:58.958 04:28:13 -- common/autotest_common.sh@10 -- # set +x 00:30:58.958 [2024-05-14 04:28:13.366547] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:58.958 [2024-05-14 04:28:13.366599] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:58.958 EAL: No free 2048 kB hugepages reported on node 1 00:30:58.958 [2024-05-14 04:28:13.448623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:58.958 [2024-05-14 04:28:13.522260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:58.958 [2024-05-14 04:28:13.522412] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:58.958 [2024-05-14 04:28:13.522421] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:58.958 [2024-05-14 04:28:13.522428] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:58.958 [2024-05-14 04:28:13.522566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:58.958 [2024-05-14 04:28:13.522838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:58.958 [2024-05-14 04:28:13.522839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:59.899 04:28:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:59.899 04:28:14 -- common/autotest_common.sh@852 -- # return 0 00:30:59.899 04:28:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:59.899 04:28:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:59.899 04:28:14 -- common/autotest_common.sh@10 -- # set +x 00:30:59.899 04:28:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:59.899 04:28:14 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:59.899 04:28:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:59.899 04:28:14 -- common/autotest_common.sh@10 -- # set +x 00:30:59.899 [2024-05-14 04:28:14.183154] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:59.899 04:28:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:59.899 04:28:14 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:59.899 04:28:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:59.899 04:28:14 -- common/autotest_common.sh@10 -- # set +x 00:30:59.899 Malloc0 00:30:59.899 04:28:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:59.899 04:28:14 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:59.899 04:28:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:59.899 04:28:14 -- common/autotest_common.sh@10 -- # set +x 00:30:59.899 04:28:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:59.899 04:28:14 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:59.899 04:28:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:59.899 04:28:14 -- common/autotest_common.sh@10 -- # set +x 00:30:59.899 04:28:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:59.899 04:28:14 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:59.899 04:28:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:59.899 04:28:14 -- common/autotest_common.sh@10 -- # set +x 00:30:59.899 [2024-05-14 04:28:14.247689] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:59.899 04:28:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:59.899 04:28:14 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:59.899 04:28:14 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:59.899 04:28:14 -- nvmf/common.sh@520 -- # config=() 00:30:59.899 04:28:14 -- nvmf/common.sh@520 -- # local subsystem config 00:30:59.899 04:28:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:59.899 04:28:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:59.899 { 00:30:59.899 "params": { 00:30:59.899 "name": "Nvme$subsystem", 00:30:59.899 "trtype": "$TEST_TRANSPORT", 00:30:59.899 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:59.899 "adrfam": "ipv4", 00:30:59.899 "trsvcid": "$NVMF_PORT", 00:30:59.899 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:59.899 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:59.899 "hdgst": ${hdgst:-false}, 00:30:59.899 "ddgst": ${ddgst:-false} 00:30:59.899 }, 00:30:59.899 "method": "bdev_nvme_attach_controller" 00:30:59.899 } 00:30:59.899 EOF 00:30:59.899 )") 00:30:59.899 04:28:14 -- nvmf/common.sh@542 -- # cat 00:30:59.899 04:28:14 -- nvmf/common.sh@544 -- # jq . 00:30:59.899 04:28:14 -- nvmf/common.sh@545 -- # IFS=, 00:30:59.899 04:28:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:59.899 "params": { 00:30:59.899 "name": "Nvme1", 00:30:59.899 "trtype": "tcp", 00:30:59.899 "traddr": "10.0.0.2", 00:30:59.899 "adrfam": "ipv4", 00:30:59.899 "trsvcid": "4420", 00:30:59.899 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:59.899 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:59.899 "hdgst": false, 00:30:59.899 "ddgst": false 00:30:59.899 }, 00:30:59.899 "method": "bdev_nvme_attach_controller" 00:30:59.899 }' 00:30:59.899 [2024-05-14 04:28:14.295317] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:59.899 [2024-05-14 04:28:14.295371] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4142219 ] 00:30:59.899 EAL: No free 2048 kB hugepages reported on node 1 00:30:59.899 [2024-05-14 04:28:14.353622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:59.899 [2024-05-14 04:28:14.416019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:00.161 Running I/O for 1 seconds... 00:31:01.104 00:31:01.104 Latency(us) 00:31:01.104 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:01.104 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:01.104 Verification LBA range: start 0x0 length 0x4000 00:31:01.104 Nvme1n1 : 1.01 13859.92 54.14 0.00 0.00 9195.05 1235.63 22719.15 00:31:01.104 =================================================================================================================== 00:31:01.104 Total : 13859.92 54.14 0.00 0.00 9195.05 1235.63 22719.15 00:31:01.365 04:28:15 -- host/bdevperf.sh@30 -- # bdevperfpid=4142537 00:31:01.365 04:28:15 -- host/bdevperf.sh@32 -- # sleep 3 00:31:01.365 04:28:15 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:31:01.365 04:28:15 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:31:01.365 04:28:15 -- nvmf/common.sh@520 -- # config=() 00:31:01.365 04:28:15 -- nvmf/common.sh@520 -- # local subsystem config 00:31:01.365 04:28:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:01.365 04:28:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:01.365 { 00:31:01.365 "params": { 00:31:01.365 "name": "Nvme$subsystem", 00:31:01.365 "trtype": "$TEST_TRANSPORT", 00:31:01.365 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:01.365 "adrfam": "ipv4", 00:31:01.365 "trsvcid": "$NVMF_PORT", 00:31:01.365 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:01.365 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:01.365 "hdgst": ${hdgst:-false}, 00:31:01.365 "ddgst": ${ddgst:-false} 00:31:01.365 }, 00:31:01.365 "method": "bdev_nvme_attach_controller" 00:31:01.365 } 00:31:01.365 EOF 00:31:01.365 )") 00:31:01.365 04:28:15 -- nvmf/common.sh@542 -- # cat 00:31:01.365 04:28:15 -- nvmf/common.sh@544 -- # jq . 00:31:01.365 04:28:15 -- nvmf/common.sh@545 -- # IFS=, 00:31:01.365 04:28:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:01.365 "params": { 00:31:01.365 "name": "Nvme1", 00:31:01.365 "trtype": "tcp", 00:31:01.366 "traddr": "10.0.0.2", 00:31:01.366 "adrfam": "ipv4", 00:31:01.366 "trsvcid": "4420", 00:31:01.366 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:01.366 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:01.366 "hdgst": false, 00:31:01.366 "ddgst": false 00:31:01.366 }, 00:31:01.366 "method": "bdev_nvme_attach_controller" 00:31:01.366 }' 00:31:01.366 [2024-05-14 04:28:15.864548] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:31:01.366 [2024-05-14 04:28:15.864602] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4142537 ] 00:31:01.366 EAL: No free 2048 kB hugepages reported on node 1 00:31:01.366 [2024-05-14 04:28:15.923671] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:01.626 [2024-05-14 04:28:15.984884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:01.626 Running I/O for 15 seconds... 00:31:04.934 04:28:18 -- host/bdevperf.sh@33 -- # kill -9 4142164 00:31:04.934 04:28:18 -- host/bdevperf.sh@35 -- # sleep 3 00:31:04.934 [2024-05-14 04:28:18.833666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:35128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:35144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:35152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:35160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:34672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:34688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:34696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:34704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:34720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:34736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.934 [2024-05-14 04:28:18.833968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:35176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.934 [2024-05-14 04:28:18.833977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.833986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:35184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.833994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:35200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:35208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:35216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:35224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:35240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:35256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:35272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:35280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:35296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:35320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:35336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:35344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:35360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:35376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:35392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:35408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:34752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:34760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:34768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:34784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:34800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:34808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:34824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:34832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:34848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:34872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:35424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:35432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:35464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.935 [2024-05-14 04:28:18.834581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:35488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:35496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:35504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.935 [2024-05-14 04:28:18.834631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.935 [2024-05-14 04:28:18.834640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.935 [2024-05-14 04:28:18.834647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.834680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:35536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:35544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.834712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:35560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.834745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:34896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:34912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:34928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:34960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:34984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:34992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:35000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:35008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:35024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:35032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:35040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:35048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.834986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:35080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.834994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:35096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:35568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.835027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:35576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.835044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:35584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.835060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:35592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.835076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.835092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:35608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.835109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:35616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.936 [2024-05-14 04:28:18.835125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:35624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:35632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:35120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:35136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:35192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:35232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:35288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:35304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:35312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:35640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.936 [2024-05-14 04:28:18.835400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:35648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.936 [2024-05-14 04:28:18.835408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:35656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:35664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:35672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:35680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:35696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:35704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:35712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:35728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:35736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:35744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:35752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:35760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:35768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:35776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:35784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:35792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:35808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:35816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:35832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:35840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:35848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:04.937 [2024-05-14 04:28:18.835828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:35328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:35352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:35440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:35448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:35456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:31:04.937 [2024-05-14 04:28:18.835944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.835953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1117ab0 is same with the state(5) to be set 00:31:04.937 [2024-05-14 04:28:18.835963] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:04.937 [2024-05-14 04:28:18.835968] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:04.937 [2024-05-14 04:28:18.835975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35472 len:8 PRP1 0x0 PRP2 0x0 00:31:04.937 [2024-05-14 04:28:18.835982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:04.937 [2024-05-14 04:28:18.836020] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1117ab0 was disconnected and freed. reset controller. 00:31:04.937 [2024-05-14 04:28:18.838369] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.937 [2024-05-14 04:28:18.838412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.937 [2024-05-14 04:28:18.839226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.937 [2024-05-14 04:28:18.839714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.937 [2024-05-14 04:28:18.839751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.937 [2024-05-14 04:28:18.839762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.937 [2024-05-14 04:28:18.839927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.937 [2024-05-14 04:28:18.840111] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.937 [2024-05-14 04:28:18.840120] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.937 [2024-05-14 04:28:18.840129] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.937 [2024-05-14 04:28:18.842268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.937 [2024-05-14 04:28:18.850977] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.937 [2024-05-14 04:28:18.851690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.937 [2024-05-14 04:28:18.852086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.937 [2024-05-14 04:28:18.852098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.938 [2024-05-14 04:28:18.852108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.938 [2024-05-14 04:28:18.852233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.938 [2024-05-14 04:28:18.852404] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.938 [2024-05-14 04:28:18.852413] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.938 [2024-05-14 04:28:18.852421] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.938 [2024-05-14 04:28:18.854880] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.938 [2024-05-14 04:28:18.863462] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.938 [2024-05-14 04:28:18.864168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.864678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.864692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.938 [2024-05-14 04:28:18.864702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.938 [2024-05-14 04:28:18.864808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.938 [2024-05-14 04:28:18.864936] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.938 [2024-05-14 04:28:18.864944] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.938 [2024-05-14 04:28:18.864951] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.938 [2024-05-14 04:28:18.867306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.938 [2024-05-14 04:28:18.875833] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.938 [2024-05-14 04:28:18.876525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.877037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.877050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.938 [2024-05-14 04:28:18.877059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.938 [2024-05-14 04:28:18.877202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.938 [2024-05-14 04:28:18.877338] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.938 [2024-05-14 04:28:18.877347] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.938 [2024-05-14 04:28:18.877355] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.938 [2024-05-14 04:28:18.879488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.938 [2024-05-14 04:28:18.888358] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.938 [2024-05-14 04:28:18.889070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.889461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.889476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.938 [2024-05-14 04:28:18.889486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.938 [2024-05-14 04:28:18.889629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.938 [2024-05-14 04:28:18.889756] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.938 [2024-05-14 04:28:18.889764] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.938 [2024-05-14 04:28:18.889772] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.938 [2024-05-14 04:28:18.891906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.938 [2024-05-14 04:28:18.900844] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.938 [2024-05-14 04:28:18.901565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.902087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.902104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.938 [2024-05-14 04:28:18.902114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.938 [2024-05-14 04:28:18.902276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.938 [2024-05-14 04:28:18.902430] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.938 [2024-05-14 04:28:18.902439] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.938 [2024-05-14 04:28:18.902447] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.938 [2024-05-14 04:28:18.904616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.938 [2024-05-14 04:28:18.913307] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.938 [2024-05-14 04:28:18.913976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.914444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.914454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.938 [2024-05-14 04:28:18.914462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.938 [2024-05-14 04:28:18.914604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.938 [2024-05-14 04:28:18.914710] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.938 [2024-05-14 04:28:18.914718] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.938 [2024-05-14 04:28:18.914724] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.938 [2024-05-14 04:28:18.916944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.938 [2024-05-14 04:28:18.925663] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.938 [2024-05-14 04:28:18.926400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.926939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.926952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.938 [2024-05-14 04:28:18.926961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.938 [2024-05-14 04:28:18.927123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.938 [2024-05-14 04:28:18.927312] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.938 [2024-05-14 04:28:18.927321] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.938 [2024-05-14 04:28:18.927329] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.938 [2024-05-14 04:28:18.929427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.938 [2024-05-14 04:28:18.938337] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.938 [2024-05-14 04:28:18.938992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.939456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.939467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.938 [2024-05-14 04:28:18.939479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.938 [2024-05-14 04:28:18.939586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.938 [2024-05-14 04:28:18.939746] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.938 [2024-05-14 04:28:18.939754] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.938 [2024-05-14 04:28:18.939760] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.938 [2024-05-14 04:28:18.942141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.938 [2024-05-14 04:28:18.950925] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.938 [2024-05-14 04:28:18.951685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.952177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.938 [2024-05-14 04:28:18.952189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.938 [2024-05-14 04:28:18.952199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.938 [2024-05-14 04:28:18.952385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.938 [2024-05-14 04:28:18.952549] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.938 [2024-05-14 04:28:18.952558] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.938 [2024-05-14 04:28:18.952565] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.938 [2024-05-14 04:28:18.954953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.938 [2024-05-14 04:28:18.963464] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.938 [2024-05-14 04:28:18.964155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:18.964714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:18.964728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.939 [2024-05-14 04:28:18.964737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.939 [2024-05-14 04:28:18.964880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.939 [2024-05-14 04:28:18.965025] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.939 [2024-05-14 04:28:18.965034] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.939 [2024-05-14 04:28:18.965041] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.939 [2024-05-14 04:28:18.967506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.939 [2024-05-14 04:28:18.976062] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.939 [2024-05-14 04:28:18.976761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:18.977347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:18.977361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.939 [2024-05-14 04:28:18.977370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.939 [2024-05-14 04:28:18.977537] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.939 [2024-05-14 04:28:18.977664] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.939 [2024-05-14 04:28:18.977673] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.939 [2024-05-14 04:28:18.977680] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.939 [2024-05-14 04:28:18.979997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.939 [2024-05-14 04:28:18.988584] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.939 [2024-05-14 04:28:18.989250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:18.989811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:18.989822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.939 [2024-05-14 04:28:18.989829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.939 [2024-05-14 04:28:18.990009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.939 [2024-05-14 04:28:18.990187] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.939 [2024-05-14 04:28:18.990195] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.939 [2024-05-14 04:28:18.990201] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.939 [2024-05-14 04:28:18.992533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.939 [2024-05-14 04:28:19.001038] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.939 [2024-05-14 04:28:19.001627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.002120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.002132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.939 [2024-05-14 04:28:19.002142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.939 [2024-05-14 04:28:19.002311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.939 [2024-05-14 04:28:19.002475] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.939 [2024-05-14 04:28:19.002483] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.939 [2024-05-14 04:28:19.002491] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.939 [2024-05-14 04:28:19.004806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.939 [2024-05-14 04:28:19.013647] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.939 [2024-05-14 04:28:19.014289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.014805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.014818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.939 [2024-05-14 04:28:19.014827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.939 [2024-05-14 04:28:19.015025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.939 [2024-05-14 04:28:19.015175] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.939 [2024-05-14 04:28:19.015183] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.939 [2024-05-14 04:28:19.015190] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.939 [2024-05-14 04:28:19.017512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.939 [2024-05-14 04:28:19.026150] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.939 [2024-05-14 04:28:19.026939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.027505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.027519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.939 [2024-05-14 04:28:19.027528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.939 [2024-05-14 04:28:19.027671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.939 [2024-05-14 04:28:19.027799] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.939 [2024-05-14 04:28:19.027807] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.939 [2024-05-14 04:28:19.027815] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.939 [2024-05-14 04:28:19.030059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.939 [2024-05-14 04:28:19.038629] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.939 [2024-05-14 04:28:19.039371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.039925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.039938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.939 [2024-05-14 04:28:19.039948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.939 [2024-05-14 04:28:19.040127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.939 [2024-05-14 04:28:19.040299] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.939 [2024-05-14 04:28:19.040308] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.939 [2024-05-14 04:28:19.040315] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.939 [2024-05-14 04:28:19.042557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.939 [2024-05-14 04:28:19.051118] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.939 [2024-05-14 04:28:19.051858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.052354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.052368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.939 [2024-05-14 04:28:19.052377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.939 [2024-05-14 04:28:19.052520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.939 [2024-05-14 04:28:19.052684] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.939 [2024-05-14 04:28:19.052696] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.939 [2024-05-14 04:28:19.052704] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.939 [2024-05-14 04:28:19.054693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.939 [2024-05-14 04:28:19.063721] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.939 [2024-05-14 04:28:19.064370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.064866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.939 [2024-05-14 04:28:19.064879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.939 [2024-05-14 04:28:19.064888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.939 [2024-05-14 04:28:19.065031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.939 [2024-05-14 04:28:19.065176] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.065185] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.065192] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.067532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.076289] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.077019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.077563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.077578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.940 [2024-05-14 04:28:19.077587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.940 [2024-05-14 04:28:19.077767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.940 [2024-05-14 04:28:19.077894] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.077903] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.077910] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.080207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.088819] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.089603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.090100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.090112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.940 [2024-05-14 04:28:19.090121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.940 [2024-05-14 04:28:19.090310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.940 [2024-05-14 04:28:19.090475] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.090483] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.090495] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.092738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.101246] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.101871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.102521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.102557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.940 [2024-05-14 04:28:19.102568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.940 [2024-05-14 04:28:19.102748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.940 [2024-05-14 04:28:19.102875] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.102884] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.102891] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.105122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.113700] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.114374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.114869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.114878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.940 [2024-05-14 04:28:19.114886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.940 [2024-05-14 04:28:19.115011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.940 [2024-05-14 04:28:19.115153] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.115161] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.115168] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.117644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.126263] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.127024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.127516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.127530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.940 [2024-05-14 04:28:19.127539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.940 [2024-05-14 04:28:19.127646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.940 [2024-05-14 04:28:19.127773] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.127781] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.127789] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.130057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.138844] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.139453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.139966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.139975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.940 [2024-05-14 04:28:19.139983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.940 [2024-05-14 04:28:19.140126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.940 [2024-05-14 04:28:19.140286] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.140298] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.140305] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.142630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.151343] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.151955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.152472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.152482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.940 [2024-05-14 04:28:19.152489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.940 [2024-05-14 04:28:19.152595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.940 [2024-05-14 04:28:19.152755] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.152762] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.152769] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.154970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.163810] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.164570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.165091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.165104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.940 [2024-05-14 04:28:19.165113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.940 [2024-05-14 04:28:19.165275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.940 [2024-05-14 04:28:19.165428] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.165437] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.165445] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.167667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.176451] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.177189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.177684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.177699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.940 [2024-05-14 04:28:19.177708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.940 [2024-05-14 04:28:19.177852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.940 [2024-05-14 04:28:19.177997] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.940 [2024-05-14 04:28:19.178005] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.940 [2024-05-14 04:28:19.178013] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.940 [2024-05-14 04:28:19.180254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.940 [2024-05-14 04:28:19.188840] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.940 [2024-05-14 04:28:19.189563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.190125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.940 [2024-05-14 04:28:19.190138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.190147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.190235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.190371] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.190380] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.190388] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.192775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.941 [2024-05-14 04:28:19.201423] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.941 [2024-05-14 04:28:19.202140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.202723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.202737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.202746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.202908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.203035] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.203043] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.203051] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.205313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.941 [2024-05-14 04:28:19.213823] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.941 [2024-05-14 04:28:19.214541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.214956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.214969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.214978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.215066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.215266] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.215274] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.215282] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.217440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.941 [2024-05-14 04:28:19.226246] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.941 [2024-05-14 04:28:19.226952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.227453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.227467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.227477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.227638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.227802] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.227810] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.227817] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.230028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.941 [2024-05-14 04:28:19.238707] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.941 [2024-05-14 04:28:19.239390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.239895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.239908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.239917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.240078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.240206] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.240214] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.240221] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.242545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.941 [2024-05-14 04:28:19.251242] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.941 [2024-05-14 04:28:19.251942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.252435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.252453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.252463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.252679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.252807] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.252815] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.252822] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.255228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.941 [2024-05-14 04:28:19.263646] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.941 [2024-05-14 04:28:19.264387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.264741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.264754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.264763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.264906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.265070] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.265078] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.265086] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.267207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.941 [2024-05-14 04:28:19.276095] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.941 [2024-05-14 04:28:19.276735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.277223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.277236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.277245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.277435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.277599] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.277607] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.277614] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.279893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.941 [2024-05-14 04:28:19.288749] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.941 [2024-05-14 04:28:19.289478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.289970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.289983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.289999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.290124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.290251] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.290259] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.290266] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.292514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.941 [2024-05-14 04:28:19.301234] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.941 [2024-05-14 04:28:19.301940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.302431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.941 [2024-05-14 04:28:19.302446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.941 [2024-05-14 04:28:19.302455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.941 [2024-05-14 04:28:19.302635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.941 [2024-05-14 04:28:19.302762] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.941 [2024-05-14 04:28:19.302770] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.941 [2024-05-14 04:28:19.302778] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.941 [2024-05-14 04:28:19.305058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.313678] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.314342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.314836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.314849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.314858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.314983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.315111] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.942 [2024-05-14 04:28:19.315119] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.942 [2024-05-14 04:28:19.315127] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.942 [2024-05-14 04:28:19.317523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.326149] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.326798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.327286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.327306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.327316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.327536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.327682] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.942 [2024-05-14 04:28:19.327690] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.942 [2024-05-14 04:28:19.327698] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.942 [2024-05-14 04:28:19.329977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.338594] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.339377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.339841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.339854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.339863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.340006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.340134] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.942 [2024-05-14 04:28:19.340142] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.942 [2024-05-14 04:28:19.340149] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.942 [2024-05-14 04:28:19.342329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.350914] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.351633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.352130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.352142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.352151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.352301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.352465] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.942 [2024-05-14 04:28:19.352473] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.942 [2024-05-14 04:28:19.352481] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.942 [2024-05-14 04:28:19.354793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.363441] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.364060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.364611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.364648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.364658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.364838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.364988] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.942 [2024-05-14 04:28:19.364997] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.942 [2024-05-14 04:28:19.365004] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.942 [2024-05-14 04:28:19.367250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.376033] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.376780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.377281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.377302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.377312] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.377491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.377637] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.942 [2024-05-14 04:28:19.377645] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.942 [2024-05-14 04:28:19.377652] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.942 [2024-05-14 04:28:19.379895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.388528] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.389268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.389786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.389799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.389809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.389970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.390061] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.942 [2024-05-14 04:28:19.390069] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.942 [2024-05-14 04:28:19.390076] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.942 [2024-05-14 04:28:19.392379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.401130] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.401904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.402522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.402558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.402569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.402749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.402912] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.942 [2024-05-14 04:28:19.402925] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.942 [2024-05-14 04:28:19.402932] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.942 [2024-05-14 04:28:19.405087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.413516] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.414261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.414820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.414834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.414843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.415005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.415205] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.942 [2024-05-14 04:28:19.415213] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.942 [2024-05-14 04:28:19.415220] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.942 [2024-05-14 04:28:19.417376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.942 [2024-05-14 04:28:19.425960] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.942 [2024-05-14 04:28:19.426716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.427117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.942 [2024-05-14 04:28:19.427131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.942 [2024-05-14 04:28:19.427140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.942 [2024-05-14 04:28:19.427327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.942 [2024-05-14 04:28:19.427473] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.943 [2024-05-14 04:28:19.427481] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.943 [2024-05-14 04:28:19.427489] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.943 [2024-05-14 04:28:19.429659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.943 [2024-05-14 04:28:19.438562] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.943 [2024-05-14 04:28:19.439215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.439412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.439432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.943 [2024-05-14 04:28:19.439440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.943 [2024-05-14 04:28:19.439588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.943 [2024-05-14 04:28:19.439713] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.943 [2024-05-14 04:28:19.439722] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.943 [2024-05-14 04:28:19.439733] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.943 [2024-05-14 04:28:19.441866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.943 [2024-05-14 04:28:19.451033] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.943 [2024-05-14 04:28:19.451689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.452154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.452163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.943 [2024-05-14 04:28:19.452171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.943 [2024-05-14 04:28:19.452277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.943 [2024-05-14 04:28:19.452458] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.943 [2024-05-14 04:28:19.452466] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.943 [2024-05-14 04:28:19.452474] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.943 [2024-05-14 04:28:19.454547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.943 [2024-05-14 04:28:19.463503] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.943 [2024-05-14 04:28:19.464374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.464933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.464947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.943 [2024-05-14 04:28:19.464957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.943 [2024-05-14 04:28:19.465138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.943 [2024-05-14 04:28:19.465308] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.943 [2024-05-14 04:28:19.465316] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.943 [2024-05-14 04:28:19.465324] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.943 [2024-05-14 04:28:19.467550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.943 [2024-05-14 04:28:19.476007] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.943 [2024-05-14 04:28:19.476675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.477141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.477151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.943 [2024-05-14 04:28:19.477159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.943 [2024-05-14 04:28:19.477266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.943 [2024-05-14 04:28:19.477413] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.943 [2024-05-14 04:28:19.477422] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.943 [2024-05-14 04:28:19.477428] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.943 [2024-05-14 04:28:19.479471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.943 [2024-05-14 04:28:19.488747] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.943 [2024-05-14 04:28:19.489501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.489993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.490005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.943 [2024-05-14 04:28:19.490015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.943 [2024-05-14 04:28:19.490158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.943 [2024-05-14 04:28:19.490310] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.943 [2024-05-14 04:28:19.490319] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.943 [2024-05-14 04:28:19.490326] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.943 [2024-05-14 04:28:19.492568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.943 [2024-05-14 04:28:19.501169] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.943 [2024-05-14 04:28:19.501894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.502383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.502396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.943 [2024-05-14 04:28:19.502405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.943 [2024-05-14 04:28:19.502585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.943 [2024-05-14 04:28:19.502712] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.943 [2024-05-14 04:28:19.502720] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.943 [2024-05-14 04:28:19.502728] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:04.943 [2024-05-14 04:28:19.504953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:04.943 [2024-05-14 04:28:19.513784] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:04.943 [2024-05-14 04:28:19.514441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.514908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:04.943 [2024-05-14 04:28:19.514918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:04.943 [2024-05-14 04:28:19.514925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:04.943 [2024-05-14 04:28:19.515086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:04.943 [2024-05-14 04:28:19.515264] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:04.943 [2024-05-14 04:28:19.515272] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:04.943 [2024-05-14 04:28:19.515279] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.206 [2024-05-14 04:28:19.517543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.526334] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.526942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.527449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.527459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.527467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.207 [2024-05-14 04:28:19.527609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.207 [2024-05-14 04:28:19.527769] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.207 [2024-05-14 04:28:19.527777] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.207 [2024-05-14 04:28:19.527784] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.207 [2024-05-14 04:28:19.529910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.538745] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.539339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.539879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.539889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.539896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.207 [2024-05-14 04:28:19.540056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.207 [2024-05-14 04:28:19.540198] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.207 [2024-05-14 04:28:19.540206] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.207 [2024-05-14 04:28:19.540213] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.207 [2024-05-14 04:28:19.542596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.551283] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.551773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.552236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.552246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.552253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.207 [2024-05-14 04:28:19.552418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.207 [2024-05-14 04:28:19.552525] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.207 [2024-05-14 04:28:19.552533] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.207 [2024-05-14 04:28:19.552540] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.207 [2024-05-14 04:28:19.554884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.563960] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.564649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.565154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.565167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.565176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.207 [2024-05-14 04:28:19.565365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.207 [2024-05-14 04:28:19.565511] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.207 [2024-05-14 04:28:19.565519] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.207 [2024-05-14 04:28:19.565527] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.207 [2024-05-14 04:28:19.567713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.576510] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.577157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.577664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.577678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.577687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.207 [2024-05-14 04:28:19.577867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.207 [2024-05-14 04:28:19.578031] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.207 [2024-05-14 04:28:19.578039] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.207 [2024-05-14 04:28:19.578046] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.207 [2024-05-14 04:28:19.580276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.589174] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.589761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.590350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.590363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.590373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.207 [2024-05-14 04:28:19.590534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.207 [2024-05-14 04:28:19.590662] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.207 [2024-05-14 04:28:19.590670] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.207 [2024-05-14 04:28:19.590678] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.207 [2024-05-14 04:28:19.592941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.601737] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.602529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.602801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.602825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.602834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.207 [2024-05-14 04:28:19.602978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.207 [2024-05-14 04:28:19.603124] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.207 [2024-05-14 04:28:19.603133] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.207 [2024-05-14 04:28:19.603140] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.207 [2024-05-14 04:28:19.605371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.614226] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.614711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.615175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.615185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.615193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.207 [2024-05-14 04:28:19.615304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.207 [2024-05-14 04:28:19.615485] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.207 [2024-05-14 04:28:19.615493] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.207 [2024-05-14 04:28:19.615499] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.207 [2024-05-14 04:28:19.617629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.626819] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.627577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.628065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.628079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.628088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.207 [2024-05-14 04:28:19.628268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.207 [2024-05-14 04:28:19.628438] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.207 [2024-05-14 04:28:19.628447] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.207 [2024-05-14 04:28:19.628454] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.207 [2024-05-14 04:28:19.630823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.207 [2024-05-14 04:28:19.639091] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.207 [2024-05-14 04:28:19.639709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.640172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.207 [2024-05-14 04:28:19.640182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.207 [2024-05-14 04:28:19.640194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.640377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.640538] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.640546] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.640553] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.642774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.651455] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.652154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.652663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.652677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.208 [2024-05-14 04:28:19.652686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.652811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.652993] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.653001] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.653009] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.655365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.664180] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.664819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.665285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.665300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.208 [2024-05-14 04:28:19.665308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.665433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.665538] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.665546] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.665552] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.667700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.676663] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.677338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.677812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.677821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.208 [2024-05-14 04:28:19.677829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.677998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.678123] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.678131] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.678137] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.680380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.688926] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.689654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.690145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.690157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.208 [2024-05-14 04:28:19.690166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.690372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.690517] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.690526] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.690533] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.692630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.701409] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.702135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.702537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.702551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.208 [2024-05-14 04:28:19.702560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.702721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.702867] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.702875] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.702882] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.705056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.713899] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.714601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.715091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.715103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.208 [2024-05-14 04:28:19.715113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.715274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.715431] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.715440] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.715447] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.717743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.726423] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.727158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.727664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.727679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.208 [2024-05-14 04:28:19.727688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.727831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.728032] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.728041] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.728048] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.730317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.738943] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.739556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.740019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.740028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.208 [2024-05-14 04:28:19.740036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.740179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.740363] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.740371] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.740378] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.742614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.751378] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.752072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.752504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.208 [2024-05-14 04:28:19.752521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.208 [2024-05-14 04:28:19.752530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.208 [2024-05-14 04:28:19.752710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.208 [2024-05-14 04:28:19.752819] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.208 [2024-05-14 04:28:19.752832] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.208 [2024-05-14 04:28:19.752839] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.208 [2024-05-14 04:28:19.755086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.208 [2024-05-14 04:28:19.763689] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.208 [2024-05-14 04:28:19.764415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.209 [2024-05-14 04:28:19.764804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.209 [2024-05-14 04:28:19.764816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.209 [2024-05-14 04:28:19.764825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.209 [2024-05-14 04:28:19.764987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.209 [2024-05-14 04:28:19.765168] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.209 [2024-05-14 04:28:19.765176] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.209 [2024-05-14 04:28:19.765184] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.209 [2024-05-14 04:28:19.767342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.209 [2024-05-14 04:28:19.776215] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.209 [2024-05-14 04:28:19.776847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.209 [2024-05-14 04:28:19.777353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.209 [2024-05-14 04:28:19.777364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.209 [2024-05-14 04:28:19.777372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.209 [2024-05-14 04:28:19.777514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.209 [2024-05-14 04:28:19.777620] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.209 [2024-05-14 04:28:19.777628] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.209 [2024-05-14 04:28:19.777635] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.209 [2024-05-14 04:28:19.779872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.209 [2024-05-14 04:28:19.788887] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.209 [2024-05-14 04:28:19.789551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.209 [2024-05-14 04:28:19.790043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.209 [2024-05-14 04:28:19.790055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.209 [2024-05-14 04:28:19.790065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.209 [2024-05-14 04:28:19.790226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.209 [2024-05-14 04:28:19.790341] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.209 [2024-05-14 04:28:19.790350] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.209 [2024-05-14 04:28:19.790361] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.209 [2024-05-14 04:28:19.792749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.472 [2024-05-14 04:28:19.801264] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.472 [2024-05-14 04:28:19.802029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.802439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.802454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.472 [2024-05-14 04:28:19.802463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.472 [2024-05-14 04:28:19.802644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.472 [2024-05-14 04:28:19.802808] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.472 [2024-05-14 04:28:19.802816] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.472 [2024-05-14 04:28:19.802824] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.472 [2024-05-14 04:28:19.805162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.472 [2024-05-14 04:28:19.813869] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.472 [2024-05-14 04:28:19.814662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.815151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.815163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.472 [2024-05-14 04:28:19.815173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.472 [2024-05-14 04:28:19.815340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.472 [2024-05-14 04:28:19.815432] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.472 [2024-05-14 04:28:19.815440] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.472 [2024-05-14 04:28:19.815447] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.472 [2024-05-14 04:28:19.817672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.472 [2024-05-14 04:28:19.826191] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.472 [2024-05-14 04:28:19.826829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.827303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.827314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.472 [2024-05-14 04:28:19.827322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.472 [2024-05-14 04:28:19.827482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.472 [2024-05-14 04:28:19.827625] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.472 [2024-05-14 04:28:19.827632] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.472 [2024-05-14 04:28:19.827639] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.472 [2024-05-14 04:28:19.830096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.472 [2024-05-14 04:28:19.838536] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.472 [2024-05-14 04:28:19.839172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.839761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.839798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.472 [2024-05-14 04:28:19.839808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.472 [2024-05-14 04:28:19.839970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.472 [2024-05-14 04:28:19.840098] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.472 [2024-05-14 04:28:19.840106] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.472 [2024-05-14 04:28:19.840114] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.472 [2024-05-14 04:28:19.842416] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.472 [2024-05-14 04:28:19.850886] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.472 [2024-05-14 04:28:19.851660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.852160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.852173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.472 [2024-05-14 04:28:19.852183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.472 [2024-05-14 04:28:19.852314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.472 [2024-05-14 04:28:19.852461] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.472 [2024-05-14 04:28:19.852469] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.472 [2024-05-14 04:28:19.852477] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.472 [2024-05-14 04:28:19.854683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.472 [2024-05-14 04:28:19.863289] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.472 [2024-05-14 04:28:19.863991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.864488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.864503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.472 [2024-05-14 04:28:19.864513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.472 [2024-05-14 04:28:19.864620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.472 [2024-05-14 04:28:19.864802] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.472 [2024-05-14 04:28:19.864810] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.472 [2024-05-14 04:28:19.864817] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.472 [2024-05-14 04:28:19.867117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.472 [2024-05-14 04:28:19.875482] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.472 [2024-05-14 04:28:19.875972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.876566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.876603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.472 [2024-05-14 04:28:19.876614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.472 [2024-05-14 04:28:19.876775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.472 [2024-05-14 04:28:19.876885] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.472 [2024-05-14 04:28:19.876893] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.472 [2024-05-14 04:28:19.876901] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.472 [2024-05-14 04:28:19.879240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.472 [2024-05-14 04:28:19.887956] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.472 [2024-05-14 04:28:19.888677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.889163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.472 [2024-05-14 04:28:19.889176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.472 [2024-05-14 04:28:19.889185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.472 [2024-05-14 04:28:19.889353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.472 [2024-05-14 04:28:19.889517] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:19.889526] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:19.889533] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:19.892010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:19.900298] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:19.901007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.901585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.901623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.473 [2024-05-14 04:28:19.901633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.473 [2024-05-14 04:28:19.901758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.473 [2024-05-14 04:28:19.901886] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:19.901895] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:19.901902] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:19.904184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:19.912843] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:19.913343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.913922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.913959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.473 [2024-05-14 04:28:19.913969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.473 [2024-05-14 04:28:19.914112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.473 [2024-05-14 04:28:19.914320] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:19.914330] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:19.914337] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:19.916453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:19.925339] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:19.926041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.926612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.926648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.473 [2024-05-14 04:28:19.926659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.473 [2024-05-14 04:28:19.926820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.473 [2024-05-14 04:28:19.926984] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:19.926993] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:19.927000] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:19.929282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:19.937706] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:19.938334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.938812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.938822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.473 [2024-05-14 04:28:19.938830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.473 [2024-05-14 04:28:19.938959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.473 [2024-05-14 04:28:19.939066] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:19.939073] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:19.939080] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:19.941327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:19.950082] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:19.950524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.951005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.951019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.473 [2024-05-14 04:28:19.951027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.473 [2024-05-14 04:28:19.951151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.473 [2024-05-14 04:28:19.951274] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:19.951282] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:19.951288] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:19.953602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:19.962748] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:19.963390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.963933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.963946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.473 [2024-05-14 04:28:19.963955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.473 [2024-05-14 04:28:19.964135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.473 [2024-05-14 04:28:19.964262] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:19.964271] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:19.964278] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:19.966601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:19.975321] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:19.975935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.976403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.976413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.473 [2024-05-14 04:28:19.976421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.473 [2024-05-14 04:28:19.976564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.473 [2024-05-14 04:28:19.976724] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:19.976732] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:19.976738] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:19.978939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:19.987820] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:19.988440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.988908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:19.988918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.473 [2024-05-14 04:28:19.988929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.473 [2024-05-14 04:28:19.989072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.473 [2024-05-14 04:28:19.989214] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:19.989221] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:19.989228] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:19.991595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:20.000084] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:20.000751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:20.001248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:20.001262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.473 [2024-05-14 04:28:20.001271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.473 [2024-05-14 04:28:20.001458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.473 [2024-05-14 04:28:20.001640] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.473 [2024-05-14 04:28:20.001648] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.473 [2024-05-14 04:28:20.001656] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.473 [2024-05-14 04:28:20.004301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.473 [2024-05-14 04:28:20.012584] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.473 [2024-05-14 04:28:20.013316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.473 [2024-05-14 04:28:20.013723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.474 [2024-05-14 04:28:20.013737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.474 [2024-05-14 04:28:20.013747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.474 [2024-05-14 04:28:20.013890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.474 [2024-05-14 04:28:20.014018] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.474 [2024-05-14 04:28:20.014026] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.474 [2024-05-14 04:28:20.014033] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.474 [2024-05-14 04:28:20.016410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.474 [2024-05-14 04:28:20.024868] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.474 [2024-05-14 04:28:20.025655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.474 [2024-05-14 04:28:20.025983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.474 [2024-05-14 04:28:20.025995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.474 [2024-05-14 04:28:20.026004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.474 [2024-05-14 04:28:20.026100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.474 [2024-05-14 04:28:20.026243] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.474 [2024-05-14 04:28:20.026252] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.474 [2024-05-14 04:28:20.026259] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.474 [2024-05-14 04:28:20.028500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.474 [2024-05-14 04:28:20.037180] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.474 [2024-05-14 04:28:20.037879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.474 [2024-05-14 04:28:20.038386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.474 [2024-05-14 04:28:20.038397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.474 [2024-05-14 04:28:20.038404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.474 [2024-05-14 04:28:20.038565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.474 [2024-05-14 04:28:20.038725] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.474 [2024-05-14 04:28:20.038732] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.474 [2024-05-14 04:28:20.038739] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.474 [2024-05-14 04:28:20.040903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.474 [2024-05-14 04:28:20.049884] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.474 [2024-05-14 04:28:20.050577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.474 [2024-05-14 04:28:20.051081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.474 [2024-05-14 04:28:20.051094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.474 [2024-05-14 04:28:20.051103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.474 [2024-05-14 04:28:20.051283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.474 [2024-05-14 04:28:20.051455] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.474 [2024-05-14 04:28:20.051463] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.474 [2024-05-14 04:28:20.051471] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.474 [2024-05-14 04:28:20.053624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.737 [2024-05-14 04:28:20.062249] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.737 [2024-05-14 04:28:20.062978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.737 [2024-05-14 04:28:20.063470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.737 [2024-05-14 04:28:20.063484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.737 [2024-05-14 04:28:20.063494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.737 [2024-05-14 04:28:20.063656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.737 [2024-05-14 04:28:20.063824] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.737 [2024-05-14 04:28:20.063833] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.737 [2024-05-14 04:28:20.063840] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.737 [2024-05-14 04:28:20.066030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.737 [2024-05-14 04:28:20.074875] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.737 [2024-05-14 04:28:20.075580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.737 [2024-05-14 04:28:20.076147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.737 [2024-05-14 04:28:20.076160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.737 [2024-05-14 04:28:20.076169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.737 [2024-05-14 04:28:20.076338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.737 [2024-05-14 04:28:20.076466] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.737 [2024-05-14 04:28:20.076475] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.737 [2024-05-14 04:28:20.076482] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.737 [2024-05-14 04:28:20.078834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.737 [2024-05-14 04:28:20.087308] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.737 [2024-05-14 04:28:20.087880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.737 [2024-05-14 04:28:20.088526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.737 [2024-05-14 04:28:20.088563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.737 [2024-05-14 04:28:20.088574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.737 [2024-05-14 04:28:20.088736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.737 [2024-05-14 04:28:20.088900] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.737 [2024-05-14 04:28:20.088908] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.737 [2024-05-14 04:28:20.088916] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.737 [2024-05-14 04:28:20.091251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.737 [2024-05-14 04:28:20.099847] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.737 [2024-05-14 04:28:20.100585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.737 [2024-05-14 04:28:20.101085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.101098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.101107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.101250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.101420] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.738 [2024-05-14 04:28:20.101434] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.738 [2024-05-14 04:28:20.101441] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.738 [2024-05-14 04:28:20.103594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.738 [2024-05-14 04:28:20.112327] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.738 [2024-05-14 04:28:20.112918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.113285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.113300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.113309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.113488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.113630] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.738 [2024-05-14 04:28:20.113638] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.738 [2024-05-14 04:28:20.113645] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.738 [2024-05-14 04:28:20.116008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.738 [2024-05-14 04:28:20.124790] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.738 [2024-05-14 04:28:20.125658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.126169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.126182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.126191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.126398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.126545] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.738 [2024-05-14 04:28:20.126553] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.738 [2024-05-14 04:28:20.126560] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.738 [2024-05-14 04:28:20.129060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.738 [2024-05-14 04:28:20.137260] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.738 [2024-05-14 04:28:20.137938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.138506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.138543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.138554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.138715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.138843] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.738 [2024-05-14 04:28:20.138851] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.738 [2024-05-14 04:28:20.138863] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.738 [2024-05-14 04:28:20.141149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.738 [2024-05-14 04:28:20.149514] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.738 [2024-05-14 04:28:20.150242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.150747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.150760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.150770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.150949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.151095] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.738 [2024-05-14 04:28:20.151103] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.738 [2024-05-14 04:28:20.151110] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.738 [2024-05-14 04:28:20.153375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.738 [2024-05-14 04:28:20.161962] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.738 [2024-05-14 04:28:20.162736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.163226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.163239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.163248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.163417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.163581] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.738 [2024-05-14 04:28:20.163589] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.738 [2024-05-14 04:28:20.163596] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.738 [2024-05-14 04:28:20.165967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.738 [2024-05-14 04:28:20.174482] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.738 [2024-05-14 04:28:20.175219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.175790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.175805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.175814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.175994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.176121] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.738 [2024-05-14 04:28:20.176129] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.738 [2024-05-14 04:28:20.176136] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.738 [2024-05-14 04:28:20.178425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.738 [2024-05-14 04:28:20.186953] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.738 [2024-05-14 04:28:20.187668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.188157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.188170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.188179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.188328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.188474] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.738 [2024-05-14 04:28:20.188482] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.738 [2024-05-14 04:28:20.188490] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.738 [2024-05-14 04:28:20.190571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.738 [2024-05-14 04:28:20.199518] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.738 [2024-05-14 04:28:20.200183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.200750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.200787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.200797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.200977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.201105] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.738 [2024-05-14 04:28:20.201113] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.738 [2024-05-14 04:28:20.201121] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.738 [2024-05-14 04:28:20.203479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.738 [2024-05-14 04:28:20.211959] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.738 [2024-05-14 04:28:20.212703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.213193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.738 [2024-05-14 04:28:20.213205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.738 [2024-05-14 04:28:20.213215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.738 [2024-05-14 04:28:20.213417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.738 [2024-05-14 04:28:20.213509] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.739 [2024-05-14 04:28:20.213517] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.739 [2024-05-14 04:28:20.213525] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.739 [2024-05-14 04:28:20.215805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.739 [2024-05-14 04:28:20.224512] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.739 [2024-05-14 04:28:20.224995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.225314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.225326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.739 [2024-05-14 04:28:20.225335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.739 [2024-05-14 04:28:20.225496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.739 [2024-05-14 04:28:20.225657] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.739 [2024-05-14 04:28:20.225665] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.739 [2024-05-14 04:28:20.225672] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.739 [2024-05-14 04:28:20.227999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.739 [2024-05-14 04:28:20.237032] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.739 [2024-05-14 04:28:20.237606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.238102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.238115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.739 [2024-05-14 04:28:20.238125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.739 [2024-05-14 04:28:20.238268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.739 [2024-05-14 04:28:20.238418] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.739 [2024-05-14 04:28:20.238427] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.739 [2024-05-14 04:28:20.238435] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.739 [2024-05-14 04:28:20.240658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.739 [2024-05-14 04:28:20.249313] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.739 [2024-05-14 04:28:20.250145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.250653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.250668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.739 [2024-05-14 04:28:20.250677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.739 [2024-05-14 04:28:20.250821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.739 [2024-05-14 04:28:20.250930] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.739 [2024-05-14 04:28:20.250938] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.739 [2024-05-14 04:28:20.250946] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.739 [2024-05-14 04:28:20.253281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.739 [2024-05-14 04:28:20.261751] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.739 [2024-05-14 04:28:20.262394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.262968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.262981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.739 [2024-05-14 04:28:20.262990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.739 [2024-05-14 04:28:20.263116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.739 [2024-05-14 04:28:20.263206] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.739 [2024-05-14 04:28:20.263215] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.739 [2024-05-14 04:28:20.263223] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.739 [2024-05-14 04:28:20.265526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.739 [2024-05-14 04:28:20.274356] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.739 [2024-05-14 04:28:20.274974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.275546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.275583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.739 [2024-05-14 04:28:20.275593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.739 [2024-05-14 04:28:20.275773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.739 [2024-05-14 04:28:20.275883] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.739 [2024-05-14 04:28:20.275891] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.739 [2024-05-14 04:28:20.275898] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.739 [2024-05-14 04:28:20.278198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.739 [2024-05-14 04:28:20.286994] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.739 [2024-05-14 04:28:20.287735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.288225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.288237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.739 [2024-05-14 04:28:20.288246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.739 [2024-05-14 04:28:20.288416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.739 [2024-05-14 04:28:20.288617] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.739 [2024-05-14 04:28:20.288625] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.739 [2024-05-14 04:28:20.288633] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.739 [2024-05-14 04:28:20.290948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.739 [2024-05-14 04:28:20.299443] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.739 [2024-05-14 04:28:20.300188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.300727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.300746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.739 [2024-05-14 04:28:20.300756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.739 [2024-05-14 04:28:20.300901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.739 [2024-05-14 04:28:20.301047] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.739 [2024-05-14 04:28:20.301055] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.739 [2024-05-14 04:28:20.301062] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.739 [2024-05-14 04:28:20.303197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:05.739 [2024-05-14 04:28:20.311816] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:05.739 [2024-05-14 04:28:20.312432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.312943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:05.739 [2024-05-14 04:28:20.312953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:05.739 [2024-05-14 04:28:20.312960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:05.739 [2024-05-14 04:28:20.313121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:05.739 [2024-05-14 04:28:20.313304] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:05.739 [2024-05-14 04:28:20.313312] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:05.739 [2024-05-14 04:28:20.313319] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:05.739 [2024-05-14 04:28:20.315593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.003 [2024-05-14 04:28:20.324083] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.003 [2024-05-14 04:28:20.324796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.325288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.325309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.003 [2024-05-14 04:28:20.325319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.003 [2024-05-14 04:28:20.325443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.003 [2024-05-14 04:28:20.325570] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.003 [2024-05-14 04:28:20.325578] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.003 [2024-05-14 04:28:20.325586] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.003 [2024-05-14 04:28:20.327793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.003 [2024-05-14 04:28:20.336608] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.003 [2024-05-14 04:28:20.337230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.337810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.337847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.003 [2024-05-14 04:28:20.337862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.003 [2024-05-14 04:28:20.337988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.003 [2024-05-14 04:28:20.338115] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.003 [2024-05-14 04:28:20.338124] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.003 [2024-05-14 04:28:20.338131] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.003 [2024-05-14 04:28:20.340193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.003 [2024-05-14 04:28:20.348802] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.003 [2024-05-14 04:28:20.349518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.349912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.349925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.003 [2024-05-14 04:28:20.349934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.003 [2024-05-14 04:28:20.350059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.003 [2024-05-14 04:28:20.350204] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.003 [2024-05-14 04:28:20.350212] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.003 [2024-05-14 04:28:20.350219] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.003 [2024-05-14 04:28:20.352376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.003 [2024-05-14 04:28:20.361400] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.003 [2024-05-14 04:28:20.361941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.362303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.362314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.003 [2024-05-14 04:28:20.362321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.003 [2024-05-14 04:28:20.362464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.003 [2024-05-14 04:28:20.362606] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.003 [2024-05-14 04:28:20.362614] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.003 [2024-05-14 04:28:20.362620] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.003 [2024-05-14 04:28:20.364874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.003 [2024-05-14 04:28:20.373707] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.003 [2024-05-14 04:28:20.374515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.374927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.374939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.003 [2024-05-14 04:28:20.374948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.003 [2024-05-14 04:28:20.375096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.003 [2024-05-14 04:28:20.375224] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.003 [2024-05-14 04:28:20.375232] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.003 [2024-05-14 04:28:20.375239] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.003 [2024-05-14 04:28:20.377509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.003 [2024-05-14 04:28:20.386334] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.003 [2024-05-14 04:28:20.387125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.387704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.003 [2024-05-14 04:28:20.387741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.003 [2024-05-14 04:28:20.387751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.003 [2024-05-14 04:28:20.387913] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.003 [2024-05-14 04:28:20.388058] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.003 [2024-05-14 04:28:20.388067] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.003 [2024-05-14 04:28:20.388074] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.003 [2024-05-14 04:28:20.390324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.004 [2024-05-14 04:28:20.398898] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.004 [2024-05-14 04:28:20.399648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.400144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.400156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.004 [2024-05-14 04:28:20.400165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.004 [2024-05-14 04:28:20.400354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.004 [2024-05-14 04:28:20.400555] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.004 [2024-05-14 04:28:20.400563] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.004 [2024-05-14 04:28:20.400570] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.004 [2024-05-14 04:28:20.402867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.004 [2024-05-14 04:28:20.411274] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.004 [2024-05-14 04:28:20.412066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.412679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.412716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.004 [2024-05-14 04:28:20.412726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.004 [2024-05-14 04:28:20.412887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.004 [2024-05-14 04:28:20.413038] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.004 [2024-05-14 04:28:20.413046] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.004 [2024-05-14 04:28:20.413053] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.004 [2024-05-14 04:28:20.415394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.004 [2024-05-14 04:28:20.423902] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.004 [2024-05-14 04:28:20.424621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.425116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.425129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.004 [2024-05-14 04:28:20.425138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.004 [2024-05-14 04:28:20.425344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.004 [2024-05-14 04:28:20.425491] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.004 [2024-05-14 04:28:20.425499] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.004 [2024-05-14 04:28:20.425506] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.004 [2024-05-14 04:28:20.427550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.004 [2024-05-14 04:28:20.436388] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.004 [2024-05-14 04:28:20.437122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.437787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.437824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.004 [2024-05-14 04:28:20.437834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.004 [2024-05-14 04:28:20.437996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.004 [2024-05-14 04:28:20.438141] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.004 [2024-05-14 04:28:20.438150] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.004 [2024-05-14 04:28:20.438157] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.004 [2024-05-14 04:28:20.440424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.004 [2024-05-14 04:28:20.448677] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.004 [2024-05-14 04:28:20.449500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.449988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.450001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.004 [2024-05-14 04:28:20.450010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.004 [2024-05-14 04:28:20.450191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.004 [2024-05-14 04:28:20.450360] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.004 [2024-05-14 04:28:20.450376] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.004 [2024-05-14 04:28:20.450384] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.004 [2024-05-14 04:28:20.452716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.004 [2024-05-14 04:28:20.461045] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.004 [2024-05-14 04:28:20.461665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.462128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.462138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.004 [2024-05-14 04:28:20.462145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.004 [2024-05-14 04:28:20.462234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.004 [2024-05-14 04:28:20.462360] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.004 [2024-05-14 04:28:20.462368] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.004 [2024-05-14 04:28:20.462375] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.004 [2024-05-14 04:28:20.464577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.004 [2024-05-14 04:28:20.473465] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.004 [2024-05-14 04:28:20.474135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.474697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.474734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.004 [2024-05-14 04:28:20.474744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.004 [2024-05-14 04:28:20.474925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.004 [2024-05-14 04:28:20.475071] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.004 [2024-05-14 04:28:20.475079] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.004 [2024-05-14 04:28:20.475086] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.004 [2024-05-14 04:28:20.477501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.004 [2024-05-14 04:28:20.485729] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.004 [2024-05-14 04:28:20.486515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.486917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.004 [2024-05-14 04:28:20.486929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.004 [2024-05-14 04:28:20.486939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.004 [2024-05-14 04:28:20.487026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.004 [2024-05-14 04:28:20.487208] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.004 [2024-05-14 04:28:20.487217] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.004 [2024-05-14 04:28:20.487229] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.004 [2024-05-14 04:28:20.489256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.004 [2024-05-14 04:28:20.498313] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.004 [2024-05-14 04:28:20.499025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.499286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.499314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.005 [2024-05-14 04:28:20.499324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.005 [2024-05-14 04:28:20.499540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.005 [2024-05-14 04:28:20.499742] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.005 [2024-05-14 04:28:20.499750] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.005 [2024-05-14 04:28:20.499757] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.005 [2024-05-14 04:28:20.501967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.005 [2024-05-14 04:28:20.510908] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.005 [2024-05-14 04:28:20.511610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.512013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.512025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.005 [2024-05-14 04:28:20.512034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.005 [2024-05-14 04:28:20.512196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.005 [2024-05-14 04:28:20.512352] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.005 [2024-05-14 04:28:20.512361] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.005 [2024-05-14 04:28:20.512369] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.005 [2024-05-14 04:28:20.514611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.005 [2024-05-14 04:28:20.523326] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.005 [2024-05-14 04:28:20.524064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.524609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.524623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.005 [2024-05-14 04:28:20.524633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.005 [2024-05-14 04:28:20.524813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.005 [2024-05-14 04:28:20.524923] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.005 [2024-05-14 04:28:20.524931] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.005 [2024-05-14 04:28:20.524939] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.005 [2024-05-14 04:28:20.527166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.005 [2024-05-14 04:28:20.535934] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.005 [2024-05-14 04:28:20.536626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.537119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.537132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.005 [2024-05-14 04:28:20.537141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.005 [2024-05-14 04:28:20.537352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.005 [2024-05-14 04:28:20.537498] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.005 [2024-05-14 04:28:20.537506] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.005 [2024-05-14 04:28:20.537513] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.005 [2024-05-14 04:28:20.539830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.005 [2024-05-14 04:28:20.548446] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.005 [2024-05-14 04:28:20.549079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.549570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.549585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.005 [2024-05-14 04:28:20.549595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.005 [2024-05-14 04:28:20.549756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.005 [2024-05-14 04:28:20.549883] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.005 [2024-05-14 04:28:20.549892] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.005 [2024-05-14 04:28:20.549899] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.005 [2024-05-14 04:28:20.552125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.005 [2024-05-14 04:28:20.560735] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.005 [2024-05-14 04:28:20.561358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.561831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.561840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.005 [2024-05-14 04:28:20.561848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.005 [2024-05-14 04:28:20.562009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.005 [2024-05-14 04:28:20.562170] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.005 [2024-05-14 04:28:20.562177] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.005 [2024-05-14 04:28:20.562184] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.005 [2024-05-14 04:28:20.564385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.005 [2024-05-14 04:28:20.573272] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.005 [2024-05-14 04:28:20.573899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.574393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.574407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.005 [2024-05-14 04:28:20.574416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.005 [2024-05-14 04:28:20.574596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.005 [2024-05-14 04:28:20.574741] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.005 [2024-05-14 04:28:20.574749] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.005 [2024-05-14 04:28:20.574757] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.005 [2024-05-14 04:28:20.576929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.005 [2024-05-14 04:28:20.585763] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.005 [2024-05-14 04:28:20.586565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.587144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.005 [2024-05-14 04:28:20.587156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.005 [2024-05-14 04:28:20.587165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.005 [2024-05-14 04:28:20.587354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.005 [2024-05-14 04:28:20.587500] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.005 [2024-05-14 04:28:20.587508] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.005 [2024-05-14 04:28:20.587515] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.271 [2024-05-14 04:28:20.589685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.271 [2024-05-14 04:28:20.598078] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.271 [2024-05-14 04:28:20.598776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.271 [2024-05-14 04:28:20.599270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.271 [2024-05-14 04:28:20.599282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.271 [2024-05-14 04:28:20.599298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.271 [2024-05-14 04:28:20.599461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.271 [2024-05-14 04:28:20.599643] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.271 [2024-05-14 04:28:20.599651] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.271 [2024-05-14 04:28:20.599659] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.271 [2024-05-14 04:28:20.601848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.271 [2024-05-14 04:28:20.610438] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.271 [2024-05-14 04:28:20.611079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.271 [2024-05-14 04:28:20.611579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.271 [2024-05-14 04:28:20.611594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.271 [2024-05-14 04:28:20.611603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.271 [2024-05-14 04:28:20.611746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.271 [2024-05-14 04:28:20.611873] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.271 [2024-05-14 04:28:20.611882] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.271 [2024-05-14 04:28:20.611889] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.271 [2024-05-14 04:28:20.614188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.271 [2024-05-14 04:28:20.622893] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.623536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.624026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.624038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.624048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.624190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.624343] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.272 [2024-05-14 04:28:20.624352] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.272 [2024-05-14 04:28:20.624360] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.272 [2024-05-14 04:28:20.626509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.272 [2024-05-14 04:28:20.635356] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.636063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.636571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.636585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.636594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.636755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.636919] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.272 [2024-05-14 04:28:20.636927] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.272 [2024-05-14 04:28:20.636935] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.272 [2024-05-14 04:28:20.639142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.272 [2024-05-14 04:28:20.647639] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.648371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.648910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.648927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.648936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.649116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.649225] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.272 [2024-05-14 04:28:20.649233] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.272 [2024-05-14 04:28:20.649240] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.272 [2024-05-14 04:28:20.651369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.272 [2024-05-14 04:28:20.660151] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.660898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.661389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.661402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.661411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.661554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.661700] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.272 [2024-05-14 04:28:20.661708] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.272 [2024-05-14 04:28:20.661715] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.272 [2024-05-14 04:28:20.664103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.272 [2024-05-14 04:28:20.672585] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.673283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.673835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.673848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.673857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.674056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.674238] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.272 [2024-05-14 04:28:20.674246] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.272 [2024-05-14 04:28:20.674253] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.272 [2024-05-14 04:28:20.676351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.272 [2024-05-14 04:28:20.684858] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.685572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.686071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.686084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.686098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.686241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.686396] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.272 [2024-05-14 04:28:20.686405] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.272 [2024-05-14 04:28:20.686412] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.272 [2024-05-14 04:28:20.688852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.272 [2024-05-14 04:28:20.697368] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.698038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.698515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.698528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.698538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.698662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.698808] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.272 [2024-05-14 04:28:20.698816] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.272 [2024-05-14 04:28:20.698824] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.272 [2024-05-14 04:28:20.701067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.272 [2024-05-14 04:28:20.710079] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.710811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.711338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.711351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.711361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.711541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.711723] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.272 [2024-05-14 04:28:20.711731] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.272 [2024-05-14 04:28:20.711738] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.272 [2024-05-14 04:28:20.714017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.272 [2024-05-14 04:28:20.722354] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.722984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.723238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.723255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.723263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.723402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.723564] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.272 [2024-05-14 04:28:20.723572] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.272 [2024-05-14 04:28:20.723579] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.272 [2024-05-14 04:28:20.725728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.272 [2024-05-14 04:28:20.734819] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.272 [2024-05-14 04:28:20.735528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.735879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.272 [2024-05-14 04:28:20.735891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.272 [2024-05-14 04:28:20.735901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.272 [2024-05-14 04:28:20.736044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.272 [2024-05-14 04:28:20.736189] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.736197] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.736204] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.738454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.273 [2024-05-14 04:28:20.747299] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.273 [2024-05-14 04:28:20.748045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.748526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.748540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.273 [2024-05-14 04:28:20.748549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.273 [2024-05-14 04:28:20.748729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.273 [2024-05-14 04:28:20.748838] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.748846] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.748853] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.750992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.273 [2024-05-14 04:28:20.759878] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.273 [2024-05-14 04:28:20.760626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.761123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.761135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.273 [2024-05-14 04:28:20.761145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.273 [2024-05-14 04:28:20.761351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.273 [2024-05-14 04:28:20.761508] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.761517] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.761524] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.763638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.273 [2024-05-14 04:28:20.772444] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.273 [2024-05-14 04:28:20.773169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.773657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.773670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.273 [2024-05-14 04:28:20.773680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.273 [2024-05-14 04:28:20.773823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.273 [2024-05-14 04:28:20.773968] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.773976] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.773983] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.776228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.273 [2024-05-14 04:28:20.785005] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.273 [2024-05-14 04:28:20.785569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.786060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.786069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.273 [2024-05-14 04:28:20.786077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.273 [2024-05-14 04:28:20.786237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.273 [2024-05-14 04:28:20.786383] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.786391] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.786398] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.788651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.273 [2024-05-14 04:28:20.797604] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.273 [2024-05-14 04:28:20.798351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.798843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.798856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.273 [2024-05-14 04:28:20.798865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.273 [2024-05-14 04:28:20.799045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.273 [2024-05-14 04:28:20.799190] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.799202] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.799210] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.801498] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.273 [2024-05-14 04:28:20.810076] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.273 [2024-05-14 04:28:20.810803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.811303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.811316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.273 [2024-05-14 04:28:20.811326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.273 [2024-05-14 04:28:20.811505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.273 [2024-05-14 04:28:20.811651] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.811659] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.811666] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.814038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.273 [2024-05-14 04:28:20.822548] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.273 [2024-05-14 04:28:20.823256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.823823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.823837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.273 [2024-05-14 04:28:20.823846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.273 [2024-05-14 04:28:20.823990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.273 [2024-05-14 04:28:20.824098] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.824106] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.824113] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.826491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.273 [2024-05-14 04:28:20.834900] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.273 [2024-05-14 04:28:20.835659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.836239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.836251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.273 [2024-05-14 04:28:20.836261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.273 [2024-05-14 04:28:20.836449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.273 [2024-05-14 04:28:20.836576] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.836584] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.836596] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.838931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.273 [2024-05-14 04:28:20.847214] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.273 [2024-05-14 04:28:20.847869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.848528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.273 [2024-05-14 04:28:20.848565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.273 [2024-05-14 04:28:20.848575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.273 [2024-05-14 04:28:20.848737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.273 [2024-05-14 04:28:20.848901] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.273 [2024-05-14 04:28:20.848909] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.273 [2024-05-14 04:28:20.848917] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.273 [2024-05-14 04:28:20.851098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.590 [2024-05-14 04:28:20.859852] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.590 [2024-05-14 04:28:20.860479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.860965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.860978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.590 [2024-05-14 04:28:20.860987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.590 [2024-05-14 04:28:20.861112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.590 [2024-05-14 04:28:20.861257] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.590 [2024-05-14 04:28:20.861265] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.590 [2024-05-14 04:28:20.861273] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.590 [2024-05-14 04:28:20.863474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.590 [2024-05-14 04:28:20.872384] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.590 [2024-05-14 04:28:20.872985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.873486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.873523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.590 [2024-05-14 04:28:20.873534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.590 [2024-05-14 04:28:20.873677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.590 [2024-05-14 04:28:20.873823] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.590 [2024-05-14 04:28:20.873831] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.590 [2024-05-14 04:28:20.873839] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.590 [2024-05-14 04:28:20.876203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.590 [2024-05-14 04:28:20.884857] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.590 [2024-05-14 04:28:20.885522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.886076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.886089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.590 [2024-05-14 04:28:20.886098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.590 [2024-05-14 04:28:20.886259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.590 [2024-05-14 04:28:20.886429] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.590 [2024-05-14 04:28:20.886438] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.590 [2024-05-14 04:28:20.886445] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.590 [2024-05-14 04:28:20.888742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.590 [2024-05-14 04:28:20.897213] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.590 [2024-05-14 04:28:20.897928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.898502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.898539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.590 [2024-05-14 04:28:20.898551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.590 [2024-05-14 04:28:20.898716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.590 [2024-05-14 04:28:20.898880] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.590 [2024-05-14 04:28:20.898888] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.590 [2024-05-14 04:28:20.898896] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.590 [2024-05-14 04:28:20.901216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.590 [2024-05-14 04:28:20.909621] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.590 [2024-05-14 04:28:20.910272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.910784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.910794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.590 [2024-05-14 04:28:20.910802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.590 [2024-05-14 04:28:20.910926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.590 [2024-05-14 04:28:20.911086] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.590 [2024-05-14 04:28:20.911094] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.590 [2024-05-14 04:28:20.911101] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.590 [2024-05-14 04:28:20.913398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.590 [2024-05-14 04:28:20.922082] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.590 [2024-05-14 04:28:20.922723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.923124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.590 [2024-05-14 04:28:20.923137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.590 [2024-05-14 04:28:20.923146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.590 [2024-05-14 04:28:20.923233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.590 [2024-05-14 04:28:20.923350] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.590 [2024-05-14 04:28:20.923359] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.590 [2024-05-14 04:28:20.923366] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.590 [2024-05-14 04:28:20.925463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.590 [2024-05-14 04:28:20.934659] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.590 [2024-05-14 04:28:20.935365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.935915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.935928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:20.935937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:20.936136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:20.936327] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.591 [2024-05-14 04:28:20.936336] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.591 [2024-05-14 04:28:20.936344] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.591 [2024-05-14 04:28:20.938607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.591 [2024-05-14 04:28:20.947021] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.591 [2024-05-14 04:28:20.947649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.948140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.948152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:20.948161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:20.948330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:20.948513] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.591 [2024-05-14 04:28:20.948521] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.591 [2024-05-14 04:28:20.948528] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.591 [2024-05-14 04:28:20.950808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.591 [2024-05-14 04:28:20.959748] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.591 [2024-05-14 04:28:20.960458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.960949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.960961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:20.960970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:20.961095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:20.961222] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.591 [2024-05-14 04:28:20.961230] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.591 [2024-05-14 04:28:20.961237] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.591 [2024-05-14 04:28:20.963471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.591 [2024-05-14 04:28:20.972087] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.591 [2024-05-14 04:28:20.972826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.973477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.973514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:20.973525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:20.973672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:20.973817] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.591 [2024-05-14 04:28:20.973825] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.591 [2024-05-14 04:28:20.973833] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.591 [2024-05-14 04:28:20.976026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.591 [2024-05-14 04:28:20.984381] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.591 [2024-05-14 04:28:20.984996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.985590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.985626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:20.985637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:20.985817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:20.985962] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.591 [2024-05-14 04:28:20.985971] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.591 [2024-05-14 04:28:20.985978] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.591 [2024-05-14 04:28:20.988354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.591 [2024-05-14 04:28:20.996900] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.591 [2024-05-14 04:28:20.997604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.998092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:20.998105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:20.998114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:20.998258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:20.998394] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.591 [2024-05-14 04:28:20.998403] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.591 [2024-05-14 04:28:20.998411] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.591 [2024-05-14 04:28:21.000761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.591 [2024-05-14 04:28:21.009338] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.591 [2024-05-14 04:28:21.010043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:21.010617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:21.010653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:21.010664] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:21.010825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:21.010971] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.591 [2024-05-14 04:28:21.010979] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.591 [2024-05-14 04:28:21.010987] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.591 [2024-05-14 04:28:21.013331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.591 [2024-05-14 04:28:21.021830] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.591 [2024-05-14 04:28:21.022590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:21.023120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:21.023132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:21.023141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:21.023310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:21.023457] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.591 [2024-05-14 04:28:21.023465] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.591 [2024-05-14 04:28:21.023472] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.591 [2024-05-14 04:28:21.025571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.591 [2024-05-14 04:28:21.034430] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.591 [2024-05-14 04:28:21.035153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:21.035435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:21.035455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:21.035472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:21.035635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:21.035763] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.591 [2024-05-14 04:28:21.035772] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.591 [2024-05-14 04:28:21.035779] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.591 [2024-05-14 04:28:21.038064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.591 [2024-05-14 04:28:21.047039] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.591 [2024-05-14 04:28:21.047672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:21.048161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.591 [2024-05-14 04:28:21.048174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.591 [2024-05-14 04:28:21.048183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.591 [2024-05-14 04:28:21.048316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.591 [2024-05-14 04:28:21.048480] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.048488] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.048496] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.050828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.059648] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.592 [2024-05-14 04:28:21.060385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.060902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.060914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.592 [2024-05-14 04:28:21.060924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.592 [2024-05-14 04:28:21.061067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.592 [2024-05-14 04:28:21.061194] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.061202] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.061210] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.063442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.072243] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.592 [2024-05-14 04:28:21.072978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.073563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.073577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.592 [2024-05-14 04:28:21.073586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.592 [2024-05-14 04:28:21.073734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.592 [2024-05-14 04:28:21.073861] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.073869] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.073876] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.076083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.084755] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.592 [2024-05-14 04:28:21.085531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.086026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.086038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.592 [2024-05-14 04:28:21.086048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.592 [2024-05-14 04:28:21.086264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.592 [2024-05-14 04:28:21.086400] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.086409] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.086417] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.088712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.097425] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.592 [2024-05-14 04:28:21.098113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.098520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.098534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.592 [2024-05-14 04:28:21.098544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.592 [2024-05-14 04:28:21.098705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.592 [2024-05-14 04:28:21.098832] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.098840] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.098848] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.101095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.109916] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.592 [2024-05-14 04:28:21.110421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.110943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.110953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.592 [2024-05-14 04:28:21.110961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.592 [2024-05-14 04:28:21.111103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.592 [2024-05-14 04:28:21.111268] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.111276] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.111283] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.113851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.122301] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.592 [2024-05-14 04:28:21.122903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.123364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.123374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.592 [2024-05-14 04:28:21.123382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.592 [2024-05-14 04:28:21.123505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.592 [2024-05-14 04:28:21.123647] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.123654] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.123661] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.126023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.134845] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.592 [2024-05-14 04:28:21.135458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.135919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.135929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.592 [2024-05-14 04:28:21.135936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.592 [2024-05-14 04:28:21.136078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.592 [2024-05-14 04:28:21.136184] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.136191] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.136198] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.138633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.147035] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.592 [2024-05-14 04:28:21.147645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.148109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.148118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.592 [2024-05-14 04:28:21.148125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.592 [2024-05-14 04:28:21.148285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.592 [2024-05-14 04:28:21.148433] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.148445] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.148451] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.150729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.159484] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.592 [2024-05-14 04:28:21.160102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.160563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.592 [2024-05-14 04:28:21.160574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.592 [2024-05-14 04:28:21.160581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.592 [2024-05-14 04:28:21.160705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.592 [2024-05-14 04:28:21.160883] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.592 [2024-05-14 04:28:21.160890] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.592 [2024-05-14 04:28:21.160897] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.592 [2024-05-14 04:28:21.163227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.592 [2024-05-14 04:28:21.172080] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.172759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.173227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.173237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.173245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.173409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.173533] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.173541] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.173547] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.175748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.184556] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.185169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.185812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.185849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.185859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.186021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.186203] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.186212] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.186224] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.188568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.197246] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.197982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.198509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.198524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.198534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.198677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.198805] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.198814] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.198821] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.201155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.209754] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.210489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.211009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.211022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.211031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.211212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.211384] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.211393] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.211400] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.213660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.222127] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.222925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.223455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.223469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.223478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.223639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.223821] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.223830] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.223837] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.226054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.234372] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.234994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.235375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.235385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.235393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.235572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.235750] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.235758] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.235765] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.238058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.246973] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.247638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.248009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.248019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.248026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.248132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.248316] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.248324] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.248331] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.250642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.259246] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.259906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.260442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.260453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.260460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.260567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.260728] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.260736] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.260743] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.262871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.271771] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.272401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.272934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.272946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.272956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.273080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.273225] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.273234] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.273242] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.275580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.284261] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.856 [2024-05-14 04:28:21.284875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.285375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.856 [2024-05-14 04:28:21.285386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.856 [2024-05-14 04:28:21.285396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.856 [2024-05-14 04:28:21.285540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.856 [2024-05-14 04:28:21.285700] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.856 [2024-05-14 04:28:21.285708] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.856 [2024-05-14 04:28:21.285715] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.856 [2024-05-14 04:28:21.287952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.856 [2024-05-14 04:28:21.296769] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.297457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.297957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.297970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.297979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.298159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.298312] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.298321] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.298328] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.300641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.309374] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.310027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.310492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.310502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.310509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.310616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.310722] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.310729] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.310736] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.312792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.321841] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.322464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.322934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.322944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.322952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.323057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.323236] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.323243] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.323250] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.325159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.334180] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.334780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.335295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.335305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.335313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.335455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.335579] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.335587] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.335593] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.337773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.346524] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.347133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.347616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.347627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.347634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.347777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.347919] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.347927] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.347934] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.350224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.359040] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.359640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.360111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.360121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.360128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.360252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.360399] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.360407] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.360414] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.362401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.371534] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.372151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.372625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.372636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.372643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.372822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.372964] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.372972] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.372979] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.375237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.384249] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.384949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.385418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.385435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.385446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.385552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.385693] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.385701] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.385707] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.387949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.396772] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.397420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.397900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.397909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.397917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.398040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.398182] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.398189] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.398196] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.400330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.409399] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.410099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.410602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.410616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.410625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.410786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.410913] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.410921] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.410928] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.413051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.421860] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.422595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.423085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.423098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.423107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.423316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.423463] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.423471] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.423478] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.425755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:06.857 [2024-05-14 04:28:21.434521] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:06.857 [2024-05-14 04:28:21.435197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.435677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:06.857 [2024-05-14 04:28:21.435688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:06.857 [2024-05-14 04:28:21.435696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:06.857 [2024-05-14 04:28:21.435820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:06.857 [2024-05-14 04:28:21.435981] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:06.857 [2024-05-14 04:28:21.435988] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:06.857 [2024-05-14 04:28:21.435995] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:06.857 [2024-05-14 04:28:21.438399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.121 [2024-05-14 04:28:21.447207] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.121 [2024-05-14 04:28:21.447918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.448406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.448421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.121 [2024-05-14 04:28:21.448430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.121 [2024-05-14 04:28:21.448629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.121 [2024-05-14 04:28:21.448756] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.121 [2024-05-14 04:28:21.448765] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.121 [2024-05-14 04:28:21.448774] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.121 [2024-05-14 04:28:21.450820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.121 [2024-05-14 04:28:21.459589] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.121 [2024-05-14 04:28:21.460254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.460635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.460647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.121 [2024-05-14 04:28:21.460655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.121 [2024-05-14 04:28:21.460816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.121 [2024-05-14 04:28:21.460981] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.121 [2024-05-14 04:28:21.460989] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.121 [2024-05-14 04:28:21.460996] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.121 [2024-05-14 04:28:21.463328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.121 [2024-05-14 04:28:21.472167] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.121 [2024-05-14 04:28:21.472861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.473206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.473216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.121 [2024-05-14 04:28:21.473223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.121 [2024-05-14 04:28:21.473352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.121 [2024-05-14 04:28:21.473495] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.121 [2024-05-14 04:28:21.473503] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.121 [2024-05-14 04:28:21.473509] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.121 [2024-05-14 04:28:21.475731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.121 [2024-05-14 04:28:21.484421] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.121 [2024-05-14 04:28:21.485042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.485540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.485551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.121 [2024-05-14 04:28:21.485558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.121 [2024-05-14 04:28:21.485719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.121 [2024-05-14 04:28:21.485843] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.121 [2024-05-14 04:28:21.485850] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.121 [2024-05-14 04:28:21.485857] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.121 [2024-05-14 04:28:21.488076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.121 [2024-05-14 04:28:21.496836] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.121 [2024-05-14 04:28:21.497503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.497884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.497894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.121 [2024-05-14 04:28:21.497901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.121 [2024-05-14 04:28:21.498025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.121 [2024-05-14 04:28:21.498170] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.121 [2024-05-14 04:28:21.498178] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.121 [2024-05-14 04:28:21.498185] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.121 [2024-05-14 04:28:21.500731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.121 [2024-05-14 04:28:21.509346] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.121 [2024-05-14 04:28:21.509966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.510359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.510369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.121 [2024-05-14 04:28:21.510376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.121 [2024-05-14 04:28:21.510536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.121 [2024-05-14 04:28:21.510678] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.121 [2024-05-14 04:28:21.510686] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.121 [2024-05-14 04:28:21.510692] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.121 [2024-05-14 04:28:21.512948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.121 [2024-05-14 04:28:21.521818] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.121 [2024-05-14 04:28:21.522554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.523053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.523066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.121 [2024-05-14 04:28:21.523075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.121 [2024-05-14 04:28:21.523236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.121 [2024-05-14 04:28:21.523389] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.121 [2024-05-14 04:28:21.523398] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.121 [2024-05-14 04:28:21.523405] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.121 [2024-05-14 04:28:21.525646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.121 [2024-05-14 04:28:21.534368] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.121 [2024-05-14 04:28:21.535012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.535475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.535487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.121 [2024-05-14 04:28:21.535495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.121 [2024-05-14 04:28:21.535637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.121 [2024-05-14 04:28:21.535834] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.121 [2024-05-14 04:28:21.535842] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.121 [2024-05-14 04:28:21.535854] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.121 [2024-05-14 04:28:21.537985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.121 [2024-05-14 04:28:21.546803] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.121 [2024-05-14 04:28:21.547308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.547775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.121 [2024-05-14 04:28:21.547784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.121 [2024-05-14 04:28:21.547792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.121 [2024-05-14 04:28:21.547898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.121 [2024-05-14 04:28:21.548041] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.121 [2024-05-14 04:28:21.548048] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.121 [2024-05-14 04:28:21.548055] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.550347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.559381] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.559952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.560417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.560428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.560435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.122 [2024-05-14 04:28:21.560595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.122 [2024-05-14 04:28:21.560773] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.122 [2024-05-14 04:28:21.560780] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.122 [2024-05-14 04:28:21.560788] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.563005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.571758] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.572397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.572911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.572924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.572933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.122 [2024-05-14 04:28:21.573076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.122 [2024-05-14 04:28:21.573203] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.122 [2024-05-14 04:28:21.573211] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.122 [2024-05-14 04:28:21.573222] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.575183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.584384] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.584840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.585316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.585330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.585342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.122 [2024-05-14 04:28:21.585470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.122 [2024-05-14 04:28:21.585613] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.122 [2024-05-14 04:28:21.585621] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.122 [2024-05-14 04:28:21.585628] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.587829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.596952] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.597609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.598095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.598108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.598117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.122 [2024-05-14 04:28:21.598279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.122 [2024-05-14 04:28:21.598431] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.122 [2024-05-14 04:28:21.598439] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.122 [2024-05-14 04:28:21.598447] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.600743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.609483] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.610169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.610571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.610585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.610595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.122 [2024-05-14 04:28:21.610775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.122 [2024-05-14 04:28:21.610957] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.122 [2024-05-14 04:28:21.610965] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.122 [2024-05-14 04:28:21.610972] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.613313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.621888] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.622564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.623075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.623084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.623092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.122 [2024-05-14 04:28:21.623217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.122 [2024-05-14 04:28:21.623344] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.122 [2024-05-14 04:28:21.623353] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.122 [2024-05-14 04:28:21.623360] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.625648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.634379] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.634996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.635501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.635537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.635548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.122 [2024-05-14 04:28:21.635691] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.122 [2024-05-14 04:28:21.635837] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.122 [2024-05-14 04:28:21.635846] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.122 [2024-05-14 04:28:21.635853] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.638050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.646982] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.647617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.648082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.648091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.648099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.122 [2024-05-14 04:28:21.648260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.122 [2024-05-14 04:28:21.648412] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.122 [2024-05-14 04:28:21.648420] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.122 [2024-05-14 04:28:21.648427] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.650391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.659557] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.660063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.660512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.660528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.660538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.122 [2024-05-14 04:28:21.660682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.122 [2024-05-14 04:28:21.660791] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.122 [2024-05-14 04:28:21.660799] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.122 [2024-05-14 04:28:21.660806] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.122 [2024-05-14 04:28:21.662998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.122 [2024-05-14 04:28:21.672193] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.122 [2024-05-14 04:28:21.672822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.673286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.122 [2024-05-14 04:28:21.673301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.122 [2024-05-14 04:28:21.673309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.123 [2024-05-14 04:28:21.673415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.123 [2024-05-14 04:28:21.673558] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.123 [2024-05-14 04:28:21.673565] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.123 [2024-05-14 04:28:21.673572] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.123 [2024-05-14 04:28:21.675917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.123 [2024-05-14 04:28:21.684524] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.123 [2024-05-14 04:28:21.685139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.123 [2024-05-14 04:28:21.685736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.123 [2024-05-14 04:28:21.685773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.123 [2024-05-14 04:28:21.685783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.123 [2024-05-14 04:28:21.685945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.123 [2024-05-14 04:28:21.686108] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.123 [2024-05-14 04:28:21.686117] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.123 [2024-05-14 04:28:21.686125] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.123 [2024-05-14 04:28:21.688520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.123 [2024-05-14 04:28:21.697093] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.123 [2024-05-14 04:28:21.697851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.123 [2024-05-14 04:28:21.698455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.123 [2024-05-14 04:28:21.698492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.123 [2024-05-14 04:28:21.698503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.123 [2024-05-14 04:28:21.698683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.123 [2024-05-14 04:28:21.698829] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.123 [2024-05-14 04:28:21.698837] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.123 [2024-05-14 04:28:21.698845] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.123 [2024-05-14 04:28:21.700933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.386 [2024-05-14 04:28:21.709464] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.386 [2024-05-14 04:28:21.710076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.710648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.710686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.386 [2024-05-14 04:28:21.710696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.386 [2024-05-14 04:28:21.710822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.386 [2024-05-14 04:28:21.710968] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.386 [2024-05-14 04:28:21.710976] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.386 [2024-05-14 04:28:21.710984] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.386 [2024-05-14 04:28:21.713283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.386 [2024-05-14 04:28:21.721901] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.386 [2024-05-14 04:28:21.722501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.722989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.723001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.386 [2024-05-14 04:28:21.723010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.386 [2024-05-14 04:28:21.723191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.386 [2024-05-14 04:28:21.723380] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.386 [2024-05-14 04:28:21.723389] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.386 [2024-05-14 04:28:21.723396] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.386 [2024-05-14 04:28:21.725694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.386 [2024-05-14 04:28:21.734151] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.386 [2024-05-14 04:28:21.734669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.735166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.735176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.386 [2024-05-14 04:28:21.735188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.386 [2024-05-14 04:28:21.735318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.386 [2024-05-14 04:28:21.735480] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.386 [2024-05-14 04:28:21.735487] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.386 [2024-05-14 04:28:21.735494] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.386 [2024-05-14 04:28:21.737713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.386 [2024-05-14 04:28:21.746662] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.386 [2024-05-14 04:28:21.747392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.747687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.747706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.386 [2024-05-14 04:28:21.747716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.386 [2024-05-14 04:28:21.747841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.386 [2024-05-14 04:28:21.747969] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.386 [2024-05-14 04:28:21.747977] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.386 [2024-05-14 04:28:21.747984] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.386 [2024-05-14 04:28:21.750399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.386 [2024-05-14 04:28:21.759211] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.386 [2024-05-14 04:28:21.759891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.760265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.386 [2024-05-14 04:28:21.760275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.386 [2024-05-14 04:28:21.760282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.386 [2024-05-14 04:28:21.760429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.386 [2024-05-14 04:28:21.760590] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.386 [2024-05-14 04:28:21.760598] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.387 [2024-05-14 04:28:21.760605] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.387 [2024-05-14 04:28:21.762898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.387 [2024-05-14 04:28:21.771879] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.387 [2024-05-14 04:28:21.772670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.773158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.773170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.387 [2024-05-14 04:28:21.773179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.387 [2024-05-14 04:28:21.773315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.387 [2024-05-14 04:28:21.773443] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.387 [2024-05-14 04:28:21.773451] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.387 [2024-05-14 04:28:21.773458] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.387 [2024-05-14 04:28:21.775720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.387 [2024-05-14 04:28:21.784466] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.387 [2024-05-14 04:28:21.785091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.785657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.785694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.387 [2024-05-14 04:28:21.785705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.387 [2024-05-14 04:28:21.785884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.387 [2024-05-14 04:28:21.786012] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.387 [2024-05-14 04:28:21.786020] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.387 [2024-05-14 04:28:21.786028] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.387 [2024-05-14 04:28:21.788183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.387 [2024-05-14 04:28:21.797022] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.387 [2024-05-14 04:28:21.797730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.798225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.798237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.387 [2024-05-14 04:28:21.798246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.387 [2024-05-14 04:28:21.798451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.387 [2024-05-14 04:28:21.798597] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.387 [2024-05-14 04:28:21.798605] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.387 [2024-05-14 04:28:21.798613] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.387 [2024-05-14 04:28:21.800765] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.387 [2024-05-14 04:28:21.809373] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.387 [2024-05-14 04:28:21.810115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.810610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.810625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.387 [2024-05-14 04:28:21.810634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.387 [2024-05-14 04:28:21.810856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.387 [2024-05-14 04:28:21.811002] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.387 [2024-05-14 04:28:21.811015] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.387 [2024-05-14 04:28:21.811022] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.387 [2024-05-14 04:28:21.813194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.387 [2024-05-14 04:28:21.822014] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.387 [2024-05-14 04:28:21.822696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.823193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.823206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.387 [2024-05-14 04:28:21.823216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.387 [2024-05-14 04:28:21.823366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.387 [2024-05-14 04:28:21.823494] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.387 [2024-05-14 04:28:21.823502] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.387 [2024-05-14 04:28:21.823509] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.387 [2024-05-14 04:28:21.825697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.387 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 4142164 Killed "${NVMF_APP[@]}" "$@" 00:31:07.387 04:28:21 -- host/bdevperf.sh@36 -- # tgt_init 00:31:07.387 04:28:21 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:31:07.387 04:28:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:07.387 04:28:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:07.387 04:28:21 -- common/autotest_common.sh@10 -- # set +x 00:31:07.387 [2024-05-14 04:28:21.834470] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.387 [2024-05-14 04:28:21.835121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.835609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.835624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.387 [2024-05-14 04:28:21.835633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.387 [2024-05-14 04:28:21.835758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.387 [2024-05-14 04:28:21.835940] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.387 [2024-05-14 04:28:21.835949] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.387 [2024-05-14 04:28:21.835957] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.387 [2024-05-14 04:28:21.838315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.387 04:28:21 -- nvmf/common.sh@469 -- # nvmfpid=4143820 00:31:07.387 04:28:21 -- nvmf/common.sh@470 -- # waitforlisten 4143820 00:31:07.387 04:28:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:31:07.387 04:28:21 -- common/autotest_common.sh@819 -- # '[' -z 4143820 ']' 00:31:07.387 04:28:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:07.387 04:28:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:07.387 04:28:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:07.387 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:07.387 04:28:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:07.387 04:28:21 -- common/autotest_common.sh@10 -- # set +x 00:31:07.387 [2024-05-14 04:28:21.847142] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.387 [2024-05-14 04:28:21.847765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.848266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.848279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.387 [2024-05-14 04:28:21.848288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.387 [2024-05-14 04:28:21.848457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.387 [2024-05-14 04:28:21.848603] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.387 [2024-05-14 04:28:21.848613] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.387 [2024-05-14 04:28:21.848620] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.387 [2024-05-14 04:28:21.850975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.387 [2024-05-14 04:28:21.859361] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.387 [2024-05-14 04:28:21.860084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.860674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.860710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.387 [2024-05-14 04:28:21.860722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.387 [2024-05-14 04:28:21.860940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.387 [2024-05-14 04:28:21.861085] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.387 [2024-05-14 04:28:21.861094] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.387 [2024-05-14 04:28:21.861102] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.387 [2024-05-14 04:28:21.863444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.387 [2024-05-14 04:28:21.871848] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.387 [2024-05-14 04:28:21.872307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.872764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.387 [2024-05-14 04:28:21.872801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.388 [2024-05-14 04:28:21.872813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.388 [2024-05-14 04:28:21.872938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.388 [2024-05-14 04:28:21.873085] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.388 [2024-05-14 04:28:21.873093] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.388 [2024-05-14 04:28:21.873105] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.388 [2024-05-14 04:28:21.875415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.388 [2024-05-14 04:28:21.884273] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.388 [2024-05-14 04:28:21.884723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.885223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.885236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.388 [2024-05-14 04:28:21.885245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.388 [2024-05-14 04:28:21.885396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.388 [2024-05-14 04:28:21.885542] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.388 [2024-05-14 04:28:21.885550] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.388 [2024-05-14 04:28:21.885558] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.388 [2024-05-14 04:28:21.887872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.388 [2024-05-14 04:28:21.894088] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:31:07.388 [2024-05-14 04:28:21.894149] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:07.388 [2024-05-14 04:28:21.896709] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.388 [2024-05-14 04:28:21.897539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.898067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.898080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.388 [2024-05-14 04:28:21.898090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.388 [2024-05-14 04:28:21.898198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.388 [2024-05-14 04:28:21.898367] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.388 [2024-05-14 04:28:21.898375] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.388 [2024-05-14 04:28:21.898383] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.388 [2024-05-14 04:28:21.900665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.388 [2024-05-14 04:28:21.909238] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.388 [2024-05-14 04:28:21.909975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.910387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.910401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.388 [2024-05-14 04:28:21.910410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.388 [2024-05-14 04:28:21.910554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.388 [2024-05-14 04:28:21.910740] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.388 [2024-05-14 04:28:21.910749] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.388 [2024-05-14 04:28:21.910756] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.388 [2024-05-14 04:28:21.912912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.388 [2024-05-14 04:28:21.921796] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.388 [2024-05-14 04:28:21.922508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.922999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.923012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.388 [2024-05-14 04:28:21.923021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.388 [2024-05-14 04:28:21.923220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.388 [2024-05-14 04:28:21.923407] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.388 [2024-05-14 04:28:21.923415] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.388 [2024-05-14 04:28:21.923423] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.388 [2024-05-14 04:28:21.925647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.388 EAL: No free 2048 kB hugepages reported on node 1 00:31:07.388 [2024-05-14 04:28:21.934238] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.388 [2024-05-14 04:28:21.934868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.935517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.935555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.388 [2024-05-14 04:28:21.935565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.388 [2024-05-14 04:28:21.935763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.388 [2024-05-14 04:28:21.935909] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.388 [2024-05-14 04:28:21.935918] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.388 [2024-05-14 04:28:21.935926] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.388 [2024-05-14 04:28:21.938191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.388 [2024-05-14 04:28:21.946596] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.388 [2024-05-14 04:28:21.947250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.947809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.947846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.388 [2024-05-14 04:28:21.947857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.388 [2024-05-14 04:28:21.948019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.388 [2024-05-14 04:28:21.948201] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.388 [2024-05-14 04:28:21.948214] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.388 [2024-05-14 04:28:21.948221] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.388 [2024-05-14 04:28:21.950455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.388 [2024-05-14 04:28:21.958973] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.388 [2024-05-14 04:28:21.959727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.960230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.960243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.388 [2024-05-14 04:28:21.960252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.388 [2024-05-14 04:28:21.960457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.388 [2024-05-14 04:28:21.960585] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.388 [2024-05-14 04:28:21.960593] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.388 [2024-05-14 04:28:21.960600] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.388 [2024-05-14 04:28:21.962865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.388 [2024-05-14 04:28:21.971284] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.388 [2024-05-14 04:28:21.972049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.972364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.388 [2024-05-14 04:28:21.972384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.388 [2024-05-14 04:28:21.972394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.388 [2024-05-14 04:28:21.972574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.651 [2024-05-14 04:28:21.972683] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.651 [2024-05-14 04:28:21.972696] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.651 [2024-05-14 04:28:21.972703] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.651 [2024-05-14 04:28:21.974505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:31:07.651 [2024-05-14 04:28:21.974912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.651 [2024-05-14 04:28:21.983567] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.651 [2024-05-14 04:28:21.984225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.651 [2024-05-14 04:28:21.984608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.651 [2024-05-14 04:28:21.984645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.651 [2024-05-14 04:28:21.984658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.651 [2024-05-14 04:28:21.984805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.651 [2024-05-14 04:28:21.984932] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.651 [2024-05-14 04:28:21.984945] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.651 [2024-05-14 04:28:21.984954] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.651 [2024-05-14 04:28:21.987368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.651 [2024-05-14 04:28:21.995891] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.651 [2024-05-14 04:28:21.996652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.651 [2024-05-14 04:28:21.997146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.651 [2024-05-14 04:28:21.997159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.651 [2024-05-14 04:28:21.997168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.651 [2024-05-14 04:28:21.997320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.651 [2024-05-14 04:28:21.997466] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.651 [2024-05-14 04:28:21.997475] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.651 [2024-05-14 04:28:21.997482] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.651 [2024-05-14 04:28:21.999944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.651 [2024-05-14 04:28:22.008403] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.651 [2024-05-14 04:28:22.009153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.651 [2024-05-14 04:28:22.009662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.009676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.652 [2024-05-14 04:28:22.009686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.652 [2024-05-14 04:28:22.009885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.652 [2024-05-14 04:28:22.010049] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.652 [2024-05-14 04:28:22.010057] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.652 [2024-05-14 04:28:22.010064] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.652 [2024-05-14 04:28:22.012419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.652 [2024-05-14 04:28:22.021014] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.652 [2024-05-14 04:28:22.021681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.022099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.022109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.652 [2024-05-14 04:28:22.022117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.652 [2024-05-14 04:28:22.022260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.652 [2024-05-14 04:28:22.022405] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.652 [2024-05-14 04:28:22.022413] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.652 [2024-05-14 04:28:22.022426] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.652 [2024-05-14 04:28:22.024612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.652 [2024-05-14 04:28:22.027040] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:07.652 [2024-05-14 04:28:22.027122] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:07.652 [2024-05-14 04:28:22.027128] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:07.652 [2024-05-14 04:28:22.027133] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:07.652 [2024-05-14 04:28:22.027255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:07.652 [2024-05-14 04:28:22.027411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:07.652 [2024-05-14 04:28:22.027598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:07.652 [2024-05-14 04:28:22.033635] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.652 [2024-05-14 04:28:22.034392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.034898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.034911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.652 [2024-05-14 04:28:22.034921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.652 [2024-05-14 04:28:22.035066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.652 [2024-05-14 04:28:22.035230] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.652 [2024-05-14 04:28:22.035239] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.652 [2024-05-14 04:28:22.035246] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.652 [2024-05-14 04:28:22.037276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.652 [2024-05-14 04:28:22.045953] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.652 [2024-05-14 04:28:22.046780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.047278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.047295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.652 [2024-05-14 04:28:22.047305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.652 [2024-05-14 04:28:22.047505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.652 [2024-05-14 04:28:22.047688] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.652 [2024-05-14 04:28:22.047696] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.652 [2024-05-14 04:28:22.047704] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.652 [2024-05-14 04:28:22.049874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.652 [2024-05-14 04:28:22.058385] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.652 [2024-05-14 04:28:22.059145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.059665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.059680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.652 [2024-05-14 04:28:22.059695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.652 [2024-05-14 04:28:22.059875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.652 [2024-05-14 04:28:22.060020] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.652 [2024-05-14 04:28:22.060029] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.652 [2024-05-14 04:28:22.060036] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.652 [2024-05-14 04:28:22.062261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.652 [2024-05-14 04:28:22.071017] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.652 [2024-05-14 04:28:22.071799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.072304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.072317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.652 [2024-05-14 04:28:22.072327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.652 [2024-05-14 04:28:22.072488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.652 [2024-05-14 04:28:22.072634] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.652 [2024-05-14 04:28:22.072642] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.652 [2024-05-14 04:28:22.072650] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.652 [2024-05-14 04:28:22.074898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.652 [2024-05-14 04:28:22.083386] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.652 [2024-05-14 04:28:22.083898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.084398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.084413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.652 [2024-05-14 04:28:22.084423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.652 [2024-05-14 04:28:22.084585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.652 [2024-05-14 04:28:22.084731] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.652 [2024-05-14 04:28:22.084740] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.652 [2024-05-14 04:28:22.084747] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.652 [2024-05-14 04:28:22.087138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.652 [2024-05-14 04:28:22.095869] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.652 [2024-05-14 04:28:22.096628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.097132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.097145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.652 [2024-05-14 04:28:22.097154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.652 [2024-05-14 04:28:22.097330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.652 [2024-05-14 04:28:22.097458] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.652 [2024-05-14 04:28:22.097466] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.652 [2024-05-14 04:28:22.097473] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.652 [2024-05-14 04:28:22.099714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.652 [2024-05-14 04:28:22.108437] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.652 [2024-05-14 04:28:22.109084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.109662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.109699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.652 [2024-05-14 04:28:22.109710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.652 [2024-05-14 04:28:22.109890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.652 [2024-05-14 04:28:22.109999] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.652 [2024-05-14 04:28:22.110008] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.652 [2024-05-14 04:28:22.110015] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.652 [2024-05-14 04:28:22.112356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.652 [2024-05-14 04:28:22.120903] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.652 [2024-05-14 04:28:22.121384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.652 [2024-05-14 04:28:22.121894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.121907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.121917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.122059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.122168] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.122177] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.122184] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.653 [2024-05-14 04:28:22.124485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.653 [2024-05-14 04:28:22.133656] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.653 [2024-05-14 04:28:22.134365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.134888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.134901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.134910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.135035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.135185] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.135193] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.135201] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.653 [2024-05-14 04:28:22.137412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.653 [2024-05-14 04:28:22.145793] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.653 [2024-05-14 04:28:22.146533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.147039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.147052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.147062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.147204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.147376] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.147384] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.147392] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.653 [2024-05-14 04:28:22.149722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.653 [2024-05-14 04:28:22.158299] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.653 [2024-05-14 04:28:22.158974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.159562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.159599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.159609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.159771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.159935] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.159943] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.159951] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.653 [2024-05-14 04:28:22.162327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.653 [2024-05-14 04:28:22.170681] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.653 [2024-05-14 04:28:22.171484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.172049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.172063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.172072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.172252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.172423] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.172437] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.172444] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.653 [2024-05-14 04:28:22.174650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.653 [2024-05-14 04:28:22.183265] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.653 [2024-05-14 04:28:22.183956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.184577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.184614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.184624] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.184749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.184914] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.184922] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.184929] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.653 [2024-05-14 04:28:22.187139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.653 [2024-05-14 04:28:22.195662] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.653 [2024-05-14 04:28:22.196196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.196776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.196813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.196824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.197004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.197131] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.197139] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.197147] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.653 [2024-05-14 04:28:22.199431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.653 [2024-05-14 04:28:22.208179] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.653 [2024-05-14 04:28:22.208894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.209515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.209552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.209564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.209763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.209855] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.209863] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.209879] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.653 [2024-05-14 04:28:22.212106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.653 [2024-05-14 04:28:22.220851] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.653 [2024-05-14 04:28:22.221621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.222089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.222102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.222111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.222236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.222388] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.222397] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.222404] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.653 [2024-05-14 04:28:22.224700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.653 [2024-05-14 04:28:22.233140] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.653 [2024-05-14 04:28:22.233605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.234194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.653 [2024-05-14 04:28:22.234206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.653 [2024-05-14 04:28:22.234215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.653 [2024-05-14 04:28:22.234384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.653 [2024-05-14 04:28:22.234548] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.653 [2024-05-14 04:28:22.234556] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.653 [2024-05-14 04:28:22.234564] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.654 [2024-05-14 04:28:22.236933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.916 [2024-05-14 04:28:22.245629] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.916 [2024-05-14 04:28:22.246303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.916 [2024-05-14 04:28:22.246771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.916 [2024-05-14 04:28:22.246807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.916 [2024-05-14 04:28:22.246817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.916 [2024-05-14 04:28:22.246961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.916 [2024-05-14 04:28:22.247107] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.916 [2024-05-14 04:28:22.247115] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.916 [2024-05-14 04:28:22.247123] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.916 [2024-05-14 04:28:22.249504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.916 [2024-05-14 04:28:22.257910] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.916 [2024-05-14 04:28:22.258639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.916 [2024-05-14 04:28:22.259143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.916 [2024-05-14 04:28:22.259155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.916 [2024-05-14 04:28:22.259165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.916 [2024-05-14 04:28:22.259370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.916 [2024-05-14 04:28:22.259516] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.916 [2024-05-14 04:28:22.259524] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.259531] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.261847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.270285] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.270977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.271611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.271648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.917 [2024-05-14 04:28:22.271659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.917 [2024-05-14 04:28:22.271788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.917 [2024-05-14 04:28:22.271952] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.917 [2024-05-14 04:28:22.271960] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.271967] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.274232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.282710] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.283221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.283879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.283916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.917 [2024-05-14 04:28:22.283926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.917 [2024-05-14 04:28:22.284088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.917 [2024-05-14 04:28:22.284233] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.917 [2024-05-14 04:28:22.284242] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.284250] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.286536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.295067] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.295524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.296050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.296061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.917 [2024-05-14 04:28:22.296069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.917 [2024-05-14 04:28:22.296254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.917 [2024-05-14 04:28:22.296402] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.917 [2024-05-14 04:28:22.296409] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.296416] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.298674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.307465] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.308218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.308761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.308776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.917 [2024-05-14 04:28:22.308785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.917 [2024-05-14 04:28:22.308984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.917 [2024-05-14 04:28:22.309111] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.917 [2024-05-14 04:28:22.309119] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.309126] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.311300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.319853] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.320589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.321102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.321114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.917 [2024-05-14 04:28:22.321123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.917 [2024-05-14 04:28:22.321284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.917 [2024-05-14 04:28:22.321417] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.917 [2024-05-14 04:28:22.321425] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.321433] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.323673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.332370] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.332991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.333556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.333593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.917 [2024-05-14 04:28:22.333604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.917 [2024-05-14 04:28:22.333710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.917 [2024-05-14 04:28:22.333838] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.917 [2024-05-14 04:28:22.333846] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.333854] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.336136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.344916] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.345623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.346115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.346128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.917 [2024-05-14 04:28:22.346137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.917 [2024-05-14 04:28:22.346323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.917 [2024-05-14 04:28:22.346451] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.917 [2024-05-14 04:28:22.346459] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.346466] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.348851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.357597] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.358219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.358840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.358877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.917 [2024-05-14 04:28:22.358887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.917 [2024-05-14 04:28:22.359066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.917 [2024-05-14 04:28:22.359249] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.917 [2024-05-14 04:28:22.359257] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.359264] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.361354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.369967] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.370714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.371224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.371241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.917 [2024-05-14 04:28:22.371250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.917 [2024-05-14 04:28:22.371455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.917 [2024-05-14 04:28:22.371601] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.917 [2024-05-14 04:28:22.371609] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.917 [2024-05-14 04:28:22.371616] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.917 [2024-05-14 04:28:22.373894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.917 [2024-05-14 04:28:22.382531] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.917 [2024-05-14 04:28:22.383063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.383678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.917 [2024-05-14 04:28:22.383715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.383726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.383887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.383996] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.384004] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.384012] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.386240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.918 [2024-05-14 04:28:22.395067] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.918 [2024-05-14 04:28:22.395768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.396181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.396193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.396203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.396389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.396498] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.396506] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.396514] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.398593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.918 [2024-05-14 04:28:22.407422] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.918 [2024-05-14 04:28:22.407898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.408165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.408177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.408191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.408360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.408497] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.408505] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.408512] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.410612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.918 [2024-05-14 04:28:22.420010] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.918 [2024-05-14 04:28:22.420754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.421258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.421271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.421280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.421466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.421576] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.421583] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.421591] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.423796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.918 [2024-05-14 04:28:22.432454] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.918 [2024-05-14 04:28:22.433219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.433731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.433746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.433755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.433899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.434008] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.434016] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.434023] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.436176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.918 [2024-05-14 04:28:22.444796] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.918 [2024-05-14 04:28:22.445093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.445604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.445618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.445626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.445798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.445960] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.445967] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.445974] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.448399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.918 [2024-05-14 04:28:22.457200] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.918 [2024-05-14 04:28:22.458000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.458515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.458529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.458538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.458663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.458827] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.458835] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.458843] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.461070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.918 [2024-05-14 04:28:22.469838] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.918 [2024-05-14 04:28:22.470554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.471067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.471080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.471089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.471287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.471440] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.471448] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.471456] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.473680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.918 [2024-05-14 04:28:22.482378] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.918 [2024-05-14 04:28:22.483109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.483704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.483741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.483752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.483896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.484012] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.484020] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.484028] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.486386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:07.918 [2024-05-14 04:28:22.494864] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:07.918 [2024-05-14 04:28:22.495385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.495777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:07.918 [2024-05-14 04:28:22.495789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:07.918 [2024-05-14 04:28:22.495799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:07.918 [2024-05-14 04:28:22.495960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:07.918 [2024-05-14 04:28:22.496105] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:07.918 [2024-05-14 04:28:22.496113] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:07.918 [2024-05-14 04:28:22.496121] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:07.918 [2024-05-14 04:28:22.498425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.181 [2024-05-14 04:28:22.507412] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.181 [2024-05-14 04:28:22.508131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.181 [2024-05-14 04:28:22.508651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.181 [2024-05-14 04:28:22.508666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.181 [2024-05-14 04:28:22.508675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.181 [2024-05-14 04:28:22.508837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.181 [2024-05-14 04:28:22.508964] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.181 [2024-05-14 04:28:22.508972] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.181 [2024-05-14 04:28:22.508980] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.181 [2024-05-14 04:28:22.511353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.181 [2024-05-14 04:28:22.519932] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.181 [2024-05-14 04:28:22.520687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.521198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.521210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.521220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.521387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.521569] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.182 [2024-05-14 04:28:22.521582] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.182 [2024-05-14 04:28:22.521590] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.182 [2024-05-14 04:28:22.523795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.182 [2024-05-14 04:28:22.532472] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.182 [2024-05-14 04:28:22.532992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.533556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.533593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.533603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.533746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.533929] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.182 [2024-05-14 04:28:22.533937] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.182 [2024-05-14 04:28:22.533945] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.182 [2024-05-14 04:28:22.536135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.182 [2024-05-14 04:28:22.544952] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.182 [2024-05-14 04:28:22.545713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.546220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.546232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.546241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.546374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.546557] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.182 [2024-05-14 04:28:22.546565] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.182 [2024-05-14 04:28:22.546572] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.182 [2024-05-14 04:28:22.548797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.182 [2024-05-14 04:28:22.557557] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.182 [2024-05-14 04:28:22.558270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.558773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.558786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.558795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.558993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.559157] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.182 [2024-05-14 04:28:22.559164] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.182 [2024-05-14 04:28:22.559176] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.182 [2024-05-14 04:28:22.561530] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.182 [2024-05-14 04:28:22.570171] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.182 [2024-05-14 04:28:22.570822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.571483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.571520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.571530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.571637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.571782] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.182 [2024-05-14 04:28:22.571791] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.182 [2024-05-14 04:28:22.571798] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.182 [2024-05-14 04:28:22.574117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.182 [2024-05-14 04:28:22.582830] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.182 [2024-05-14 04:28:22.583577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.584076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.584088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.584097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.584258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.584409] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.182 [2024-05-14 04:28:22.584418] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.182 [2024-05-14 04:28:22.584425] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.182 [2024-05-14 04:28:22.586877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.182 [2024-05-14 04:28:22.595407] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.182 [2024-05-14 04:28:22.596061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.596650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.596686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.596697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.596876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.597022] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.182 [2024-05-14 04:28:22.597031] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.182 [2024-05-14 04:28:22.597038] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.182 [2024-05-14 04:28:22.599200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.182 [2024-05-14 04:28:22.607976] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.182 [2024-05-14 04:28:22.608776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.609142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.609154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.609164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.609289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.609442] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.182 [2024-05-14 04:28:22.609450] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.182 [2024-05-14 04:28:22.609457] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.182 [2024-05-14 04:28:22.611919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.182 [2024-05-14 04:28:22.620394] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.182 [2024-05-14 04:28:22.621048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.621599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.621613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.621622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.621803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.621912] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.182 [2024-05-14 04:28:22.621921] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.182 [2024-05-14 04:28:22.621928] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.182 [2024-05-14 04:28:22.624226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.182 [2024-05-14 04:28:22.632861] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.182 [2024-05-14 04:28:22.633673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.634086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.182 [2024-05-14 04:28:22.634098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.182 [2024-05-14 04:28:22.634107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.182 [2024-05-14 04:28:22.634251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.182 [2024-05-14 04:28:22.634419] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.183 [2024-05-14 04:28:22.634428] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.183 [2024-05-14 04:28:22.634435] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.183 [2024-05-14 04:28:22.636553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.183 [2024-05-14 04:28:22.645303] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.183 [2024-05-14 04:28:22.645975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.646573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.646610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.183 [2024-05-14 04:28:22.646620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.183 [2024-05-14 04:28:22.646800] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.183 [2024-05-14 04:28:22.646982] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.183 [2024-05-14 04:28:22.646991] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.183 [2024-05-14 04:28:22.646999] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.183 [2024-05-14 04:28:22.649409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.183 [2024-05-14 04:28:22.657849] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.183 04:28:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:08.183 04:28:22 -- common/autotest_common.sh@852 -- # return 0 00:31:08.183 [2024-05-14 04:28:22.658535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 04:28:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:08.183 [2024-05-14 04:28:22.659037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 04:28:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:08.183 [2024-05-14 04:28:22.659050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.183 [2024-05-14 04:28:22.659060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.183 [2024-05-14 04:28:22.659203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.183 04:28:22 -- common/autotest_common.sh@10 -- # set +x 00:31:08.183 [2024-05-14 04:28:22.659393] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.183 [2024-05-14 04:28:22.659402] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.183 [2024-05-14 04:28:22.659409] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.183 [2024-05-14 04:28:22.661761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.183 [2024-05-14 04:28:22.670158] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.183 [2024-05-14 04:28:22.670876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.671508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.671544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.183 [2024-05-14 04:28:22.671555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.183 [2024-05-14 04:28:22.671735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.183 [2024-05-14 04:28:22.671843] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.183 [2024-05-14 04:28:22.671852] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.183 [2024-05-14 04:28:22.671860] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.183 [2024-05-14 04:28:22.674255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.183 [2024-05-14 04:28:22.682678] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.183 [2024-05-14 04:28:22.683305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.683803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.683813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.183 [2024-05-14 04:28:22.683821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.183 [2024-05-14 04:28:22.683964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.183 [2024-05-14 04:28:22.684107] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.183 [2024-05-14 04:28:22.684114] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.183 [2024-05-14 04:28:22.684121] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.183 [2024-05-14 04:28:22.686379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.183 [2024-05-14 04:28:22.695088] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.183 [2024-05-14 04:28:22.695838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.696338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.696353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.183 [2024-05-14 04:28:22.696362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.183 [2024-05-14 04:28:22.696487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.183 [2024-05-14 04:28:22.696632] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.183 [2024-05-14 04:28:22.696640] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.183 [2024-05-14 04:28:22.696649] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.183 [2024-05-14 04:28:22.698803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.183 04:28:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:08.183 04:28:22 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:08.183 04:28:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.183 04:28:22 -- common/autotest_common.sh@10 -- # set +x 00:31:08.183 [2024-05-14 04:28:22.706058] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:08.183 [2024-05-14 04:28:22.707430] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.183 [2024-05-14 04:28:22.708061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.708637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.708674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.183 [2024-05-14 04:28:22.708685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.183 [2024-05-14 04:28:22.708828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.183 [2024-05-14 04:28:22.708974] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.183 [2024-05-14 04:28:22.708987] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.183 [2024-05-14 04:28:22.708994] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.183 04:28:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.183 [2024-05-14 04:28:22.711260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.183 04:28:22 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:08.183 04:28:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.183 04:28:22 -- common/autotest_common.sh@10 -- # set +x 00:31:08.183 [2024-05-14 04:28:22.719960] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.183 [2024-05-14 04:28:22.720426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.720936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.720948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.183 [2024-05-14 04:28:22.720958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.183 [2024-05-14 04:28:22.721156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.183 [2024-05-14 04:28:22.721310] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.183 [2024-05-14 04:28:22.721319] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.183 [2024-05-14 04:28:22.721327] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.183 [2024-05-14 04:28:22.723605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.183 [2024-05-14 04:28:22.732470] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.183 [2024-05-14 04:28:22.733106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.733376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.183 [2024-05-14 04:28:22.733401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.183 [2024-05-14 04:28:22.733413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.183 [2024-05-14 04:28:22.733585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.183 [2024-05-14 04:28:22.733747] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.183 [2024-05-14 04:28:22.733755] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.183 [2024-05-14 04:28:22.733762] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.183 [2024-05-14 04:28:22.736204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.183 Malloc0 00:31:08.183 04:28:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.183 04:28:22 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:08.183 04:28:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.183 04:28:22 -- common/autotest_common.sh@10 -- # set +x 00:31:08.183 [2024-05-14 04:28:22.744931] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.183 [2024-05-14 04:28:22.745612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.184 [2024-05-14 04:28:22.746139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.184 [2024-05-14 04:28:22.746152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.184 [2024-05-14 04:28:22.746166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.184 [2024-05-14 04:28:22.746297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.184 [2024-05-14 04:28:22.746425] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.184 [2024-05-14 04:28:22.746433] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.184 [2024-05-14 04:28:22.746440] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.184 [2024-05-14 04:28:22.748592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.184 04:28:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.184 04:28:22 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:08.184 04:28:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.184 04:28:22 -- common/autotest_common.sh@10 -- # set +x 00:31:08.184 [2024-05-14 04:28:22.757389] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.184 [2024-05-14 04:28:22.757990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.184 [2024-05-14 04:28:22.758627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:08.184 [2024-05-14 04:28:22.758664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f89c0 with addr=10.0.0.2, port=4420 00:31:08.184 [2024-05-14 04:28:22.758674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10f89c0 is same with the state(5) to be set 00:31:08.184 [2024-05-14 04:28:22.758872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10f89c0 (9): Bad file descriptor 00:31:08.184 [2024-05-14 04:28:22.758981] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:31:08.184 [2024-05-14 04:28:22.758990] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:31:08.184 [2024-05-14 04:28:22.758997] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:08.184 [2024-05-14 04:28:22.761409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:31:08.184 04:28:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.184 04:28:22 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:08.184 04:28:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.184 04:28:22 -- common/autotest_common.sh@10 -- # set +x 00:31:08.444 [2024-05-14 04:28:22.768658] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:08.444 [2024-05-14 04:28:22.770049] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:08.444 04:28:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.444 04:28:22 -- host/bdevperf.sh@38 -- # wait 4142537 00:31:08.444 [2024-05-14 04:28:22.811272] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:18.443 00:31:18.443 Latency(us) 00:31:18.443 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:18.443 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:18.443 Verification LBA range: start 0x0 length 0x4000 00:31:18.443 Nvme1n1 : 15.00 13735.91 53.66 14514.82 0.00 4516.18 1010.35 19442.35 00:31:18.443 =================================================================================================================== 00:31:18.443 Total : 13735.91 53.66 14514.82 0.00 4516.18 1010.35 19442.35 00:31:18.443 04:28:31 -- host/bdevperf.sh@39 -- # sync 00:31:18.443 04:28:31 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:18.443 04:28:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:18.443 04:28:31 -- common/autotest_common.sh@10 -- # set +x 00:31:18.443 04:28:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:18.443 04:28:31 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:31:18.443 04:28:31 -- host/bdevperf.sh@44 -- # nvmftestfini 00:31:18.443 04:28:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:18.443 04:28:31 -- nvmf/common.sh@116 -- # sync 00:31:18.443 04:28:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:18.443 04:28:31 -- nvmf/common.sh@119 -- # set +e 00:31:18.443 04:28:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:18.443 04:28:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:18.443 rmmod nvme_tcp 00:31:18.443 rmmod nvme_fabrics 00:31:18.443 rmmod nvme_keyring 00:31:18.443 04:28:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:18.443 04:28:31 -- nvmf/common.sh@123 -- # set -e 00:31:18.443 04:28:31 -- nvmf/common.sh@124 -- # return 0 00:31:18.443 04:28:31 -- nvmf/common.sh@477 -- # '[' -n 4143820 ']' 00:31:18.443 04:28:31 -- nvmf/common.sh@478 -- # killprocess 4143820 00:31:18.443 04:28:31 -- common/autotest_common.sh@926 -- # '[' -z 4143820 ']' 00:31:18.443 04:28:31 -- common/autotest_common.sh@930 -- # kill -0 4143820 00:31:18.443 04:28:31 -- common/autotest_common.sh@931 -- # uname 00:31:18.443 04:28:31 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:18.443 04:28:31 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4143820 00:31:18.443 04:28:31 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:31:18.443 04:28:31 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:31:18.443 04:28:31 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4143820' 00:31:18.443 killing process with pid 4143820 00:31:18.443 04:28:31 -- common/autotest_common.sh@945 -- # kill 4143820 00:31:18.443 04:28:31 -- common/autotest_common.sh@950 -- # wait 4143820 00:31:18.443 04:28:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:18.443 04:28:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:18.443 04:28:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:18.443 04:28:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:18.443 04:28:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:18.443 04:28:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:18.443 04:28:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:18.443 04:28:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:19.386 04:28:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:19.386 00:31:19.386 real 0m27.561s 00:31:19.386 user 1m2.724s 00:31:19.386 sys 0m6.889s 00:31:19.386 04:28:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:19.386 04:28:33 -- common/autotest_common.sh@10 -- # set +x 00:31:19.386 ************************************ 00:31:19.386 END TEST nvmf_bdevperf 00:31:19.386 ************************************ 00:31:19.386 04:28:33 -- nvmf/nvmf.sh@123 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:31:19.386 04:28:33 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:31:19.386 04:28:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:19.386 04:28:33 -- common/autotest_common.sh@10 -- # set +x 00:31:19.386 ************************************ 00:31:19.386 START TEST nvmf_target_disconnect 00:31:19.386 ************************************ 00:31:19.386 04:28:33 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:31:19.386 * Looking for test storage... 00:31:19.386 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:31:19.386 04:28:33 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:19.386 04:28:33 -- nvmf/common.sh@7 -- # uname -s 00:31:19.386 04:28:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:19.386 04:28:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:19.386 04:28:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:19.386 04:28:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:19.386 04:28:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:19.386 04:28:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:19.386 04:28:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:19.386 04:28:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:19.386 04:28:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:19.386 04:28:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:19.386 04:28:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:31:19.386 04:28:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:31:19.386 04:28:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:19.386 04:28:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:19.386 04:28:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:19.386 04:28:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:19.387 04:28:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:19.387 04:28:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:19.387 04:28:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:19.387 04:28:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.387 04:28:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.387 04:28:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.387 04:28:33 -- paths/export.sh@5 -- # export PATH 00:31:19.387 04:28:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.387 04:28:33 -- nvmf/common.sh@46 -- # : 0 00:31:19.387 04:28:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:19.387 04:28:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:19.387 04:28:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:19.387 04:28:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:19.387 04:28:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:19.387 04:28:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:19.387 04:28:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:19.387 04:28:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:19.387 04:28:33 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:31:19.387 04:28:33 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:31:19.387 04:28:33 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:31:19.387 04:28:33 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:31:19.387 04:28:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:19.387 04:28:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:19.387 04:28:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:19.387 04:28:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:19.387 04:28:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:19.387 04:28:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:19.387 04:28:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:19.387 04:28:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:19.387 04:28:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:19.387 04:28:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:19.387 04:28:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:19.387 04:28:33 -- common/autotest_common.sh@10 -- # set +x 00:31:27.535 04:28:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:27.535 04:28:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:27.535 04:28:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:27.535 04:28:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:27.535 04:28:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:27.535 04:28:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:27.535 04:28:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:27.535 04:28:40 -- nvmf/common.sh@294 -- # net_devs=() 00:31:27.535 04:28:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:27.535 04:28:40 -- nvmf/common.sh@295 -- # e810=() 00:31:27.535 04:28:40 -- nvmf/common.sh@295 -- # local -ga e810 00:31:27.535 04:28:40 -- nvmf/common.sh@296 -- # x722=() 00:31:27.535 04:28:40 -- nvmf/common.sh@296 -- # local -ga x722 00:31:27.535 04:28:40 -- nvmf/common.sh@297 -- # mlx=() 00:31:27.535 04:28:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:27.535 04:28:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:27.535 04:28:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:27.535 04:28:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:27.535 04:28:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:27.535 04:28:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:27.535 04:28:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:31:27.535 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:31:27.535 04:28:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:27.535 04:28:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:31:27.535 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:31:27.535 04:28:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:27.535 04:28:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:27.536 04:28:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:27.536 04:28:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:27.536 04:28:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:27.536 04:28:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:27.536 04:28:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:27.536 04:28:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:27.536 04:28:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:27.536 04:28:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:31:27.536 Found net devices under 0000:4b:00.0: cvl_0_0 00:31:27.536 04:28:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:27.536 04:28:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:27.536 04:28:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:27.536 04:28:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:27.536 04:28:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:27.536 04:28:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:31:27.536 Found net devices under 0000:4b:00.1: cvl_0_1 00:31:27.536 04:28:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:27.536 04:28:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:27.536 04:28:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:27.536 04:28:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:27.536 04:28:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:27.536 04:28:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:27.536 04:28:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:27.536 04:28:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:27.536 04:28:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:27.536 04:28:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:27.536 04:28:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:27.536 04:28:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:27.536 04:28:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:27.536 04:28:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:27.536 04:28:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:27.536 04:28:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:27.536 04:28:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:27.536 04:28:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:27.536 04:28:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:27.536 04:28:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:27.536 04:28:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:27.536 04:28:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:27.536 04:28:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:27.536 04:28:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:27.536 04:28:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:27.536 04:28:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:27.536 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:27.536 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.588 ms 00:31:27.536 00:31:27.536 --- 10.0.0.2 ping statistics --- 00:31:27.536 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:27.536 rtt min/avg/max/mdev = 0.588/0.588/0.588/0.000 ms 00:31:27.536 04:28:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:27.536 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:27.536 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.392 ms 00:31:27.536 00:31:27.536 --- 10.0.0.1 ping statistics --- 00:31:27.536 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:27.536 rtt min/avg/max/mdev = 0.392/0.392/0.392/0.000 ms 00:31:27.536 04:28:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:27.536 04:28:41 -- nvmf/common.sh@410 -- # return 0 00:31:27.536 04:28:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:27.536 04:28:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:27.536 04:28:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:27.536 04:28:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:27.536 04:28:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:27.536 04:28:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:27.536 04:28:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:27.536 04:28:41 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:31:27.536 04:28:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:27.536 04:28:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:27.536 04:28:41 -- common/autotest_common.sh@10 -- # set +x 00:31:27.536 ************************************ 00:31:27.536 START TEST nvmf_target_disconnect_tc1 00:31:27.536 ************************************ 00:31:27.536 04:28:41 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:31:27.536 04:28:41 -- host/target_disconnect.sh@32 -- # set +e 00:31:27.536 04:28:41 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:31:27.536 EAL: No free 2048 kB hugepages reported on node 1 00:31:27.536 [2024-05-14 04:28:41.252033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:27.536 [2024-05-14 04:28:41.252602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:27.536 [2024-05-14 04:28:41.252656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1aa4860 with addr=10.0.0.2, port=4420 00:31:27.536 [2024-05-14 04:28:41.252696] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:31:27.536 [2024-05-14 04:28:41.252706] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:31:27.536 [2024-05-14 04:28:41.252716] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:31:27.536 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:31:27.536 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:31:27.536 Initializing NVMe Controllers 00:31:27.536 04:28:41 -- host/target_disconnect.sh@33 -- # trap - ERR 00:31:27.536 04:28:41 -- host/target_disconnect.sh@33 -- # print_backtrace 00:31:27.536 04:28:41 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:31:27.536 04:28:41 -- common/autotest_common.sh@1132 -- # return 0 00:31:27.536 04:28:41 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:31:27.536 04:28:41 -- host/target_disconnect.sh@41 -- # set -e 00:31:27.536 00:31:27.536 real 0m0.103s 00:31:27.536 user 0m0.038s 00:31:27.536 sys 0m0.065s 00:31:27.536 04:28:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:27.536 04:28:41 -- common/autotest_common.sh@10 -- # set +x 00:31:27.536 ************************************ 00:31:27.536 END TEST nvmf_target_disconnect_tc1 00:31:27.536 ************************************ 00:31:27.536 04:28:41 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:31:27.536 04:28:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:27.536 04:28:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:27.536 04:28:41 -- common/autotest_common.sh@10 -- # set +x 00:31:27.536 ************************************ 00:31:27.536 START TEST nvmf_target_disconnect_tc2 00:31:27.536 ************************************ 00:31:27.536 04:28:41 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:31:27.536 04:28:41 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:31:27.536 04:28:41 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:31:27.536 04:28:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:27.536 04:28:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:27.536 04:28:41 -- common/autotest_common.sh@10 -- # set +x 00:31:27.536 04:28:41 -- nvmf/common.sh@469 -- # nvmfpid=4149747 00:31:27.536 04:28:41 -- nvmf/common.sh@470 -- # waitforlisten 4149747 00:31:27.536 04:28:41 -- common/autotest_common.sh@819 -- # '[' -z 4149747 ']' 00:31:27.536 04:28:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:31:27.536 04:28:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:27.536 04:28:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:27.536 04:28:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:27.536 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:27.536 04:28:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:27.536 04:28:41 -- common/autotest_common.sh@10 -- # set +x 00:31:27.536 [2024-05-14 04:28:41.371504] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:31:27.536 [2024-05-14 04:28:41.371565] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:27.536 EAL: No free 2048 kB hugepages reported on node 1 00:31:27.536 [2024-05-14 04:28:41.458921] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:27.536 [2024-05-14 04:28:41.550224] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:27.536 [2024-05-14 04:28:41.550391] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:27.536 [2024-05-14 04:28:41.550402] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:27.536 [2024-05-14 04:28:41.550410] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:27.536 [2024-05-14 04:28:41.550951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:31:27.536 [2024-05-14 04:28:41.551084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:31:27.536 [2024-05-14 04:28:41.551256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:31:27.536 [2024-05-14 04:28:41.551330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:31:27.798 04:28:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:27.798 04:28:42 -- common/autotest_common.sh@852 -- # return 0 00:31:27.798 04:28:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:27.798 04:28:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:27.798 04:28:42 -- common/autotest_common.sh@10 -- # set +x 00:31:27.798 04:28:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:27.798 04:28:42 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:27.798 04:28:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:27.798 04:28:42 -- common/autotest_common.sh@10 -- # set +x 00:31:27.798 Malloc0 00:31:27.798 04:28:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:27.798 04:28:42 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:31:27.798 04:28:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:27.798 04:28:42 -- common/autotest_common.sh@10 -- # set +x 00:31:27.798 [2024-05-14 04:28:42.245771] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:27.798 04:28:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:27.798 04:28:42 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:27.798 04:28:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:27.798 04:28:42 -- common/autotest_common.sh@10 -- # set +x 00:31:27.798 04:28:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:27.798 04:28:42 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:27.798 04:28:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:27.798 04:28:42 -- common/autotest_common.sh@10 -- # set +x 00:31:27.798 04:28:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:27.798 04:28:42 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:27.798 04:28:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:27.798 04:28:42 -- common/autotest_common.sh@10 -- # set +x 00:31:27.798 [2024-05-14 04:28:42.286230] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:27.798 04:28:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:27.798 04:28:42 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:31:27.798 04:28:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:27.798 04:28:42 -- common/autotest_common.sh@10 -- # set +x 00:31:27.798 04:28:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:27.798 04:28:42 -- host/target_disconnect.sh@50 -- # reconnectpid=4149992 00:31:27.798 04:28:42 -- host/target_disconnect.sh@52 -- # sleep 2 00:31:27.798 04:28:42 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:31:27.798 EAL: No free 2048 kB hugepages reported on node 1 00:31:30.359 04:28:44 -- host/target_disconnect.sh@53 -- # kill -9 4149747 00:31:30.359 04:28:44 -- host/target_disconnect.sh@55 -- # sleep 2 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Write completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Write completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Write completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Write completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Write completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Write completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Write completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Write completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Read completed with error (sct=0, sc=8) 00:31:30.359 starting I/O failed 00:31:30.359 Write completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 Read completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 Read completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 Read completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 Write completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 Read completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 Read completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 Read completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 Read completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 Write completed with error (sct=0, sc=8) 00:31:30.360 starting I/O failed 00:31:30.360 [2024-05-14 04:28:44.318925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:30.360 [2024-05-14 04:28:44.319612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.320062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.320071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.320770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.321141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.321151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.321737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.322271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.322281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.322836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.323524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.323551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.324005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.324615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.324643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.325112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.325704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.325732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.326232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.326832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.326860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.327210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.327643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.327671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.328014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.328556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.328584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.328954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.329333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.329341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.329812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.330319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.330327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.330731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.331240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.331247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.331742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.332260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.332267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.332740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.333205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.333212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.333672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.334001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.334008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.334246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.334535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.334542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.334922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.335426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.335433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.335925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.336324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.336331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.336865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.337318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.337326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.337716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.338224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.338231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.338710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.339174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.339181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.339655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.340160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.340167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.340534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.340896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.340906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.341387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.341874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.341881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.342334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.342801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.342807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.343274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.343748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.343755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.360 qpair failed and we were unable to recover it. 00:31:30.360 [2024-05-14 04:28:44.344249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.360 [2024-05-14 04:28:44.344729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.344736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.345201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.345775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.345803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.346180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.346531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.346538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.347005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.347497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.347524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.348067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.348672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.348699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.349138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.349609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.349637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.350048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.350609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.350637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.350992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.351594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.351622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.352155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.352711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.352738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.353110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.353674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.353701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.354227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.354719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.354746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.355138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.355648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.355676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.356059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.356540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.356567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.357030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.357511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.357538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.357919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.358396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.358403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.358854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.359235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.359241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.359725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.359908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.359920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.360327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.360772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.360779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.361229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.361733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.361740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.362191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.362666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.362673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.363124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.363588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.363616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.364087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.364601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.364629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.365064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.365539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.365566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.365940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.366361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.366368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.366713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.367173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.367180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.367679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.368053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.368060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.368528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.368890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.368897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.369390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.369883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.369891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.370362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.370782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.370788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.361 [2024-05-14 04:28:44.371256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.371486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.361 [2024-05-14 04:28:44.371501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.361 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.371994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.372495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.372501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.372954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.373414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.373420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.373912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.374319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.374325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.374741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.375271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.375277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.375743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.376202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.376208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.376679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.377142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.377148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.377713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.378214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.378224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.378820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.379458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.379486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.379956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.380554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.380582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.381072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.381672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.381700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.382179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.382670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.382677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.383216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.383679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.383686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.384145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.384711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.384738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.384959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.385405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.385413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.385786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.386311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.386319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.386758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.387224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.387230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.387703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.388163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.388169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.388731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.389227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.389236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.389756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.390131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.390138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.390746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.391241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.391251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.391792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.392305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.392315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.392791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.393297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.393308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.393788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.394247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.394253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.394798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.395299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.395308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.395787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.396451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.396479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.396951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.397528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.397556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.398035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.398589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.398616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.399111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.399714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.399742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.400215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.400765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.400792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.362 qpair failed and we were unable to recover it. 00:31:30.362 [2024-05-14 04:28:44.401272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.362 [2024-05-14 04:28:44.401837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.401864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.402319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.402801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.402808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.403265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.403725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.403735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.404186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.404669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.404676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.405130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.405655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.405682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.406157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.406564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.406591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.407133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.407698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.407726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.408237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.408786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.408814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.409282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.409885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.409912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.410497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.410995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.411004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.411552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.412056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.412065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.412618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.413116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.413125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.413694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.414188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.414201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.414809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.415300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.415310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.415819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.416281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.416289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.416900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.417523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.417551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.418048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.418660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.418688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.419027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.419629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.419658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.420127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.420690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.420717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.421225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.421787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.421815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.422288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.422867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.422894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.423481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.424053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.424062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.424275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.424527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.424542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.424985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.425577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.425604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.426076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.426635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.426662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.427162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.427716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.427743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.428214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.428778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.428805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.429273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.429839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.429866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.430482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.430977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.430986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.363 qpair failed and we were unable to recover it. 00:31:30.363 [2024-05-14 04:28:44.431495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.431991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.363 [2024-05-14 04:28:44.432000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.432566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.433075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.433084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.433579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.434052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.434062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.434537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.435036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.435045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.435624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.436115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.436124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.436722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.437221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.437230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.437793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.438305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.438315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.438861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.439500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.439528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.439896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.440236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.440243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.440811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.441315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.441332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.441805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.442270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.442276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.442739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.443200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.443206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.443755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.444210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.444216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.444777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.445259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.445269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.445837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.446501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.446528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.447005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.447562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.447589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.448063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.448666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.448694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.449225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.449829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.449856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.450084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.450657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.450684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.451158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.451713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.451740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.452214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.452771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.452798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.453270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.453738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.453765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.454226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.454777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.454805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.455270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.455860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.455888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.364 [2024-05-14 04:28:44.456499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.456998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.364 [2024-05-14 04:28:44.457007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.364 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.457574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.458071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.458080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.458564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.459063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.459072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.459623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.460105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.460115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.460689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.461184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.461193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.461681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.462181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.462190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.462625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.463124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.463130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.463673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.464167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.464176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.464717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.465187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.465194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.465677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.466138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.466144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.466689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.467186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.467195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.467773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.468261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.468271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.468884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.469501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.469529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.469993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.470591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.470618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.471112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.471713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.471740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.472207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.472762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.472790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.473255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.473847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.473875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.474503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.475005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.475014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.475556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.476041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.476050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.476593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.477087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.477096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.477667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.478165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.478174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.478627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.478993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.479000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.479558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.480052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.480061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.480612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.481152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.481161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.481717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.482217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.482226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.482780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.483279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.483288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.483856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.484313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.484330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.484812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.485272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.485279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.485819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.486289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.486302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.486872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.487483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.487510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.365 qpair failed and we were unable to recover it. 00:31:30.365 [2024-05-14 04:28:44.487977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.365 [2024-05-14 04:28:44.488605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.488633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.489177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.489648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.489656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.490152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.490698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.490725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.491196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.491814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.491841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.492490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.492984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.492993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.493545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.493914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.493924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.494380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.494868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.494874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.495327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.495794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.495801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.496252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.496715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.496722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.497185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.497673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.497680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.498059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.498637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.498665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.499161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.499720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.499747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.500217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.500782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.500809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.501283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.501845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.501872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.502495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.502996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.503005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.503603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.504119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.504128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.504666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.504919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.504933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.505462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.505932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.505939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.506529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.507078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.507088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.507663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.508157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.508166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.508665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.509134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.509140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.509694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.510233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.510242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.510805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.511305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.511315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.511800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.512125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.512132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.512717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.513181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.513189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.513669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.514133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.514139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.514607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.515109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.515118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.515753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.516242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.516251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.516803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.517299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.517309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.366 qpair failed and we were unable to recover it. 00:31:30.366 [2024-05-14 04:28:44.517864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.366 [2024-05-14 04:28:44.518453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.518480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.518953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.519517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.519544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.520027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.520580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.520607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.521104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.521670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.521697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.522177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.522716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.522723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.523185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.523668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.523675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.524132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.524723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.524751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.525229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.525678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.525705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.525930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.526411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.526419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.526889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.527352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.527359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.527746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.528211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.528217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.528702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.529162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.529168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.529660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.530156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.530165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.530778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.531273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.531283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.531869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.532481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.532508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.532978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.533541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.533569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.534040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.534604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.534631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.535115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.535680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.535707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.536185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.536672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.536679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.537048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.537574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.537601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.537800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.538282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.538289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.538758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.539192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.539199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.539609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.539986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.539992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.540584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.541076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.541085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.541643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.542141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.542150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.542719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.543179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.543188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.543681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.544137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.544144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.544691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.545063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.545071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.367 [2024-05-14 04:28:44.545649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.546053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.367 [2024-05-14 04:28:44.546062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.367 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.546282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.546757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.546764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.547259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.547850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.547878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.548502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.549000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.549009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.549503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.549908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.549917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.550503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.550996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.551006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.551460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.551931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.551938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.552417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.552790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.552797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.553285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.553779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.553785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.554264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.554890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.554918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.555505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.555999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.556008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.556559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.557130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.557138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.557704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.558207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.558216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.558790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.559298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.559310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.559794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.560183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.560190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.560768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.561269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.561278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.561825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.562505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.562532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.563031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.563595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.563622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.564092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.564645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.564672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.565142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.565738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.565765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.566235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.566866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.566894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.567489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.567862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.567871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.568498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.568986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.568995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.569568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.570055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.570068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.570673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.571245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.571255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.368 [2024-05-14 04:28:44.571541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.571886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.368 [2024-05-14 04:28:44.571893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.368 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.572349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.572822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.572829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.573287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.573758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.573765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.574222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.574576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.574583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.574915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.575141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.575154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.575675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.576178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.576184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.576656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.577113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.577119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.577567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.577810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.577823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.578302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.578853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.578863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.579327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.579711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.579718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.580100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.580540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.580547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.581002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.581462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.581468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.581932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.582433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.582441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.582923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.583383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.583391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.583732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.584034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.584044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.584527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.584984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.584991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.585485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.585943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.585950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.586344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.586822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.586829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.587284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.587663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.587671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.588042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.588602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.588629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.589129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.589579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.589606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.590079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.590635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.590663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.591133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.591588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.591615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.591839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.592333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.592341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.592717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.593061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.593068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.593576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.594021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.594029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.594553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.595003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.595010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.595470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.595959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.595965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.596301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.596777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.596783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.369 [2024-05-14 04:28:44.597244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.597768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.369 [2024-05-14 04:28:44.597795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.369 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.598260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.598838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.598865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.599532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.600029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.600038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.600590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.601078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.601087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.601640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.602138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.602148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.602643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.603027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.603036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.603602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.604094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.604103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.604711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.605209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.605218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.605816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.606222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.606232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.606666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.607204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.607214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.607706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.608209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.608217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.608689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.609081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.609089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.609737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.610506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.610534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.610916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.611539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.611567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.612038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.612598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.612625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.612965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.613431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.613439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.613784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.614224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.614231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.614743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.615189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.615196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.615674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.616012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.616020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.616508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.616995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.617002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.617569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.618075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.618084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.618673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.619172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.619181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.619660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.620159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.620167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.620728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.621230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.621238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.621717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.622224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.622233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.622841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.623243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.623252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.623893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.624484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.624512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.625010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.625576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.625604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.626075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.626602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.626630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.627105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.627659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.370 [2024-05-14 04:28:44.627687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.370 qpair failed and we were unable to recover it. 00:31:30.370 [2024-05-14 04:28:44.628244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.628810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.628838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.629461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.629996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.630005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.630558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.631055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.631064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.631615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.632075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.632084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.632681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.633044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.633054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.633631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.634125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.634134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.634720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.635222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.635231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.635783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.636282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.636297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.636881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.637482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.637510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.637980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.638537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.638564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.639096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.639688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.639716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.640203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.640583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.640610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.641139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.641578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.641606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.642177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.642522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.642529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.642897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.643287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.643301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.643814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.644158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.644164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.644714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.645217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.645226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.645882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.646256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.646266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.646864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.647521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.647548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.648033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.648612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.648640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.649118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.649745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.649773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.650156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.650642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.650670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.651008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.651643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.651670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.652201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.652757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.652784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.653270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.653619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.653646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.654125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.654606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.654634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.655110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.655665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.655693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.656168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.656783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.656811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.657041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.657645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.657672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.371 qpair failed and we were unable to recover it. 00:31:30.371 [2024-05-14 04:28:44.658054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.371 [2024-05-14 04:28:44.658627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.658654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.659043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.659499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.659506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.659990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.660589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.660617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.661090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.661680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.661708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.662296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.662773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.662800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.663303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.663859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.663886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.664506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.665007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.665016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.665615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.666117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.666127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.666754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.667517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.667544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.668016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.668583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.668610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.669149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.669724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.669752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.670226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.670803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.670831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.671314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.671706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.671713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.672084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.672426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.672434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.672983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.673575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.673603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.674082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.674671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.674698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.675238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.675635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.675642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.676107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.676718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.676745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.677219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.677629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.677656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.678149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.678729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.678756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.679256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.679835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.679862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.680513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.681074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.681082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.681675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.682177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.682186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.682681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.683191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.683200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.683641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.684033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.684039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.684646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.685140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.685149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.685544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.685947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.685956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.686546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.686945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.686954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.687403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.687899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.687906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.372 qpair failed and we were unable to recover it. 00:31:30.372 [2024-05-14 04:28:44.688360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.372 [2024-05-14 04:28:44.688822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.688828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.689288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.689853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.689860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.690282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.690890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.690918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.691551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.692077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.692086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.692650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.693143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.693152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.693652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.694215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.694224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.694862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.695580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.695608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.696147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.696814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.696842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.697250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.697877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.697904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.698482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.699022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.699031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.699590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.699885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.699900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.700531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.700946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.700955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.701418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.701902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.701909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.702299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.702830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.702836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.703066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.703532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.703540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.704011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.704453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.704460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.704798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.705239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.705246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.705606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.706073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.706079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.706587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.707093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.707102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.707677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.708231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.708239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.708768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.709243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.709249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.709858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.710530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.710558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.711094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.711687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.711718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.712197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.712855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.712882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.713534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.714094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.714103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.373 qpair failed and we were unable to recover it. 00:31:30.373 [2024-05-14 04:28:44.714745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.715240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.373 [2024-05-14 04:28:44.715249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.715883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.716538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.716565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.717082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.717654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.717682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.718181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.718783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.718811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.719282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.719849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.719876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.720251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.720719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.720746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.721266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.721487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.721499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.721953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.722443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.722454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.722810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.723297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.723304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.723666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.724142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.724148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.724625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.725092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.725098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.725647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.726157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.726166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.726761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.727282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.727295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.727882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.728494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.728522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.728973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.729605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.729631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.730000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.730612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.730640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.731021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.731607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.731634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.732166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.732787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.732817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.733528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.734036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.734045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.734653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.735203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.735212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.735864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.736514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.736541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.737076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.737668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.737695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.738207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.738833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.738860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.739511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.739933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.739942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.740301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.740770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.740776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.741140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.741592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.741598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.742062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.742577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.742604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.743073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.743678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.743709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.744172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.744645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.744672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.374 qpair failed and we were unable to recover it. 00:31:30.374 [2024-05-14 04:28:44.745147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.745778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.374 [2024-05-14 04:28:44.745806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.746532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.746945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.746953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.747532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.748021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.748029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.748609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.749184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.749193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.749697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.750042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.750048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.750532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.750978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.750988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.751573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.752063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.752073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.752614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.753177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.753186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.753658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.754123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.754130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.754703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.755215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.755224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.755721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.756213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.756223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.756492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.756952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.756958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.757348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.757789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.757795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.758334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.758706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.758712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.759187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.759682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.759690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.760164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.760733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.760740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.761188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.761630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.761657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.762158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.762741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.762769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.763242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.763726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.763754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.764268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.764766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.764793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.765275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.765913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.765941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.766584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.767086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.767095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.767679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.768198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.768208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.768780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.769188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.769198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.769694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.770173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.770180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.770697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.770993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.771000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.771215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.771705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.771713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.772044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.772490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.772497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.772940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.773407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.773413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.773900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.774422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.375 [2024-05-14 04:28:44.774429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.375 qpair failed and we were unable to recover it. 00:31:30.375 [2024-05-14 04:28:44.774658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.775137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.775144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.775512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.776023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.776030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.776490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.776853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.776859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.777323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.777839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.777846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.778320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.778828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.778835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.779300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.779733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.779739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.780195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.780666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.780672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.781044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.781432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.781439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.781912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.782372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.782378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.782714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.783221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.783228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.783719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.784178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.784185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.784567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.784980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.784987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.785464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.785971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.785978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.786357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.786730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.786737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.787119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.787594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.787600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.788056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.788618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.788645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.789184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.789526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.789533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.789951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.790422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.790428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.790790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.791171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.791177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.791545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.791634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.791645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.792146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.792625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.792632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.793112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.793492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.793498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.793970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.794568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.794596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.795112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.795594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.795622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.796099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.796595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.796622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.796891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.797410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.797418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.797773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.798114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.798120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.798599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.799063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.799069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.799285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.799679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.376 [2024-05-14 04:28:44.799686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.376 qpair failed and we were unable to recover it. 00:31:30.376 [2024-05-14 04:28:44.799903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.800382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.800389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.800968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.801423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.801430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.801867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.802334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.802341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.802857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.803357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.803364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.803829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.804288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.804298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.804803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.805284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.805294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.805858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.806530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.806557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.807033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.807641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.807668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.808201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.808697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.808704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.809152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.809679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.809706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.810111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.810605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.810633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.811111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.811659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.811686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.812168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.812747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.812775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.813258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.813798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.813825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.814500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.814999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.815008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.815505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.815913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.815922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.816493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.817057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.817066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.817605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.818083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.818092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.818614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.819148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.819157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.819784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.820529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.820557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.821028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.821532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.821559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.822022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.822611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.822638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.823038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.823617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.823645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.824125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.824711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.824739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.825125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.825717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.825744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.377 [2024-05-14 04:28:44.826157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.826743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.377 [2024-05-14 04:28:44.826770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.377 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.827004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.827595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.827623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.828009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.828581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.828609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.829090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.829676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.829703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.830069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.830580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.830608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.831123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.831659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.831686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.832165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.832681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.832709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.833225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.833772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.833799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.834272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.834658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.834686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.835241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.835832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.835859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.836273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.836850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.836877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.837223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.837678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.837705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.838172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.838664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.838691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.839233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.839776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.839803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.840524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.841023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.841032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.841595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.842092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.842101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.842639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.843008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.843018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.843603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.844122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.844132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.844636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.845197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.845206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.845684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.846156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.846162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.846797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.847096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.847111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.847779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.848287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.848302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.848887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.849514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.849541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.849931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.850561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.850588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.850972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.851555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.851582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.852065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.852599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.852626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.853127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.853709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.853736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.854258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.854874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.854901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.855259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.855863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.855891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.856587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.857075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.378 [2024-05-14 04:28:44.857084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.378 qpair failed and we were unable to recover it. 00:31:30.378 [2024-05-14 04:28:44.857685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.858177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.858185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.858769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.859184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.859193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.859675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.860111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.860119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.860579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.861100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.861109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.861675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.862231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.862240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.862769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.863281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.863296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.863843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.864513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.864540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.864929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.865491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.865519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.866059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.866641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.866669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.867212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.867675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.867682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.867898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.868402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.868409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.868868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.869377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.869384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.869811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.870326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.870333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.870721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.871169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.871176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.871699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.872169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.872175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.872748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.873257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.873270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.873858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.874513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.874541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.875071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.875686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.875714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.876198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.876800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.876828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.877222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.877755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.877782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.878170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.878655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.878683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.879189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.879743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.879771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.880245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.880730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.880738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.880964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.881488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.881516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.882049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.882691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.882718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.883248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.883824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.883854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.884526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.885019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.885028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.885602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.886105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.886113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.886733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.887101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.379 [2024-05-14 04:28:44.887111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.379 qpair failed and we were unable to recover it. 00:31:30.379 [2024-05-14 04:28:44.887613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.888171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.888181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.888665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.889043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.889050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.889271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.889683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.889690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.890161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.890679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.890707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.891199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.891773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.891800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.892271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.892851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.892879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.893546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.894034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.894047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.894598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.895104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.895113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.895334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.895881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.895889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.896508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.897006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.897015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.897595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.897999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.898009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.898600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.898849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.898862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.899348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.899847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.899853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.900313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.900850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.900857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.901315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.901693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.901700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.902180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.902699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.902707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.903174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.903656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.903667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.904103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.904695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.904723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.905197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.905667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.905694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.906240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.906673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.906680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.907146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.907741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.907768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.908300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.908920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.908948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.909566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.910059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.910068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.910627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.911119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.911128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.911760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.912514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.912541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.912907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.913567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.913595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.914082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.914537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.914564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.915080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.915679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.915707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.916231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.916825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.380 [2024-05-14 04:28:44.916852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.380 qpair failed and we were unable to recover it. 00:31:30.380 [2024-05-14 04:28:44.917267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.917728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.917755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.918237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.918638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.918665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.919048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.919650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.919677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.920215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.920509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.920517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.920959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.921438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.921445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.921916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.922378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.922386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.922868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.923242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.923248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.923722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.924105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.924112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.924650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.925023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.925033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.925617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.926008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.926019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.926519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.927048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.927057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.927634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.928128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.928138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.928592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.929093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.929103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.929595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.931409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.931428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.931894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.932130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.932148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.933236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.933760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.933769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.934214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.934634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.381 [2024-05-14 04:28:44.934642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.381 qpair failed and we were unable to recover it. 00:31:30.381 [2024-05-14 04:28:44.935138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.935619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.935647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.936027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.936576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.936604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.937104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.937609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.937636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.938108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.938691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.938718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.939248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.939774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.939802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.940273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.940829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.940857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.941544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.942045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.942054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.942621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.942875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.942889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.943398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.943913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.943920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.944388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.944897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.944904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.945403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.945761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.945768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.946150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.946630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.946637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.947116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.947695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.947723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.948241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.948809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.948837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.949226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.949764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.949791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.950059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.950555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.950563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.950940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.951565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.951593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.952100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.952695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.952722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.953226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.953825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.953853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.954503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.955013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.955022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.955245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.955781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.955789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.956250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.956789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.956817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.957109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.957584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.957611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.958087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.958679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.958706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.959243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.959825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.959853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.960493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.961055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.961063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.961580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.962082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.962091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.649 [2024-05-14 04:28:44.962312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.962800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.649 [2024-05-14 04:28:44.962807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.649 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.963266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.963734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.963761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.964277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.964789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.964816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.965524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.966024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.966032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.966538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.967038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.967047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.967263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.967883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.967910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.968524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.969014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.969023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.969561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.970000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.970009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.970660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.971028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.971039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.971606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.972174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.972183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.972668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.973137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.973144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.973629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.974041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.974050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.974599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.975039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.975048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.975601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.976202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.976211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.976714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.977192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.977199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.977574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.978079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.978086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.978654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.979137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.979147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.979816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.980499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.980526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.981056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.981636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.981663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.982129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.982656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.982683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.983156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.983730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.983758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.984237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.984819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.984847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.985535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.986085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.986094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.986693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.987134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.987143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.987717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.988212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.988221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.988719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.989209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.989219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.989613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.990136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.990145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.990528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.990991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.991002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.991612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.992118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.992127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.650 qpair failed and we were unable to recover it. 00:31:30.650 [2024-05-14 04:28:44.992628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.650 [2024-05-14 04:28:44.993037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.993047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:44.993620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.994023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.994032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:44.994590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.995087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.995096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:44.995567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.996073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.996083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:44.996674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.997174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.997182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:44.997569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.998047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.998055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:44.998558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.998978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.998987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:44.999613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.999982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:44.999991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.000447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.000936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.000943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.001428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.001934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.001940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.002418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.002636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.002648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.003198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.003570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.003577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.004035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.004495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.004502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.004873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.005253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.005259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.005718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.006225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.006232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.006732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.007203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.007210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.007591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.007776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.007787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.008273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.008653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.008660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.009029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.009530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.009537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.009997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.010530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.010557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.011040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.011621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.011648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.012072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.012582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.012609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.013091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.013593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.013621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.014096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.014586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.014613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.015091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.015667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.015694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.016191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.016725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.016732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.017209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.017738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.017766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.018241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.018867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.018894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.019128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.019585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.651 [2024-05-14 04:28:45.019612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.651 qpair failed and we were unable to recover it. 00:31:30.651 [2024-05-14 04:28:45.020136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.020800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.020828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.021263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.021786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.021814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.022184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.022772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.022799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.023279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.023922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.023949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.024572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.025088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.025096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.025686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.026094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.026103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.026672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.027237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.027249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.027846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.028510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.028537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.029056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.029287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.029310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.029889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.030466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.030494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.030972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.031565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.031593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.032070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.032716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.032744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.033213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.033761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.033789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.034277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.034869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.034897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.035572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.035960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.035969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.036589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.037087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.037096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.037676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.038067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.038079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.038715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.039214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.039224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.039844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.040511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.040539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.041012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.041603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.041630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.042127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.042357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.042370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.042867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.043499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.043527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.043999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.044472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.044479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.044943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.045524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.045551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.046100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.046671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.046698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.047194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.047680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.047688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.048143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.048724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.048755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.049121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.049679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.049707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.050204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.050709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.050736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.652 qpair failed and we were unable to recover it. 00:31:30.652 [2024-05-14 04:28:45.051207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.652 [2024-05-14 04:28:45.051665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.051672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.052129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.052687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.052715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.053188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.053563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.053591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.054054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.054526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.054554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.055012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.055559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.055586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.056103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.056668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.056695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.057171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.057832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.057859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.058498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.058749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.058766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.059128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.059704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.059732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.060204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.060664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.060671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.061148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.061716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.061744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.062250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.062811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.062839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.063316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.063805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.063812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.064196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.064749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.064756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.065203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.065686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.065692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.066147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.066772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.066799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.067274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.067857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.067885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.068502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.069001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.069011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.069642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.070165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.070174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.070659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.071128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.071136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.071691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.072191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.072200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.072768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.073268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.073277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.073827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.074302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.074309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.074782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.075241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.075247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.653 qpair failed and we were unable to recover it. 00:31:30.653 [2024-05-14 04:28:45.075715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.076079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.653 [2024-05-14 04:28:45.076086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.076633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.077130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.077139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.077687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.078193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.078202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.078765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.079224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.079233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.079716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.080189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.080196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.080774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.081185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.081195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.081691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.082228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.082235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.082816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.083507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.083534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.083763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.084218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.084226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.084489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.085031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.085038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.085448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.085928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.085935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.086391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.086864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.086871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.087331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.087827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.087834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.088177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.088650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.088658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.089218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.089595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.089602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.090062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.090391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.090398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.090839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.091305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.091312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.091666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.092159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.092166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.092768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.093769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.093788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.093996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.094573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.094601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.095127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.095721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.095749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.096737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.097205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.097213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.097834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.098497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.098525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.099024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.099602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.099630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.100101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.100674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.100702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.101171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.101639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.101667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.102143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.102725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.102752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.103300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.103847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.103874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.104499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.105005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.105015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.105571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.106066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.654 [2024-05-14 04:28:45.106074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.654 qpair failed and we were unable to recover it. 00:31:30.654 [2024-05-14 04:28:45.106622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.107118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.107127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.107598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.108008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.108017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.108611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.109111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.109121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.109716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.110205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.110214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.110695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.111061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.111071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.111671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.112170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.112178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.112719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.113191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.113198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.113684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.114149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.114155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.114707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.115206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.115215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.115841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.116505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.116532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.117058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.117610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.117637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.118118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.118724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.118752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.119224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.119809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.119836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.120502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.121078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.121087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.121656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.122154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.122164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.122719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.123215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.123224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.123838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.124520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.124548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.125023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.125572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.125600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.126102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.126599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.126627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.127100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.127554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.127581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.128049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.128608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.128635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.129148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.129708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.129736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.130206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.130784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.130812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.131195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.131661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.131669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.132123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.132684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.132711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.133215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.133556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.133583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.134140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.134715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.134743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.135217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.135785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.135813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.136195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.136742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.136749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.655 qpair failed and we were unable to recover it. 00:31:30.655 [2024-05-14 04:28:45.137202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.137652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.655 [2024-05-14 04:28:45.137679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.138153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.138728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.138756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.139228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.139807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.139834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.140059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.140613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.140640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.141135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.141768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.141795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.142505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.143011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.143020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.143559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.144113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.144122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.144732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.145315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.145333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.145729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.146076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.146083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.146612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.147070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.147076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.147623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.148118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.148127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.148685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.149189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.149198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.149764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.150259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.150268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.150729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.151099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.151109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.151681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.152163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.152172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.152623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.153116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.153123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.153670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.154132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.154142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.154703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.155200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.155209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.155772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.156274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.156284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.156846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.157537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.157564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.158069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.158699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.158726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.159229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.159791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.159819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.160202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.160672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.160679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.161132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.161685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.161713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.162214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.162762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.162790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.163174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.163673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.163681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.164142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.164706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.164733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.165282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.165872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.165900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.166517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.167090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.167099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.656 [2024-05-14 04:28:45.167709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.168081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.656 [2024-05-14 04:28:45.168090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.656 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.168684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.169180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.169190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.169764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.170260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.170269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.170758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.171220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.171228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.171786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.172264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.172274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.172843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.173498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.173526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.174008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.174584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.174611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.175137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.175609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.175637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.176161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.176723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.176750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.177222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.177780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.177808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.178502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.179003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.179012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.179567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.180064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.180073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.180634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.181129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.181138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.181724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.182210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.182219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.182826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.183499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.183526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.183995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.184549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.184576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.185049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.185649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.185677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.186068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.186620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.186647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.187125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.187682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.187710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.188178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.188657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.188664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.189122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.189716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.189744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.190218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.190762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.190789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.191025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.191609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.191636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.192134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.192688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.192716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.193215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.193776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.193804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.194299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.194624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.194652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.195126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.195687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.195717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.196088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.196681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.196709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.657 qpair failed and we were unable to recover it. 00:31:30.657 [2024-05-14 04:28:45.197179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.197673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.657 [2024-05-14 04:28:45.197681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.198075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.198658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.198686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.199067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.199630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.199657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.200128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.200640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.200668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.201162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.201643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.201670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.202140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.202623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.202630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.203093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.203641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.203669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.204167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.204803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.204830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.205276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.205757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.205788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.206258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.206856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.206883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.207481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.207981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.207990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.208200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.208718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.208725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.209225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.209780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.209808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.210272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.210757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.210784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.211256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.211834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.211862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.212244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.212778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.212806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.213314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.213827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.213834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.214327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.214805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.214812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.215266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.215730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.215741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.216203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.216666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.216672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.217133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.217682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.217711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.218272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.218811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.218839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.219495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.219895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.219904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.220528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.221025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.221034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.221582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.222075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.222086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.222666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.223161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.223170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.658 qpair failed and we were unable to recover it. 00:31:30.658 [2024-05-14 04:28:45.223632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.658 [2024-05-14 04:28:45.224102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.224108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.659 qpair failed and we were unable to recover it. 00:31:30.659 [2024-05-14 04:28:45.224561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.225051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.225060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.659 qpair failed and we were unable to recover it. 00:31:30.659 [2024-05-14 04:28:45.225613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.226112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.226125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.659 qpair failed and we were unable to recover it. 00:31:30.659 [2024-05-14 04:28:45.226736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.227242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.227251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.659 qpair failed and we were unable to recover it. 00:31:30.659 [2024-05-14 04:28:45.227833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.228498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.228526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.659 qpair failed and we were unable to recover it. 00:31:30.659 [2024-05-14 04:28:45.229017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.229574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.229602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.659 qpair failed and we were unable to recover it. 00:31:30.659 [2024-05-14 04:28:45.230046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.230711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.659 [2024-05-14 04:28:45.230727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.659 qpair failed and we were unable to recover it. 00:31:30.659 [2024-05-14 04:28:45.231199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.231767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.231795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.232268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.232848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.232876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.233162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.233734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.233761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.234284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.234839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.234866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.235502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.235991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.236000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.236524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.237017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.237028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.237617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.238077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.238086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.238717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.239209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.239218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.239773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.240262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.240271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.240858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.241460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.241488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.242016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.242490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.242518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.243015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.243514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.243542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.244010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.244563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.244591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.245064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.245620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.245648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.246145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.246670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.246697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.247077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.247634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.247661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.248124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.248582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.248609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.249083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.249612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.249639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.250117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.250674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.250701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.251197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.251656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.251685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.252161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.252705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.252732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.253212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.253657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.253684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.253898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.254342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.254349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.254782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.255285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.255296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.926 qpair failed and we were unable to recover it. 00:31:30.926 [2024-05-14 04:28:45.255629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.256086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.926 [2024-05-14 04:28:45.256093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.256679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.257168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.257177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.257395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.257714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.257722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.258190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.258666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.258673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.258798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.259347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.259355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.259797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.260281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.260288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.260760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.261213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.261220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.261671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.262125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.262133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.262703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.263077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.263086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.263534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.264023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.264033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.264584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.265080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.265089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.265716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.266209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.266218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.266742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.267201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.267207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.267637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.268082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.268093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.268696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.269188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.269197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.269678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.270133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.270139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.270696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.271188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.271198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.271809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.272314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.272330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.272795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.273137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.273145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.273721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.273992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.274002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.274492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.274949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.274956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.275413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.275896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.275902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.276119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.276594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.276603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.276926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.277431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.277437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.277791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.278277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.278284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.278748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.279197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.279204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.279671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.280170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.280177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.280629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.281079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.281085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.281661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.282064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.282073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.927 qpair failed and we were unable to recover it. 00:31:30.927 [2024-05-14 04:28:45.282565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.927 [2024-05-14 04:28:45.283059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.283069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.283613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.284101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.284110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.284663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.285155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.285164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.285755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.286158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.286167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.286596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.286850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.286865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.287482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.287975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.287985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.288445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.288792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.288799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.289253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.289793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.289801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.290243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.290701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.290708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.291202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.291829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.291857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.292483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.292971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.292980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.293530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.293778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.293791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.294168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.294718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.294725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.294945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.295416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.295423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.295750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.296242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.296248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.296707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.297161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.297168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.297678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.298237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.298246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.298717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.298962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.298969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.299576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.300067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.300076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.300628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.300895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.300905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.301389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.301820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.301827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.302307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.302756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.302763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.303092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.303587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.303594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.304038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.304494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.304500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.304933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.305384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.305397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.305915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.306256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.306263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.306722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.307147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.307155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.307703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.308192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.308201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.308804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.309298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.309308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.928 qpair failed and we were unable to recover it. 00:31:30.928 [2024-05-14 04:28:45.309765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.928 [2024-05-14 04:28:45.310220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.310227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.310797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.311200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.311210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.311774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.312144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.312155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.312729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.313235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.313244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.313836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.314528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.314557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.314707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.315206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.315213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.315672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.316127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.316133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.316574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.317059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.317069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.317696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.318183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.318192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.318723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.319096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.319103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.319651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.320134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.320145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.320728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.321042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.321052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.321644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.322138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.322148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.322736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.323226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.323236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.323809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.324506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.324533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.325068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.325648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.325675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.326167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.326720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.326748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.327212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.327748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.327776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.328252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.328782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.328809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.329284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.329799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.329827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.330527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.331025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.331035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.331528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.332026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.332036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.332610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.333106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.333115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.333737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.334279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.334287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.334799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.335318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.335336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.335921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.336515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.336542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.336920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.337382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.337389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.337868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.338329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.338336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.338819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.339279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.339285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.929 qpair failed and we were unable to recover it. 00:31:30.929 [2024-05-14 04:28:45.339674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.929 [2024-05-14 04:28:45.340159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.340165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.340767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.341285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.341301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.341934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.342520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.342548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.343059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.343566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.343593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.344096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.344671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.344699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.345175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.345765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.345792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.346271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.346819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.346847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.347523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.348022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.348031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.348519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.349013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.349023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.349531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.350036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.350045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.350547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.351056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.351064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.351537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.352037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.352048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.352644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.353144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.353152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.353726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.353984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.353997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.354373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.354868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.354875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.355341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.355893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.355903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.356450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.356795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.356802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.357285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.357774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.357781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.358171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.358780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.358808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.359464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.359878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.359887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.360262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.360637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.360644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.360919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.361458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.361465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.361934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.362415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.362421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.362944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.363445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.930 [2024-05-14 04:28:45.363452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.930 qpair failed and we were unable to recover it. 00:31:30.930 [2024-05-14 04:28:45.363763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.364225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.364233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.364625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.365129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.365139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.365759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.366264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.366273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.366668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.367182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.367189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.367617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.368113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.368123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.368719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.369216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.369225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.369855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.370222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.370231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.370789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.371284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.371300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.371642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.372018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.372025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.372556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.373073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.373083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.373749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.374255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.374265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.374693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.375182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.375195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.375674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.376169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.376177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.376544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.376916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.376923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.377412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.377763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.377772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.378133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.378537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.378544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.379025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.379521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.379549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.380020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.380581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.380609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.380882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.381391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.381398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.381874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.382394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.382400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.382736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.383230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.383236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.383749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.384189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.384199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.384577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.385036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.385043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.385547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.386008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.386015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.386607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.387105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.387114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.387683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.388181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.388191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.388739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.389247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.389254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.389743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.390255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.390264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.390824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.391304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.931 [2024-05-14 04:28:45.391315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.931 qpair failed and we were unable to recover it. 00:31:30.931 [2024-05-14 04:28:45.391811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.392276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.392283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.392760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.393228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.393235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.393755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.394249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.394259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.394837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.395479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.395506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.395854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.396330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.396338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.396818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.397280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.397287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.397795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.398261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.398268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.398832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.399229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.399238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.399709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.400196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.400205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.400682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.401162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.401169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.401744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.402246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.402255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.402581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.403135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.403146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.403715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.404214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.404223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.404671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.405164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.405173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.405683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.406142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.406149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.406716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.407087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.407096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.407325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.407665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.407674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.408149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.408713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.408741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.409212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.409585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.409592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.410114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.410564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.410591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.411058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.411656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.411683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.412153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.412772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.412799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.413303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.413780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.413787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.414247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.414767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.414774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.415144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.415702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.415729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.416200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.416772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.416799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.417301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.417856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.417883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.418504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.419002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.419010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.419485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.419970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.419980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.932 qpair failed and we were unable to recover it. 00:31:30.932 [2024-05-14 04:28:45.420499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.932 [2024-05-14 04:28:45.420989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.420998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.421547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.422056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.422065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.422615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.423112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.423121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.423607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.424097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.424106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.424580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.425100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.425109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.425681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.426093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.426102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.426680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.427180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.427189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.427737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.428232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.428242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.428709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.429171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.429178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.429663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.430128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.430135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.430685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.431181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.431190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.431812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.432454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.432481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.432588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.433064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.433071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.433577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.434077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.434083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.434638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.435132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.435140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.435695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.436060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.436071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.436636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.436889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.436903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.437414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.437906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.437913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.438368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.438745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.438752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.439038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.439220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.439230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.439748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.440264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.440271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.440630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.441126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.441133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.441605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.442107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.442116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.442707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.443254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.443263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.443810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.444456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.444483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.444955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.445512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.445539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.446037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.446591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.446618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.447172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.447733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.447760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.448244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.448797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.448825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.933 [2024-05-14 04:28:45.449303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.449780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.933 [2024-05-14 04:28:45.449787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.933 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.450249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.450720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.450727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.451187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.451673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.451680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.452045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.452600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.452627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.453134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.453716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.453743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.454242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.454801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.454828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.455300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.455811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.455818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.456282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.456410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.456422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.456972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.457437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.457444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.457906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.458378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.458385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.458887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.459343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.459350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.459717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.460206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.460213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.460609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.461085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.461091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.461573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.462080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.462087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.462642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.463136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.463145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.463722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.464269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.464278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.464872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.465481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.465508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.465985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.466539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.466566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.467039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.467595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.467621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.468095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.468644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.468672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.469141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.469722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.469749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.469976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.470452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.470480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.470951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.471421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.471429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.471914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.472413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.472420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.472876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.473340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.473347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.473808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.474273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.474280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.474741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.475204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.475211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.475692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.476085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.476092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.476671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.477072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.477080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.477665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.478109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.934 [2024-05-14 04:28:45.478118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.934 qpair failed and we were unable to recover it. 00:31:30.934 [2024-05-14 04:28:45.478673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.479173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.479182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.479690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.480228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.480235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.480705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.481207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.481216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.481726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.482180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.482187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.482803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.483315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.483332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.483797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.484264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.484270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.484723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.485183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.485190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.485667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.486166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.486173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.486733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.487236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.487245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.487834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.488465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.488492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.488990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.489559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.489587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.489929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.490450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.490477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.490951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.491297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.491304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.491766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.492245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.492251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.492803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.493299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.493308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.493767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.494261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.494269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.494812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.495256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.495265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.495827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.496467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.496494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.496989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.497547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.497575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.497796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.498153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.498160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.498615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.499080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.499086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.499636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.500134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.500144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.500614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.501009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.501018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.501587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.502087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.502096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.502644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.503161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.503170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.935 qpair failed and we were unable to recover it. 00:31:30.935 [2024-05-14 04:28:45.503640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.504151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.935 [2024-05-14 04:28:45.504160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.936 qpair failed and we were unable to recover it. 00:31:30.936 [2024-05-14 04:28:45.504713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.936 [2024-05-14 04:28:45.505220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.936 [2024-05-14 04:28:45.505229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.936 qpair failed and we were unable to recover it. 00:31:30.936 [2024-05-14 04:28:45.505845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.936 [2024-05-14 04:28:45.506469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.936 [2024-05-14 04:28:45.506497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.936 qpair failed and we were unable to recover it. 00:31:30.936 [2024-05-14 04:28:45.506984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.936 [2024-05-14 04:28:45.507561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:30.936 [2024-05-14 04:28:45.507588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:30.936 qpair failed and we were unable to recover it. 00:31:30.936 [2024-05-14 04:28:45.508160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.508732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.508760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.509228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.509802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.509829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.510066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.510660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.510687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.511153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.511713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.511740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.512211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.512805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.512832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.513452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.513939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.513948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.514540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.515033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.515046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.515534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.516029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.516039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.516587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.517075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.517084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.517720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.518223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.518232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.518684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.519146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.519153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.519698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.520190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.520199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.520779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.521150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.521159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.204 [2024-05-14 04:28:45.521580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.522156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.204 [2024-05-14 04:28:45.522167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.204 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.522611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.523072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.523078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.523622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.524120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.524129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.524677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.525042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.525056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.525621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.526138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.526146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.526703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.527102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.527111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.527661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.528166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.528175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.528631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.529093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.529100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.529644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.530135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.530145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.530520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.531011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.531023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.531586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.532086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.532095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.532645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.533143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.533153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.533809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.534315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.534332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.534787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.535248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.535258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.535593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.535955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.535962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.536545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.537073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.537083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.537672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.538170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.538179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.538640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.539108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.539114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.539656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.540148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.540157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.540708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.541204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.541213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.541726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.542258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.542268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.542871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.543474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.543502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.543978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.544526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.544554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.545028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.545485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.545512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.546032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.546258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.546269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.546760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.547218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.547224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.547676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.548177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.548183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.548635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.549135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.549142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.549725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.550224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.550233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.205 qpair failed and we were unable to recover it. 00:31:31.205 [2024-05-14 04:28:45.550786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.205 [2024-05-14 04:28:45.551278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.551287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.551782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.552473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.552500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.552721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.553204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.553211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.553681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.554149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.554155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.554709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.555213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.555222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.555701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.556161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.556167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.556714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.557208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.557217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.557834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.558476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.558503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.559049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.559605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.559632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.560101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.560661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.560688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.561165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.561735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.561762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.562259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.562855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.562882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.563483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.563980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.563989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.564535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.565035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.565044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.565255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.565728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.565736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.566204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.566750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.566757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.567103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.567651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.567678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.568059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.568662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.568689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.569163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.569733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.569760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.570250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.570815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.570842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.571491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.572001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.572010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.572578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.573149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.573159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.573735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.574239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.574248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.574733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.575237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.575245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.575773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.576175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.576184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.576598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.577067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.577073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.577669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.578156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.578166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.578766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.579267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.579276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.579748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.580503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.580530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.206 qpair failed and we were unable to recover it. 00:31:31.206 [2024-05-14 04:28:45.581006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.206 [2024-05-14 04:28:45.581582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.581609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.582092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.582543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.582570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.582955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.583555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.583583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.584130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.584684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.584712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.585187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.585767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.585774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.586137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.586739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.586766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.587288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.587876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.587903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.588548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.588917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.588926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.589526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.589886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.589895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.590382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.590847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.590854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.591328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.591834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.591841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.592298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.592795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.592802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.593255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.593894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.593922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.594541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.595047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.595056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.595699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.596067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.596076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.596714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.597084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.597095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.597655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.598034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.598043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.598617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.599202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.599211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.599674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.600180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.600187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.600665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.601128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.601134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.601698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.602102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.602111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.602710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.602969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.602983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.603572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.604071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.604081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.604748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.605183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.605192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.605729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.605956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.605967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.606479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.606946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.606953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.607418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.607889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.607895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.608366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.608875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.608881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.609342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.609729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.609735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.207 qpair failed and we were unable to recover it. 00:31:31.207 [2024-05-14 04:28:45.610194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.207 [2024-05-14 04:28:45.610694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.610701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.611164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.611721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.611749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.612254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.612827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.612855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.613237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.613785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.613813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.614492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.614954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.614963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.615552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.615965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.615974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.616337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.616740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.616746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.617268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.617661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.617668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.618135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.618587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.618614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.619141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.619626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.619654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.620016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.620595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.620623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.620946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.621439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.621446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.621927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.622386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.622393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.622926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.623420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.623427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.623810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.624185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.624191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.624678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.625015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.625022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.625478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.625939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.625946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.626405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.626872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.626879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.627385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.627725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.627732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.628227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.628460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.628467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.628752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.629237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.629243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.629616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.629964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.629970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.630345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.630831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.630838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.631176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.631631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.631638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.632138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.632700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.632728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.633101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.633664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.633691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.634091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.634558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.634585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.208 qpair failed and we were unable to recover it. 00:31:31.208 [2024-05-14 04:28:45.635123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.635681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.208 [2024-05-14 04:28:45.635708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.636187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.636776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.636804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.637515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.638012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.638021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.638501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.638869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.638878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.639342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.639828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.639835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.640208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.640698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.640705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.641242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.641712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.641719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.642172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.642727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.642756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.643242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.643566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.643595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.644069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.644704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.644731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.644959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.645344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.645353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.645731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.646205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.646212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.646694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.647026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.647034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.647518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.647904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.647911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.648372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.648841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.648848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.649313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.649769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.649776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.650166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.650641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.650648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.650864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.651354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.651361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.651803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.652137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.652144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.652613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.652951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.652957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.653322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.653815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.653823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.654161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.654667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.654674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.655130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.655735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.655762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.656471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.657029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.657038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.657621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.658119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.658128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.658712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.659214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.659223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.209 qpair failed and we were unable to recover it. 00:31:31.209 [2024-05-14 04:28:45.659756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.209 [2024-05-14 04:28:45.660302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.660312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.660521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.660728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.660738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.661237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.661632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.661639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.662132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.662646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.662673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.663143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.663719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.663749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.664253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.664849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.664877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.665499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.666052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.666061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.666657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.667156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.667165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.667781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.668283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.668296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.668885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.669495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.669522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.669995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.670443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.670470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.670949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.671547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.671574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.672023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.672250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.672262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.672631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.673062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.673069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.673626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.674121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.674133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.674683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.675180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.675189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.675663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.676154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.676160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.676723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.677222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.677231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.677784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.678468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.678495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.678971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.679571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.679599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.680103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.680676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.680703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.681199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.681686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.681693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.682078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.682668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.682695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.683165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.683731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.683759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.684268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.684847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.684878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.685455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.685949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.685958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.686506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.687004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.687013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.687562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.688049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.688059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.688553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.689052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.689061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.210 [2024-05-14 04:28:45.689625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.690016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.210 [2024-05-14 04:28:45.690025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.210 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.690652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.691139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.691148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.691698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.692195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.692204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.692757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.693258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.693268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.693830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.694458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.694485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.694956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.695511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.695541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.696006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.696606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.696633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.697108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.697661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.697688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.698163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.698724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.698752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.699230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.699783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.699810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.700282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.700855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.700883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.701479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.701971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.701979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.702569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.703067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.703077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.703654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.704171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.704179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.704653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.704992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.704999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.705594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.706091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.706100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.706654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.707151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.707160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.707730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.708214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.708223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.708791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.709279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.709288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.709837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.710451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.710479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.710990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.711507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.711534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.712003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.712485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.712513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.712984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.713484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.713491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.713944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.714492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.714519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.715062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.715642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.715669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.716143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.716709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.716736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.717208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.717851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.717879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.718492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.718990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.719000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.719591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.720090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.720099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.720675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.721177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.721186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.211 qpair failed and we were unable to recover it. 00:31:31.211 [2024-05-14 04:28:45.721728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.211 [2024-05-14 04:28:45.722192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.722198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.722774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.723265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.723274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.723879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.724485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.724512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.724862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.725357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.725364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.725815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.726295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.726302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.726777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.727146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.727153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.727745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.728243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.728252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.728800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.729014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.729027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.729533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.729998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.730005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.730564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.731059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.731067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.731618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.731983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.731994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.732569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.733072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.733081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.733636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.734136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.734144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.734714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.735212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.735221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.735782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.736288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.736302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.736783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.737022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.737034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.737647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.738180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.738190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.738726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.739183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.739189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.739811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.740313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.740330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.740706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.741196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.741203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.741723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.742190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.742196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.742666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.743154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.743161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.743724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.744224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.744233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.744792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.745288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.745302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.745841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.746206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.746217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.746783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.747465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.747492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.747712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.748199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.748206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.748686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.749194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.749200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.749692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.750153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.750159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.212 qpair failed and we were unable to recover it. 00:31:31.212 [2024-05-14 04:28:45.750729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.212 [2024-05-14 04:28:45.751229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.751238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.751694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.752189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.752199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.752684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.753150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.753157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.753757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.754261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.754269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.754888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.755486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.755513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.755985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.756485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.756512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.756982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.757492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.757519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.757982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.758547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.758574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.759074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.759630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.759657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.759877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.760378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.760386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.760914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.761365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.761372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.761848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.762334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.762341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.762806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.763285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.763304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.763747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.764209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.764215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.764585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.765040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.765046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.765612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.766016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.766025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.766622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.767110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.767119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.767666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.768158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.768166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.768722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.769230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.769240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.769807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.770509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.770536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.771036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.771583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.771610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.772107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.772711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.772738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.773126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.773723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.773750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.774218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.774834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.774862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.775489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.775993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.776002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.213 qpair failed and we were unable to recover it. 00:31:31.213 [2024-05-14 04:28:45.776554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.213 [2024-05-14 04:28:45.777051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.777059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.214 qpair failed and we were unable to recover it. 00:31:31.214 [2024-05-14 04:28:45.777605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.778100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.778109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.214 qpair failed and we were unable to recover it. 00:31:31.214 [2024-05-14 04:28:45.778694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.779192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.779201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.214 qpair failed and we were unable to recover it. 00:31:31.214 [2024-05-14 04:28:45.779689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.780152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.780159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.214 qpair failed and we were unable to recover it. 00:31:31.214 [2024-05-14 04:28:45.780710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.781278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.781287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.214 qpair failed and we were unable to recover it. 00:31:31.214 [2024-05-14 04:28:45.781839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.782248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.782257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.214 qpair failed and we were unable to recover it. 00:31:31.214 [2024-05-14 04:28:45.782627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.783128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.783139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.214 qpair failed and we were unable to recover it. 00:31:31.214 [2024-05-14 04:28:45.783685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.784180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.214 [2024-05-14 04:28:45.784189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.214 qpair failed and we were unable to recover it. 00:31:31.214 [2024-05-14 04:28:45.784812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.785303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.785316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.502 qpair failed and we were unable to recover it. 00:31:31.502 [2024-05-14 04:28:45.785684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.786188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.786198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.502 qpair failed and we were unable to recover it. 00:31:31.502 [2024-05-14 04:28:45.786690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.787234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.787244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.502 qpair failed and we were unable to recover it. 00:31:31.502 [2024-05-14 04:28:45.787732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.788195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.788201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.502 qpair failed and we were unable to recover it. 00:31:31.502 [2024-05-14 04:28:45.788680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.789216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.789223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.502 qpair failed and we were unable to recover it. 00:31:31.502 [2024-05-14 04:28:45.789782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.502 [2024-05-14 04:28:45.789936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.789950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.790458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.790961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.790968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.791423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.791887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.791893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.792359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.792819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.792825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.793281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.793738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.793745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.794224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.794710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.794717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.795172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.795555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.795582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.796086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.796644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.796671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.797152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.797601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.797628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.798153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.798601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.798629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.799127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.799603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.799630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.800126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.800714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.800741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.801214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.801774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.801801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.802270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.802894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.802922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.803558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.804050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.804058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.804606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.805114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.805123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.805717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.806219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.806228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.806790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.807297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.807306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.807848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.808260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.808270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.808861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.809275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.809284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.809871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.810270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.810279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.810782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.811246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.811253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.811814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.812458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.812486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.812987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.813539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.813566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.814040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.814641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.814668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.815142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.815699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.815726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.816223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.816790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.816817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.817040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.817528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.817536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.817992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.818595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.818622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.503 [2024-05-14 04:28:45.819089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.819642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.503 [2024-05-14 04:28:45.819669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.503 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.820172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.820541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.820568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.821073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.821638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.821666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.822145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.822729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.822757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.823287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.823883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.823910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.824480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.825045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.825053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.825608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.825981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.825992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.826513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.827025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.827034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.827607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.827861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.827875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.828404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.828876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.828882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.829347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.829863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.829873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.830333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.830808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.830815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.831275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.831752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.831759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.832294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.832750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.832756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.833251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.833849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.833877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.834505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.835003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.835012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.835565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.836066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.836075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.836635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.837135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.837143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.837695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.838200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.838209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.838751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.839159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.839169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.839631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.840015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.840026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.840607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.841164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.841173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.841553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.842003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.842009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.842503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.842998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.843005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.843480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.843935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.843944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.844069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.844547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.844555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.844952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.845402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.845409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.845913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.846374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.846381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.846930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.847391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.847398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.847881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.848253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.848259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.504 qpair failed and we were unable to recover it. 00:31:31.504 [2024-05-14 04:28:45.848616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.504 [2024-05-14 04:28:45.849071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.849082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.849660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.850156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.850165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.850776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.851039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.851061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.851670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.852237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.852246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.852722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.853102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.853108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.853655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.854147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.854157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.854735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.855113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.855123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.855595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.856091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.856100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.856570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.857093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.857102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.857568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.858076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.858085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.858525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.859023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.859035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.859640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.860071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.860080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.860552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.861059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.861068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.861643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.862150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.862159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.862767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.863176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.863185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.863753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.864251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.864260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.864833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.865507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.865535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.866011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.866580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.866608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.867085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.867648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.867675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.868020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.868603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.868630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.869006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.869506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.869534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.869918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.870240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.870246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.870606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.871066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.871072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.871628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.872127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.872136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.872638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.873005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.873014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.873574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.874078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.874086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.874751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.875258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.875267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.875883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.876500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.876528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.877076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.877635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.505 [2024-05-14 04:28:45.877662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.505 qpair failed and we were unable to recover it. 00:31:31.505 [2024-05-14 04:28:45.878214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.878767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.878794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.879265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.879861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.879888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.880267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.880802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.880830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.881508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.882010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.882019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.882518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.883027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.883036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.883285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.883893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.883921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.884149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.884620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.884647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.885197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.885687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.885694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.885952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.886522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.886550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.886872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.887345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.887352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.887838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.888343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.888350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.888811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.889272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.889279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.889749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.890206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.890212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.890568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.891071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.891077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.891703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.892209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.892219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.892713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.893197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.893204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.893780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.894275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.894285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.894773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.895288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.895299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.895634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.896143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.896154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.896728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.897104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.897113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.897747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.898468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.898495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.898924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.899298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.899305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.899682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.900129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.900137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.900598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.900995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.901004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.901554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.902050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.902059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.902628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.903123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.903131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.903681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.904177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.904186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.904802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.905298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.905308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.905790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.906263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.906270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.506 qpair failed and we were unable to recover it. 00:31:31.506 [2024-05-14 04:28:45.906868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.506 [2024-05-14 04:28:45.907485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.907512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.908047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.908595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.908623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.909000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.909541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.909568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.909922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.910525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.910552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.911012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.911420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.911427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.911890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.912357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.912364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.912813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.913276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.913282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.913660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.914068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.914075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.914661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.915155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.915164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.915730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.916223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.916232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.916806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.917482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.917509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.917975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.918530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.918558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.918937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.919448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.919455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.919821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.920178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.920186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.920654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.921026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.921033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.921489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.921946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.921953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.922331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.922832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.922838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.923334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.923808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.923814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.924276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.924770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.924778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.925139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.925559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.925587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.926075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.926666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.926694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.927167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.927640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.927667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.928145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.928743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.928770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.928992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.929469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.929501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.507 [2024-05-14 04:28:45.929966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.930429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.507 [2024-05-14 04:28:45.930436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.507 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.930919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.931381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.931388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.931858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.932318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.932325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.932655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.933138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.933146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.933624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.934124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.934131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.934699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.935194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.935203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.935694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.936153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.936159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.936706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.937205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.937214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.937729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.938173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.938183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.938687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.939075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.939083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.939662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.940157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.940166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.940778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.941279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.941287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.941837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.942514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.942542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.942882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.943493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.943521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.944029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.944630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.944657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.945120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.945657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.945685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.946160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.946731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.946759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.947230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.947831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.947859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.948486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.948981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.948991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.949558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.950055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.950065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.950285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.950682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.950690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.951245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.951686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.951694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.952147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.952703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.952730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.953199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.953771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.953798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.954267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.954886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.954914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.955140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.955669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.955696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.956168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.956796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.956823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.957298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.957877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.957904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.958469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.958966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.958975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.959192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.959658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.959667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.508 qpair failed and we were unable to recover it. 00:31:31.508 [2024-05-14 04:28:45.960120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.508 [2024-05-14 04:28:45.960672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.960699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.961178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.961654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.961661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.962118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.962699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.962726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.963219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.963752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.963779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.964248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.964827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.964854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.965238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.965796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.965823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.966296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.966860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.966887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.967471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.968037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.968046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.968597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.969092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.969101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.969650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.970146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.970155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.970740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.971234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.971244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.971800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.972453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.972480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.972977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.973577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.973604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.974131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.974683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.974710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.975181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.975770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.975797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.976306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.976786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.976792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.977253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.977846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.977873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.978453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.978952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.978960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.979517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.979898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.979906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.980503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.980989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.981001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.981507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.982012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.982019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.982579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.983076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.983085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.983695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.984190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.984199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.984717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.985176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.985183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.985634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.986093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.986099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.986647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.987180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.987190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.987679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.988143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.988150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.988696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.989087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.989096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.989725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.990211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.990220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.509 qpair failed and we were unable to recover it. 00:31:31.509 [2024-05-14 04:28:45.990780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.991280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.509 [2024-05-14 04:28:45.991304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:45.991862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.992451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.992478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:45.992986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.993551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.993578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:45.994079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.994677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.994705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:45.995271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.995844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.995871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:45.996515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.996881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.996890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:45.997466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.997960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.997969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:45.998426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.998891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.998898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:45.999363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.999741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:45.999748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.000200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.000702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.000710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.001202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.001673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.001683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.002136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.002689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.002716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.003192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.003695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.003702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.004156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.004706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.004733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.005203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.005771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.005798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.006298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.006882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.006909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.007296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.007818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.007845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.008502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.008998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.009007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.009581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.010085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.010094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.010696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.011190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.011199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.011774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.012270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.012283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.012739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.013196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.013203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.013761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.014166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.014175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.014672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.014902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.014914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.015385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.015866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.015873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.016328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.016792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.016799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.017173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.017629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.017636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.018011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.018598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.018626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.019099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.019675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.019703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.510 [2024-05-14 04:28:46.020192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.020684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.510 [2024-05-14 04:28:46.020691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.510 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.021183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.021627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.021634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.022093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.022663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.022691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.023170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.023604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.023632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.023996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.024599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.024626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.025132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.025685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.025712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.026225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.026784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.026812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.027283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.027856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.027883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.028490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.028978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.028988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.029538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.030036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.030045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.030606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.031178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.031187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.031642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.032141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.032147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.032621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.032880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.032894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.033412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.033913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.033920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.034376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.034834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.034841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.035333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.035717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.035723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.036174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.036632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.036639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.037140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.037530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.037557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.038052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.038599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.038627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.039098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.039664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.039691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.040164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.040734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.040762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.041266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.041843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.041870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.042468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.042966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.042974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.043610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.044105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.044114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.044663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.045152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.045161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.045715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.046217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.046227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.511 qpair failed and we were unable to recover it. 00:31:31.511 [2024-05-14 04:28:46.046788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.511 [2024-05-14 04:28:46.047237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.047245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.047839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.048440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.048468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.048822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.049027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.049038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.049280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.049777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.049784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.050237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.050697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.050704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.051196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.051667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.051673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.052127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.052594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.052622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.053163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.053726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.053753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.054245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.054872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.054899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.055461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.055961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.055969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.056521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.057025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.057034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.057587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.058124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.058134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.058728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.059232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.059241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.059792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.060304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.060313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.060807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.061464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.061492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.061991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.062469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.062497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.062997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.063456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.063483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.064013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.064567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.064594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.064999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.065591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.065619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.066086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.066322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.066336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.066824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.067287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.067297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.067769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.068270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.068276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.068857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.069448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.069475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.069974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.070496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.070523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.071020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.071578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.071606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.072081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.072567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.072595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.073066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.073655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.073682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.074189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.074681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.074689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.075149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.075866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.075894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.512 [2024-05-14 04:28:46.076276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.076869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.512 [2024-05-14 04:28:46.076897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.512 qpair failed and we were unable to recover it. 00:31:31.513 [2024-05-14 04:28:46.077497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.078014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.078022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.513 qpair failed and we were unable to recover it. 00:31:31.513 [2024-05-14 04:28:46.078565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.079092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.079101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.513 qpair failed and we were unable to recover it. 00:31:31.513 [2024-05-14 04:28:46.079664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.080115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.080124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.513 qpair failed and we were unable to recover it. 00:31:31.513 [2024-05-14 04:28:46.080673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.081174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.081182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.513 qpair failed and we were unable to recover it. 00:31:31.513 [2024-05-14 04:28:46.081616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.082161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.082170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.513 qpair failed and we were unable to recover it. 00:31:31.513 [2024-05-14 04:28:46.082665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.083125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.083133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.513 qpair failed and we were unable to recover it. 00:31:31.513 [2024-05-14 04:28:46.083611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.084008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.513 [2024-05-14 04:28:46.084017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.513 qpair failed and we were unable to recover it. 00:31:31.513 [2024-05-14 04:28:46.084589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.781 [2024-05-14 04:28:46.085084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.781 [2024-05-14 04:28:46.085095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.781 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.085638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.086191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.086200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.086678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.087147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.087154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.087717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.088217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.088226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.088865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.089498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.089525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.090006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.090579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.090606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.091084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.091704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.091731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.092224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.092785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.092813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.093258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.093820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.093848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.094229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.094837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.094865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.095248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.095795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.095822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.096503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.096907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.096916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.097250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.097740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.097747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.098198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.098674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.098682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.099059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.099673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.099700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.100245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.100818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.100846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.101045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.101659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.101687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.102104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.102710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.102738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.103125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.103499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.103506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.103969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.104565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.104592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.105074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.105693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.105721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.106217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.106780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.106807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.107190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.107668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.107675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.108139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.108701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.108729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.109201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.109744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.109772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.110317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.110800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.110807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.111177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.111634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.111640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.112107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.112702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.112730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.113254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.113734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.113742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.782 qpair failed and we were unable to recover it. 00:31:31.782 [2024-05-14 04:28:46.114206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.114778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.782 [2024-05-14 04:28:46.114805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.115250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.115697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.115725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.116228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.116574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.116581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.116983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.117545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.117572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.118044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.118621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.118649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.119049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.119611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.119639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.120142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.120742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.120770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.121161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.121523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.121551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.122027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.122518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.122545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.123044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.123606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.123633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.124148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.124720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.124747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.125217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.125682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.125710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.126181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.126672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.126679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.127142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.127753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.127781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.128285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.128744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.128772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.129257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.129823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.129850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.130464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.130836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.130845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.131504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.131998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.132007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.132586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.133079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.133089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.133660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.134155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.134164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.134771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.135268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.135277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.135823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.136526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.136554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.136896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.137124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.137136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.137597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.138095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.138104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.138617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.139111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.139120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.139594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.140070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.140077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.783 qpair failed and we were unable to recover it. 00:31:31.783 [2024-05-14 04:28:46.140627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.783 [2024-05-14 04:28:46.141122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.141131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.141697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.142192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.142201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.142769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.143270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.143279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.143842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.144495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.144522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.144992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.145533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.145564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.146024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.146571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.146598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.146824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.147311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.147319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.147780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.148242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.148248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.148700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.149161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.149168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.149662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.150159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.150167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.150733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.151217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.151226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.151848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.152067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.152080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.152579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.153043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.153051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.153599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.154097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.154106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.154654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.155151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.155164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.155722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.156207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.156216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.156788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.157287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.157302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.157875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.158457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.158484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.158958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.159518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.159545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.160090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.160644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.160671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.161165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.161730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.161757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.162305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.162770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.162777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.163232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.163696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.163703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.164209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.164684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.164691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.165185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.165773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.165803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.166280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.166865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.166892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.167458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.167965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.167974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.168570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.169070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.169079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.169632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.170127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.170136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.784 qpair failed and we were unable to recover it. 00:31:31.784 [2024-05-14 04:28:46.170358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.170817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.784 [2024-05-14 04:28:46.170825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.171203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.171671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.171678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.172136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.172686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.172713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.173215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.173774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.173801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.174271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.174825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.174852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.175078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.175631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.175661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.176128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.176677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.176705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.177175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.177812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.177840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.178225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.178755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.178782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.179253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.179851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.179878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.180512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.180886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.180895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.181483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.181979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.181988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.182544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.183040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.183049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.183572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.184058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.184068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.184659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.185225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.185235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.185722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.186235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.186243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.186855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.187384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.187394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.187897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.188486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.188513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.189020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.189600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.189627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.190127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.190690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.190717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.191103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.191340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.191353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.191830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.192313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.192328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.192810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.193339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.193346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.193806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.194306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.194313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.194775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.195233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.195239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.195452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.195895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.195902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.785 [2024-05-14 04:28:46.196357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.196825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.785 [2024-05-14 04:28:46.196832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.785 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.197315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.197775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.197781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.198234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.198755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.198761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.199223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.199659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.199666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.200158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.200711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.200739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.201114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.201663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.201690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.202163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.202636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.202663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.203046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.203607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.203634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.204133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.204696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.204723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.205224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.205786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.205813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.206045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.206512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.206539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.207011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.207616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.207643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.208193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.208631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.208638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.209097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.209650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.209677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.210147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.210703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.210731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.211298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.211840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.211867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.212453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.212945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.212954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.213518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.214019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.214028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.214594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.215096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.215105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.215660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.216150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.216160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.216765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.217312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.217329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.217833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.218301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.218308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.218771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.219233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.219240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.219795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.220295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.220305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.786 [2024-05-14 04:28:46.220849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.221472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.786 [2024-05-14 04:28:46.221501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.786 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.222001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.222554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.222581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.223045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.223601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.223628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.224097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.224649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.224676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.225197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.225684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.225691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.226153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.226706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.226733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.227207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.227772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.227799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.228171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.228763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.228790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.229153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.229729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.229756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.230224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.230570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.230597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.231073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.231675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.231702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.232175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.232723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.232731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.233184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.233686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.233713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.234211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.234679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.234686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.234907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.235397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.235404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.235861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.236197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.236205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.236674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.237134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.237140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.237698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.238199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.238207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.238680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.239140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.239147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.239693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.240175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.240184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.240677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.241171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.241181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.241717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.242084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.242091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.242659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.243225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.243234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.243689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.244159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.244165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.244715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.245209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.245217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.245841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.246452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.246479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.787 [2024-05-14 04:28:46.246949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.247505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.787 [2024-05-14 04:28:46.247532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.787 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.248002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.248561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.248588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.248951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.249339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.249346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.249665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.250156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.250163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.250632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.251103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.251110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.251673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.252162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.252171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.252580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.252693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.252704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.253251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.253706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.253713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.254177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.254728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.254756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.255229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.255604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.255611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.256066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.256666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.256693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.257186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.257681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.257688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.258081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.258641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.258668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.259144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.259704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.259732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.260230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.260787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.260814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.261470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.261964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.261974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.262528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.263027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.263036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.263634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.264129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.264138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.264685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.265092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.265102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.265688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.266189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.266198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.266684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.267067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.267074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.267528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.267990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.267996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.268455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.268679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.268691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.268970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.269467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.269474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.269933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.270392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.270399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.270914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.271250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.271257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.271727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.272138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.272145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.272745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.273235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.273244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.273788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.274287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.274304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.274772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.275234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.788 [2024-05-14 04:28:46.275240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.788 qpair failed and we were unable to recover it. 00:31:31.788 [2024-05-14 04:28:46.275740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.276106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.276115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.276784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.277278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.277287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.277865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.278475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.278503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.278993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.279576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.279603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.280100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.280583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.280610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.280987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.281547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.281575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.282057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.282593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.282621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.283118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.283667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.283694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.284165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.284622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.284649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.285157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.285719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.285746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.286221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.286782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.286809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.287283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.287847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.287875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.288459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.288960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.288969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.289571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.289822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.289837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.290352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.290822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.290829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.291281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.291740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.291747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.292200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.292671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.292677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.293139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.293706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.293734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.294115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.294706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.294733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.295205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.295773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.295800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.296314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.296781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.296788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.297247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.297697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.297704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.298156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.298711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.298739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.299222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.299787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.299814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.300457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.300954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.300963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.301540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.302038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.302048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.789 qpair failed and we were unable to recover it. 00:31:31.789 [2024-05-14 04:28:46.302622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.789 [2024-05-14 04:28:46.303132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.303141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.303364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.303849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.303858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.304312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.304768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.304774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.305227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.305739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.305745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.306211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.306687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.306697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.307171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.307725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.307752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.308251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.308846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.308874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.309484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.310022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.310031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.310576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.311126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.311135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.311683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.312175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.312185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.312764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.313253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.313262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 4149747 Killed "${NVMF_APP[@]}" "$@" 00:31:31.790 [2024-05-14 04:28:46.313921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.314182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.314196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.314571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 04:28:46 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:31:31.790 04:28:46 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:31:31.790 [2024-05-14 04:28:46.315033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.315041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 04:28:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:31.790 04:28:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:31.790 [2024-05-14 04:28:46.315636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 04:28:46 -- common/autotest_common.sh@10 -- # set +x 00:31:31.790 [2024-05-14 04:28:46.316138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.316147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.316721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.317162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.317171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.317653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.318107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.318114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.318749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.319304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.319315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.319781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.320244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.320252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.320743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.321134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.321142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.321624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.322085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.322095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.322693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 04:28:46 -- nvmf/common.sh@469 -- # nvmfpid=4150680 00:31:31.790 [2024-05-14 04:28:46.323228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.323239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 04:28:46 -- nvmf/common.sh@470 -- # waitforlisten 4150680 00:31:31.790 04:28:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:31:31.790 04:28:46 -- common/autotest_common.sh@819 -- # '[' -z 4150680 ']' 00:31:31.790 [2024-05-14 04:28:46.323834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 04:28:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:31.790 04:28:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:31.790 04:28:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:31.790 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:31.790 [2024-05-14 04:28:46.324507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.324537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 04:28:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:31.790 04:28:46 -- common/autotest_common.sh@10 -- # set +x 00:31:31.790 [2024-05-14 04:28:46.325039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.325232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.325244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.325611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.326031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.326039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.326463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.326927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.326935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.327405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.327884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.327892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.790 qpair failed and we were unable to recover it. 00:31:31.790 [2024-05-14 04:28:46.328391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.790 [2024-05-14 04:28:46.328912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.328920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.329410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.329873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.329881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.330365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.330847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.330855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.331234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.331722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.331730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.332107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.332601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.332629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.333170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.333710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.333742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.334221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.334665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.334693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.335168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.335705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.335733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.336082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.336615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.336643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.337115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.337687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.337714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.338184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.338677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.338704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.339175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.339651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.339658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.340202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.340719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.340726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.341191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.341415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.341428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.341962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.342411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.342418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.342899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.343359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.343369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.343839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.344297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.344306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.344780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.345252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.345259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.345738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.346235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.346244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.346797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.347300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.347309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.347769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.348250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.348257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.348808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.349314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.349332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.349803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.350270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.350276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.350799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.351255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.351261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.791 qpair failed and we were unable to recover it. 00:31:31.791 [2024-05-14 04:28:46.351855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.352503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.791 [2024-05-14 04:28:46.352530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.352826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.353259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.353270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.353754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.354126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.354133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.354711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.355200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.355210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.355776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.356274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.356284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.356860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.357521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.357548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.358060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.358568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.358596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.359084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.359553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.359581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.360058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.360627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.360654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.361149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.361713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:31.792 [2024-05-14 04:28:46.361741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:31.792 qpair failed and we were unable to recover it. 00:31:31.792 [2024-05-14 04:28:46.362217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.362814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.362843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.363487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.363992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.364005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.364554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.365057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.365066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.365632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.366131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.366140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.366675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.367176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.367185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.367662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.368129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.368136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.368737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.369234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.369243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.369377] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:31:32.062 [2024-05-14 04:28:46.369424] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:32.062 [2024-05-14 04:28:46.369836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.370511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.370539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.371078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.371563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.371590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.372062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.372655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.372682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.373181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.373667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.373675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.374185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.374736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.374764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.375261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.375744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.375751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.376212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.376506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.376535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.376761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.377003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.377013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.377500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.377971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.377978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.378341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.378839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.378847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.379332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.379830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.379839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.380338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.380557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.380566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.380987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.381206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.381213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.382205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.382699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.382708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.383165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.383689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.062 [2024-05-14 04:28:46.383696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.062 qpair failed and we were unable to recover it. 00:31:32.062 [2024-05-14 04:28:46.384153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.384617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.384624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.385124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.385653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.385667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.386176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.386672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.386679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.387056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.387501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.387509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.390268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.390790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.390799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.391260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.391775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.391782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.392234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.392662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.392670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.393128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.393603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.393611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.394074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.394578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.394585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.395111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.395678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.395706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.396198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.396730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.396738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.397188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.397716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.397723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.398220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.398760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.398787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.399268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.399758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.399786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.400245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.400814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.400843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 EAL: No free 2048 kB hugepages reported on node 1 00:31:32.063 [2024-05-14 04:28:46.401510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.401985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.401995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.402606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.403071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.403080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.403581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.403991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.404000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.404504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.405086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.405095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.405321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.405777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.405786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.406248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.406820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.406848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.407483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.408052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.408062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.408606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.409213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.409223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.409768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.410225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.410231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.410858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.411108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.411122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.411725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.412240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.412249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.412857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.413254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.413264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.413778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.414275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.414284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.063 [2024-05-14 04:28:46.414849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.415507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.063 [2024-05-14 04:28:46.415535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.063 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.416005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.416563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.416590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.417066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.417624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.417652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.418105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.418709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.418737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.419098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.419649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.419676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.420145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.420705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.420732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.421537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.422004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.422011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.422566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.422937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.422948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.423512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.424003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.424012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.424234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.424711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.424719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.425177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.425670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.425678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.426165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.426553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.426581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.427081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.427668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.427696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.428200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.428788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.428815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.429288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.429877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.429904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.430487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.430987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.430996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.431579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.432082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.432091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.432556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.433051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.433061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.433616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.434113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.434123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.434348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.434704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.434713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.435212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.435682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.435690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.436095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.436506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.436533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.437009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.437583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.437611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.438136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.438696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.438723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.439232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.439796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.439825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.440501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.440963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.440973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.441553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.442053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.442063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.442619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.443118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.443127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.443623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.444123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.444132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.444791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.445286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.064 [2024-05-14 04:28:46.445301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.064 qpair failed and we were unable to recover it. 00:31:32.064 [2024-05-14 04:28:46.445767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.446236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.446246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.446845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.447496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.447523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.448015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.448488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.448515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.449087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.449645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.449672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.450133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.450696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.450723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.451192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.451752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.451780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.452252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.452818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.452846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.453501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.454000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.454010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.454564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.454969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.454978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.455606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.455857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:32.065 [2024-05-14 04:28:46.456101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.456110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.456640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.457153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.457162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.457762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.458260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.458269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.458861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.459483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.459511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.459982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.460597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.460625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.461093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.461676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.461704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.462175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.462655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.462664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.463053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.463646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.463674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.464154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.464738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.464765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.465282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.465905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.465932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.466512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.466799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.466812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.467274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.467762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.467769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.468218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.468851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.468878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.469533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.470051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.470060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.470635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.471182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.471191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.471661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.472201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.472209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.472788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.473517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.473544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.474073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.474676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.474703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.475248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.475827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.475854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.476122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.476498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.476525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.065 qpair failed and we were unable to recover it. 00:31:32.065 [2024-05-14 04:28:46.477069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.065 [2024-05-14 04:28:46.477714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.477742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.478308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.478764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.478771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.479258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.479734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.479742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.480219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.480661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.480669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.481145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.481719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.481747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.482223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.482790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.482818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.483501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.484061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.484070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.484663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.485161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.485170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.485665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.486080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.486087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.486577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.487062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.487069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.487559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.488005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.488012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.488522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.489019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.489028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.489628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.490140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.490150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.490524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.491053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.491064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.491590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.492165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.492174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.492633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.493124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.493132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.493701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.494200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.494209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.494707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.495211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.495221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.495691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.496157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.496165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.496714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.497213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.497223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.497718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.498254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.498264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.498854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.499504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.499531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.500013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.500619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.500647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.501028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.501613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.501641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.066 qpair failed and we were unable to recover it. 00:31:32.066 [2024-05-14 04:28:46.502036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.066 [2024-05-14 04:28:46.502597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.502625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.503132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.503700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.503727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.504242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.504770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.504797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.505267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.505865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.505893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.506497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.507006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.507016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.507567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.508065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.508074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.508535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.508796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.508811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.509305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.509762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.509768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.510221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.510710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.510717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.511212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.511682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.511689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.512188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.512666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.512673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.512889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.513377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.513385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.513861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.514370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.514377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.514737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.515107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.515114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.515604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.516111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.516118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.516697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.517194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.517204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.517569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.517826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.517832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.518221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.518705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.518712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.518807] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:32.067 [2024-05-14 04:28:46.518939] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:32.067 [2024-05-14 04:28:46.518950] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:32.067 [2024-05-14 04:28:46.518958] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:32.067 [2024-05-14 04:28:46.519104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:31:32.067 [2024-05-14 04:28:46.519215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.519227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:31:32.067 [2024-05-14 04:28:46.519395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:31:32.067 [2024-05-14 04:28:46.519398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:31:32.067 [2024-05-14 04:28:46.519674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.519682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.520174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.520770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.520798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.521280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.521918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.521946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.522562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.523159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.523168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.523669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.523893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.523907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.524300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.524659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.524665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.525136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.525693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.525720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.526108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.526671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.526699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.527200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.527779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.527806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.067 [2024-05-14 04:28:46.528278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.528729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.067 [2024-05-14 04:28:46.528757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.067 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.529112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.529728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.529755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.530145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.530572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.530599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.530971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.531546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.531573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.532055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.532615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.532642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.533029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.533514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.533542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.533896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.534268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.534275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.534747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.535260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.535268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.535866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.536487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.536515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.536988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.537597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.537625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.538128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.538697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.538724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.539091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.539530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.539558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.540042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.540603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.540630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.541108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.541557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.541584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.542091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.542644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.542671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.543216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.543623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.543651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.544129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.544565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.544593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.545093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.545702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.545731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.546232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.546809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.546836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.547145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.547535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.547566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.547827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.548339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.548347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.548692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.549151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.549158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.549616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.549983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.549991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.550630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.551007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.551016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.551479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.551955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.551962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.552548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.553058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.553067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.553296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.553410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.553422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.553794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.554298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.554306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.554543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.555010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.555016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.555471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.555947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.555961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.068 qpair failed and we were unable to recover it. 00:31:32.068 [2024-05-14 04:28:46.556566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.068 [2024-05-14 04:28:46.557067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.557075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.557641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.558019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.558028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.558609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.559120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.559129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.559630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.560000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.560008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.560567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.561067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.561076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.561632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.562139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.562148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.562722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.563044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.563054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.563648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.564057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.564066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.564502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.565013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.565023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.565635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.566137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.566150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.566705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.567112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.567121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.567511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.568014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.568023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.568589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.569082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.569092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.569697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.570204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.570214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.570776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.571281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.571296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.571530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.572028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.572035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.572495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.572887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.572896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.573399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.573875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.573882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.574214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.574684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.574690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.575153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.575750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.575780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.576251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.576736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.576764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.577002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.577346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.577353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.577724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.578192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.578198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.578681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.579152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.579159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.579721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.580221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.580231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.580769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.581236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.581243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.581816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.582507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.582536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.583022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.583617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.583645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.583912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.584276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.584282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.069 qpair failed and we were unable to recover it. 00:31:32.069 [2024-05-14 04:28:46.584761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.585232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.069 [2024-05-14 04:28:46.585239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.585813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.586084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.586093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.586525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.586820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.586835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.586977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.587211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.587220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.587719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.588110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.588117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.588615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.589082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.589089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.589650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.590161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.590170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.590717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.591055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.591062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.591296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.591762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.591770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.592272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.592839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.592867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.593455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.594022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.594032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.594606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.595113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.595122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.595695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.596194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.596205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.596793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.597307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.597317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.597608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.597867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.597875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.598493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.598998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.599007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.599473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.599730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.599737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.599975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.600455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.600463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.600942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.601022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.601031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.601496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.601959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.601966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.602424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.602850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.602857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.603318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.603845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.603853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.604196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.604568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.604575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.604795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.605271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.605278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.605649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.606159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.606167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.606641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.607151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.607157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.607709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.608214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.608224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.608795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.609259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.609268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.609820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.610189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.610199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.610408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.610895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.070 [2024-05-14 04:28:46.610903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.070 qpair failed and we were unable to recover it. 00:31:32.070 [2024-05-14 04:28:46.611372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.611869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.611876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.612380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.612879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.612886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.613346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.613838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.613845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.614322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.614571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.614578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.615022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.615487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.615494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.615976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.616242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.616250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.616735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.617118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.617125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.617751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.618122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.618131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.618691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.619206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.619215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.619775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.620276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.620285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.620762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.620991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.621004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.621259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.621754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.621762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.622277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.622655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.622683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.622947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.623183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.623189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.623629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.624101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.624109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.624674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.625173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.625182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.625682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.626149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.626156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.626711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.627209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.627218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.627772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.628271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.628281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.628856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.629148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.629157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.629819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.630500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.630528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.631004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.631569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.631596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.632071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.632722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.632750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.633229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.633676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.633703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.634180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.634538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.634545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.071 qpair failed and we were unable to recover it. 00:31:32.071 [2024-05-14 04:28:46.635009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.071 [2024-05-14 04:28:46.635278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.635285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.072 qpair failed and we were unable to recover it. 00:31:32.072 [2024-05-14 04:28:46.635790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.636253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.636259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.072 qpair failed and we were unable to recover it. 00:31:32.072 [2024-05-14 04:28:46.636870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.637467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.637495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.072 qpair failed and we were unable to recover it. 00:31:32.072 [2024-05-14 04:28:46.638029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.638591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.638618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.072 qpair failed and we were unable to recover it. 00:31:32.072 [2024-05-14 04:28:46.639125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.639684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.639712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.072 qpair failed and we were unable to recover it. 00:31:32.072 [2024-05-14 04:28:46.639974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.640201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.640208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.072 qpair failed and we were unable to recover it. 00:31:32.072 [2024-05-14 04:28:46.640454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.640925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.640932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.072 qpair failed and we were unable to recover it. 00:31:32.072 [2024-05-14 04:28:46.641402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.641892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.072 [2024-05-14 04:28:46.641898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.072 qpair failed and we were unable to recover it. 00:31:32.072 [2024-05-14 04:28:46.642129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.642616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.642625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.642852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.643329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.643336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.643471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.643935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.643942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.644403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.644879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.644886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.645380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.645747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.645754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.646211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.646680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.646687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.647167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.647624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.647632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.648085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.648661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.648688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.649164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.649817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.649846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.650507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.650793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.650802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.651067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.651534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.651541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.651876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.652088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.652099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.652644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.653111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.653118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.342 qpair failed and we were unable to recover it. 00:31:32.342 [2024-05-14 04:28:46.653717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.654307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.342 [2024-05-14 04:28:46.654318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.654757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.655216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.655222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.655831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.656499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.656527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.656816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.657086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.657093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.657354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.657859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.657866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.658095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.658307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.658314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.658703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.659171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.659177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.659718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.660179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.660186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.660436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.660663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.660669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.660945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.661140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.661147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.661472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.661942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.661950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.662174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.662532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.662541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.662769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.663249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.663256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.663727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.664194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.664201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.664674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.665140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.665147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.665506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.665960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.665967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.666437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.666931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.666938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.667323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.667826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.667832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.668287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.668796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.668803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.669261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.669817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.669845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.670505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.671005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.671014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.671569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.672090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.672099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.672464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.672983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.672992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.673558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.674063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.674072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.674626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.674889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.674907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.675396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.675645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.675652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.676143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.676606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.676613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.677071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.677560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.677588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.677930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.678438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.678446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.678913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.679297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.343 [2024-05-14 04:28:46.679305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.343 qpair failed and we were unable to recover it. 00:31:32.343 [2024-05-14 04:28:46.679786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.680257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.680263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.680838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.681136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.681146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.681729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.682258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.682267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.682894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.683497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.683525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.684002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.684579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.684607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.685109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.685670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.685698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.686208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.686828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.686855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.687499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.687914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.687924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.688500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.689002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.689011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.689599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.690100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.690109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.690665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.691171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.691180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.691628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.692092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.692099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.692547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.692775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.692785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.693280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.693781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.693789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.694302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.694650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.694657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.695125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.695494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.695527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.696056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.696625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.696653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.697147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.697508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.697536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.697884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.698506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.698535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.699013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.699603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.699630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.699982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.700477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.700485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.700945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.701413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.701420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.701919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.702002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.702013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.702496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.702966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.702972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.703429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.703894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.703900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.704321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.704784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.704795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.705303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.705770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.705777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.706232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.706695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.706701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.707160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.707514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.707521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.344 qpair failed and we were unable to recover it. 00:31:32.344 [2024-05-14 04:28:46.707875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.344 [2024-05-14 04:28:46.708116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.708123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.708615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.708850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.708858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.709341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.709724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.709730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.710193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.710684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.710690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.711151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.711742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.711770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.712272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.712804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.712832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.713307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.713774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.713784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.714245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.714817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.714845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.715515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.715819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.715829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.716093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.716575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.716582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.716960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.717549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.717577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.717850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.718286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.718298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.718809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.719152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.719158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.719772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.720283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.720304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.720872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.721531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.721559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.722038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.722611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.722639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.722868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.723110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.723121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.723431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.723947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.723954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.724414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.724782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.724789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.725323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.725559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.725569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.726057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.726525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.726532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.726984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.727442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.727450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.727927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.728397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.728404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.728879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.729221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.729228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.729698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.730162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.730168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.730644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.731015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.731025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.731644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.732139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.732147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.732506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.733009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.733019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.733249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.733712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.733719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.345 [2024-05-14 04:28:46.734191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.734848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.345 [2024-05-14 04:28:46.734875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.345 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.735505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.736008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.736017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.736574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.737075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.737085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.737605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.738104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.738113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.738673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.739176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.739185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.739723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.739985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.739993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.740625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.741125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.741134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.741690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.742184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.742193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.742724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.743100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.743106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.743541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.744109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.744118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.744730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.745233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.745243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.745828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.746484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.746512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.747053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.747641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.747669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.748147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.748742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.748769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.749245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.749765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.749793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.750247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.750620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.750648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.751152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.751666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.751693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.752167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.752733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.752761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.753231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.753799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.753827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.754304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.754782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.754789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.755297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.755520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.755526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.755958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.756512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.756540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.757020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.757279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.757287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.757527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.757732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.757738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.758276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.758749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.758757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.759211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.759661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.759668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.346 qpair failed and we were unable to recover it. 00:31:32.346 [2024-05-14 04:28:46.760144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.760710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.346 [2024-05-14 04:28:46.760738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.761273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.761758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.761787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.762273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.762837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.762865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.763541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.763834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.763843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.764086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.764470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.764477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.764813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.765306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.765314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.765771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.766312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.766319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.766801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.767253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.767261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.767731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.768082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.768089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.768550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.769018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.769024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.769573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.770078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.770087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.770704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.771208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.771218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.771618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.772120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.772127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.772725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.773219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.773229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.773676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.774005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.774014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.774589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.774873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.774883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.775150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.775359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.775366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.775928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.776395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.776402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.776640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.777116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.777122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.777593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.777938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.777945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.778406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.778876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.778882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.779257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.779743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.779750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.780208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.780306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.780314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.780769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.781136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.781144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.781605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.782070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.782077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.782626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.783167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.783176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.783689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.784065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.784072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.784675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.784960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.347 [2024-05-14 04:28:46.784970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.347 qpair failed and we were unable to recover it. 00:31:32.347 [2024-05-14 04:28:46.785237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.785495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.785502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.785894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.786364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.786372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.786850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.787224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.787230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.787713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.788212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.788219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.788699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.789166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.789173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.789586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.790169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.790179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.790659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.790900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.790907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.791105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.791562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.791570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.792031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.792636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.792664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.793212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.793447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.793461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.793885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.794140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.794147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.794531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.794904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.794911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.795283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.795756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.795763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.796224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.796783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.796811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.797485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.797988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.797997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.798516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.799022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.799031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.799674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.800178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.800188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.800680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.801190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.801197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.801720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.801969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.801976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.802553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.803064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.803073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.803631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.803917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.803927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.804445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.804916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.804923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.805383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.805876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.805883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.806118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.806606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.806613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.806867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.807116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.807123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.807580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.808044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.808050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.808600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.809136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.809145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.809716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.810221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.810230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.810791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.811298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.811307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.348 qpair failed and we were unable to recover it. 00:31:32.348 [2024-05-14 04:28:46.811558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.348 [2024-05-14 04:28:46.812027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.812034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.812586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.813090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.813099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.813540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.813810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.813819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.814169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.814539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.814567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.815069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.815570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.815598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.816104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.816676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.816704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.817182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.817679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.817686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.818095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.818659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.818687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.819161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.819735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.819762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.820281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.820855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.820883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.821484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.821885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.821894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.822505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.823002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.823011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.823577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.824084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.824093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.824583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.825112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.825121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.825699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.825962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.825971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.826228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.826478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.826486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.826952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.827425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.827433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.827940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.828376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.828383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.828873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.829339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.829346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.829823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.830021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.830029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.830401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.830598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.830604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.831055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.831516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.831524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.832006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.832395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.832402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.832884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.833346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.833353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.833738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.834213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.834219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.834490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.834978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.834989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.835449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.835911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.835919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.836300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.836769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.836776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.837289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.837785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.837792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.349 [2024-05-14 04:28:46.838252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.838801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.349 [2024-05-14 04:28:46.838809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.349 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.839268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.839555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.839582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.840088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.840461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.840489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.840748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.841096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.841103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.841600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.842077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.842083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.842557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.842928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.842938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.843394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.843772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.843783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.844293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.844752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.844759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.845096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.845661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.845689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.846169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.846743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.846770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.847257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.847823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.847851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.848469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.848840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.848849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.849185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.849414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.849422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.849678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.850136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.850144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.850358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.850767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.850774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.850989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.851490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.851497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.851963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.852425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.852436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.852942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.853413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.853420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.853887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.854066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.854076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.854558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.854653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.854660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.855049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.855435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.855442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.855927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.856394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.856401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.856876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.857385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.857392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.857867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.858206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.858214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.858703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.859067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.859074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.859532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.860042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.860050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.860269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.860724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.860735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.861234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.861709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.861716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.862174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.862751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.862779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.863508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.863776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.863785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.350 qpair failed and we were unable to recover it. 00:31:32.350 [2024-05-14 04:28:46.864020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.350 [2024-05-14 04:28:46.864461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.864469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.864972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.865441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.865448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.865808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.866270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.866277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.866790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.867191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.867199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.867451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.867950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.867957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.868458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.868919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.868925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.869176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.869506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.869535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.870029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.870595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.870623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.870886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.871126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.871138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.871238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.871708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.871716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.872177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.872668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.872675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.873159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.873730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.873758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.874242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.874774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.874801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.875485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.875987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.875996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.876608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.877111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.877120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.877683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.877944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.877953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.878321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.878565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.878583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.878986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.879249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.879256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.879662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.880007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.880015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.880515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.881006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.881014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.881377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.881835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.881841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.882068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.882268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.882280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.882562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.882801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.882808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.883274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.883638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.883645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.884107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.884562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.351 [2024-05-14 04:28:46.884570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.351 qpair failed and we were unable to recover it. 00:31:32.351 [2024-05-14 04:28:46.884729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.884921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.884930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.885415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.885880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.885887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.886366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.886756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.886763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.887224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.887696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.887704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.888162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.888625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.888633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.889133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.889225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.889232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.889767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.890232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.890238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.890492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.890684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.890691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.891165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.891495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.891502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.891993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.892549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.892577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.893070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.893679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.893707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.894068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.894708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.894736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.895246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.895808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.895836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.896177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.896529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.896536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.896997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.897556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.897583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.898071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.898626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.898653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.899040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.899315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.899331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.899601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.899941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.899948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.900409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.900930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.900936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.901315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.901831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.901837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.902072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.902286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.902305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.902560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.903054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.903060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.903518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.904011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.904018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.904475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.904926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.904933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.905494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.905998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.906007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.906565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.906821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.906834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.907339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.907678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.907686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.908165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.908638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.908645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.909102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.909707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.909734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.352 qpair failed and we were unable to recover it. 00:31:32.352 [2024-05-14 04:28:46.910285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.352 [2024-05-14 04:28:46.910740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.910768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.911249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.911822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.911849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.912085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.912302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.912310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.912805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.913039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.913047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.913276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.913771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.913778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.914250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.914607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.914634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.914979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.915334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.915341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.915838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.916302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.916309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.916694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.917196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.917202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.917696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.917934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.917941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.918412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.918793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.918800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.919033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.919274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.919281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.919832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.920180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.920187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.920675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.921139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.353 [2024-05-14 04:28:46.921146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.353 qpair failed and we were unable to recover it. 00:31:32.353 [2024-05-14 04:28:46.921716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.922128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.922137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.922762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.923262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.923271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.923916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.924494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.924522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.925000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.925565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.925592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.925939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.926535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.926563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.926905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.927408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.927415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.927906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.928378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.928386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.928870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.929323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.929330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.929589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.930088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.930094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.930577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.931116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.931124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.931688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.932194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.932204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.932714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.933269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.621 [2024-05-14 04:28:46.933276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.621 qpair failed and we were unable to recover it. 00:31:32.621 [2024-05-14 04:28:46.933846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.934505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.934533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.935044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.935610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.935637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.936185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.936659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.936666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.937128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.937708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.937735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.938213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.938778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.938806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.939500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.939997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.940006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.940505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.940877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.940886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.941140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.941232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.941245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.941520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.941723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.941730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.942243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.942700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.942706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.943214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.943697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.943704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.944168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.944797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.944824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.945169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.945724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.945752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.946303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.946803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.946810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.946939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.947335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.947342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.947838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.948307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.948315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.948774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.949247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.949253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.949719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.950182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.950189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.950613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.951108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.951114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.951478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.951893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.951902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.952134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.952570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.952579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.953083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.953640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.953668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.954134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.954739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.954766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.955254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.955592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.955619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.956163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.956747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.956775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.957281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.957890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.957917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.958542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.959055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.959064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.959628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.960135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.960145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.960574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.961075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.622 [2024-05-14 04:28:46.961086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.622 qpair failed and we were unable to recover it. 00:31:32.622 [2024-05-14 04:28:46.961327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.961594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.961602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.962013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.962354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.962361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.962825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.963299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.963307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.963569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.963839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.963846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.964080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.964541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.964548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.965007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.965472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.965479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.965564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.965666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.965674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.966182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.966679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.966686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.967156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.967641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.967648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.968111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.968558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.968587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.969077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.969649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.969677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.969906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.970363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.970372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.970604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.971103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.971110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.971448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.971662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.971673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.972263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.972731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.972738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.973194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.973660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.973667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.974203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.974681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.974689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.974931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.975317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.975325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.975816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.976282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.976298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.976786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.977241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.977247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.977757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.978222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.978228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.978593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.979096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.979106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.979333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.979796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.979804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.980044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.980539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.980546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.981053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.981628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.981656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.981923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.982396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.982403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.982877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.983348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.983355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.983824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.984340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.984347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.984831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.985054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.985076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.623 qpair failed and we were unable to recover it. 00:31:32.623 [2024-05-14 04:28:46.985576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.623 [2024-05-14 04:28:46.986040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.986047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.986511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.986980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.986987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.987447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.987961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.987968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.988537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.989037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.989046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.989606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.990104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.990113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.990572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.990866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.990876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.991349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.991825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.991832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.992344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.992711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.992718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.993186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.993587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.993594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.994079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.994589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.994600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.995055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.995557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.995585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.996132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.996576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.996603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.996848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.997055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.997061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.997264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.997713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.997720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.997965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.998453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.998460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.998795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.999290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:46.999302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:46.999763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.000232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.000239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.000710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.001073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.001080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.001518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.001758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.001771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.002262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.002737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.002749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.003225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.003689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.003697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.004155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.004596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.004623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.005103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.005627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.005655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.006157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.006722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.006749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.007300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.007776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.007804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.008280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.008834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.008861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.009505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.010087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.010096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.010321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.010811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.010819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.011283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.011757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.011784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.624 [2024-05-14 04:28:47.012263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.012713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.624 [2024-05-14 04:28:47.012741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.624 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.013007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.013565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.013592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.014105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.014737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.014765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.015241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.015697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.015726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.016200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.016683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.016690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.017152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.017720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.017749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.018229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.018760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.018787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.019289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.019857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.019885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.020527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.021033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.021042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.021675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.022178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.022188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.022771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.023136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.023146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.023571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.023860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.023870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.024354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.024823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.024830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.025289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.025797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.025804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.026144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.026264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.026270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.026637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.026864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.026870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.027355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.027819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.027826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.028286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.028519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.028526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.029018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.029579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.029586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.030045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.030628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.030657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.031142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.031726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.031753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.032242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.032867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.032895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.033501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.034003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.034012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.034579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.035081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.035091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.035769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.036027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.036041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.036304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.036776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.036783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.037246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.037736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.037745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.038207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.038671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.038679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.625 qpair failed and we were unable to recover it. 00:31:32.625 [2024-05-14 04:28:47.038912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.039181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.625 [2024-05-14 04:28:47.039188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.039637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.040158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.040166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.040611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.040984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.040993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.041458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.041968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.041975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.042527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.043029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.043038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.043595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.044097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.044106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.044687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.045240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.045249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.045882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.046259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.046270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.046659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.047075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.047084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.047681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.048056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.048065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.048680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.049182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.049191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.049717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.050095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.050102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.050671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.051045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.051054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.051615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.052123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.052132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.052697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.052961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.052970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.053507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.053879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.053888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.054372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.054868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.054876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.055287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.055799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.055806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.056267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.056545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.056572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.056860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.057335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.057343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.057573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.058095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.058102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.058443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.058952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.058959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.059349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.059822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.059829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.059955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.060177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.060183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.060637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.061099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.061105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.061573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.062038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.062045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.626 qpair failed and we were unable to recover it. 00:31:32.626 [2024-05-14 04:28:47.062514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.626 [2024-05-14 04:28:47.063035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.063042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.063648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.064153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.064162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.064728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.065102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.065111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.065577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.066084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.066093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.066652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.066920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.066930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.067552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.068054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.068064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.068647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.069071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.069081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.069667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.070175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.070184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.070722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.071076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.071083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.071685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.071835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.071844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.072079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.072466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.072474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.072934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.073401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.073409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.073885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.074234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.074242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.074747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.075228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.075234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.075714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.076181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.076187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.076651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.077113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.077120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.077554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.077816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.077825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.078346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.078824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.078831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.079399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.079723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.079732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.079987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.080206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.080213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.080420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.080951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.080959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.081463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.081696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.081703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.082136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.082513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.082520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.082986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.083450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.083458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.083915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.084176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.084183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.084664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.084922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.084929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.085410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.085908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.085915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.086368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.086867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.086874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.087346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.087850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.087856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.627 [2024-05-14 04:28:47.088340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.088699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.627 [2024-05-14 04:28:47.088706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.627 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.089182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.089742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.089749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.090203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.090764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.090771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.091099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.091694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.091721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.092239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.092714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.092723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.093054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.093542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.093569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.094046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.094613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.094641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.095149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.095553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.095581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.096071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.096642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.096670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.097014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.097499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.097527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.098013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.098621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.098649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.099064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.099628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.099656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.099922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.100186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.100193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.100428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.100931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.100938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.101166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.101642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.101650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.102122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.102675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.102703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.103206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.103688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.103695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.104156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.104727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.104755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.105020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.105626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.105653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.105912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.106149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.106156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.106371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.106881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.106888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.107429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.107832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.107838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.108301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.108790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.108797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.109251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.109772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.109800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.110187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.110705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.110713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.111195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.111670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.111677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.112151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.112732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.112760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.113281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.113850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.113878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.114508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.115015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.115024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.115586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.115851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.628 [2024-05-14 04:28:47.115860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.628 qpair failed and we were unable to recover it. 00:31:32.628 [2024-05-14 04:28:47.116349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.116589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.116603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.117110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.117576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.117583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.118040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.118311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.118325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.118575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.118792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.118800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.119260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.119740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.119748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.120205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.120678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.120686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.121185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.121639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.121647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.121978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.122461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.122468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.122931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.123393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.123403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.123881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.124344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.124351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.124860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.125242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.125249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.125715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.126179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.126186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.126520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.126987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.126994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.127195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.127540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.127549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.128004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.129002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.129019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.129477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.129998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.130005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.130484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.130954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.130961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.131422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.131759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.131766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.132234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.132705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.132714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.133216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.133709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.133716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.134180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.134613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.134621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.135085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.135680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.135708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.136220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.136720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.136728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.137202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.137705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.137733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.138224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.138460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.138468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.138945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.139296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.139304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.139758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.140223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.140230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.140838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.141501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.141528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.141872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.142380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.142391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.629 qpair failed and we were unable to recover it. 00:31:32.629 [2024-05-14 04:28:47.142878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.143345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.629 [2024-05-14 04:28:47.143353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.143587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.143847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.143853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.143973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.144482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.144490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.144716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.145192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.145199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.145674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.146134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.146142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.146614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.146832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.146842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.147316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.147679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.147686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.148076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.148488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.148495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.149047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.149521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.149528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.149985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.150457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.150466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.150990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.151256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.151263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.151503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.151940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.151947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.152405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.152886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.152893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.153232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.153672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.153679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.154051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.154507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.154534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.154918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.155365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.155372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.155752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.156252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.156259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.156783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.157044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.157051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.157532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.157962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.157968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.158569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.159075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.159084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.159717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.160260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.160269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.160832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.161128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.161138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.161266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.161762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.161770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.162107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.162729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.162756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.163101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.163676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.163703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.630 qpair failed and we were unable to recover it. 00:31:32.630 [2024-05-14 04:28:47.163930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.164341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.630 [2024-05-14 04:28:47.164349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.164843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.165311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.165318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.165818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.166282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.166288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.166680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.167142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.167149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.167717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.168219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.168228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.168714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.169187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.169193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.169825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.170512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.170540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.170780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.170999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.171006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.171237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.171768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.171775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.172301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.172783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.172790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.173260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.173761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.173768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.174235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.174709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.174716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.175180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.175674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.175681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.176003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.176229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.176235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.176485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.176950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.176957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.177466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.177934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.177941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.178397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.178875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.178882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.179347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.179818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.179825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.180302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.180479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.180485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.180910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.181176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.181182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.181578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.181879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.181885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.182351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.182859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.182865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.183332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.183666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.183672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.184137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.184603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.184610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.185088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.185485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.185492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 04:28:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:32.631 04:28:47 -- common/autotest_common.sh@852 -- # return 0 00:31:32.631 04:28:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:32.631 [2024-05-14 04:28:47.185974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 04:28:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:32.631 04:28:47 -- common/autotest_common.sh@10 -- # set +x 00:31:32.631 [2024-05-14 04:28:47.186498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.186526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.187053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.187617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.187644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.188152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.188540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.188567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.189027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.189516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.189544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.631 qpair failed and we were unable to recover it. 00:31:32.631 [2024-05-14 04:28:47.189807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.631 [2024-05-14 04:28:47.190034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.190041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.190268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.190771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.190779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.191246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.191737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.191744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.192214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.192778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.192806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.193299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.193882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.193910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.194274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.194803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.194830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.195502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.196048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.196057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.196618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.197035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.197045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.197606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.198062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.198072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.198521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.199103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.199112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.199518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.200021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.200030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.200585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.200875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.200886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.201119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.201574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.201582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.202036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.202590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.632 [2024-05-14 04:28:47.202618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.632 qpair failed and we were unable to recover it. 00:31:32.632 [2024-05-14 04:28:47.203123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.203706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.203734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.204220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.204788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.204817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.205289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.205756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.205784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.206020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.206505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.206533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.206791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.207254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.207261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.207736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.208233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.208240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.208721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.209185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.209192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.209316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.209536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.209542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.209747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.209984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.209991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.210486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.210959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.210966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.211469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.211958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.211965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.212290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.212767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.212774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.213232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.213679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.213686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.897 [2024-05-14 04:28:47.214149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.214732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.897 [2024-05-14 04:28:47.214759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.897 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.215233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.215813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.215841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.216491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.216991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.217000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.217221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.217551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.217559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.217817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.218272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.218279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.218658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.219015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.219022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.219467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.219964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.219971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.220434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.220668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.220680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.220907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.221166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.221176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.221665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.222014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.222021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.222484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.222956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.222962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.223422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 04:28:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:32.898 [2024-05-14 04:28:47.223908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.223917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 04:28:47 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:31:32.898 04:28:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:32.898 [2024-05-14 04:28:47.224280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 04:28:47 -- common/autotest_common.sh@10 -- # set +x 00:31:32.898 [2024-05-14 04:28:47.224538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.224549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.225037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.225422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.225429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.225877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.226344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.226350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.226829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.227213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.227219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.227690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.228164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.228171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.228729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.229230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.229239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.229877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.230516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.230544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.231055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.231655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.231682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.232189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.232678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.232685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.233149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.233724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.233752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.233873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.234339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.234347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.234662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.234926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.234932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.235153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.235625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.235632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.235968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.236459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.236466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.236826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.237321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.237328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.237680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.238157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.238164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.898 qpair failed and we were unable to recover it. 00:31:32.898 [2024-05-14 04:28:47.238677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.898 [2024-05-14 04:28:47.239139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.239145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.239580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.240170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.240179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.240673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.241048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.241055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.241158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.241443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.241450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.241924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.242017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.242023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.242264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 Malloc0 00:31:32.899 [2024-05-14 04:28:47.242614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.242621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.243121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 04:28:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:32.899 04:28:47 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:31:32.899 [2024-05-14 04:28:47.243626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.243633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 04:28:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:32.899 [2024-05-14 04:28:47.244090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 04:28:47 -- common/autotest_common.sh@10 -- # set +x 00:31:32.899 [2024-05-14 04:28:47.244702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.244729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.245242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.245696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.245724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.245955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.246123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.246131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.246409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.246925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.246932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.247441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.247804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.247811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.248309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.248753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.248759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.249215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.249670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.249677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.249867] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:32.899 [2024-05-14 04:28:47.250139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.250623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.250630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.251132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.251742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.251769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.252278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.252874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.252901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.253254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.253826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.253854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.254083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.254646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.254674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.255151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.255747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.255775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.256285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.256880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.256907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.257257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.257847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.257875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 [2024-05-14 04:28:47.258504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 04:28:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:32.899 [2024-05-14 04:28:47.259010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 [2024-05-14 04:28:47.259019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.899 qpair failed and we were unable to recover it. 00:31:32.899 04:28:47 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:32.899 [2024-05-14 04:28:47.259557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.899 04:28:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:32.899 04:28:47 -- common/autotest_common.sh@10 -- # set +x 00:31:32.899 [2024-05-14 04:28:47.260030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.260040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.260528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.261032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.261040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.261531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.262036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.262045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.262622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.263128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.263137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.263580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.263953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.263963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.264504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.265007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.265017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.265595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.266104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.266113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.266682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.267207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.267217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.267477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.267722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.267729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.268195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.268684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.268691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.269145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.269696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.269724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.270210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.270647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.270654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 04:28:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:32.900 [2024-05-14 04:28:47.270999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 04:28:47 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:32.900 04:28:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:32.900 [2024-05-14 04:28:47.271597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.271625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 04:28:47 -- common/autotest_common.sh@10 -- # set +x 00:31:32.900 [2024-05-14 04:28:47.272142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.272722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.272750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.273235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.273888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.273918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.274497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.275000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.275008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.275597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.276102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.276110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.276700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.277209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.277218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.277833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.278487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.278515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.278785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.279251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.279258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.279598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.280065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.280072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.280711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.281219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.281228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.281765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.282251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.282259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.282833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 04:28:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:32.900 [2024-05-14 04:28:47.283208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.283217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 04:28:47 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:32.900 04:28:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:32.900 [2024-05-14 04:28:47.283840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 04:28:47 -- common/autotest_common.sh@10 -- # set +x 00:31:32.900 [2024-05-14 04:28:47.284254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.284263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.284860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.285246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.285255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.900 qpair failed and we were unable to recover it. 00:31:32.900 [2024-05-14 04:28:47.285840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.900 [2024-05-14 04:28:47.286488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.286515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.286901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.287171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.287178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.287529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.287758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.287765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.288278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.288759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.288766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.289229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.289746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.289753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f4558000b90 with addr=10.0.0.2, port=4420 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.290152] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:32.901 [2024-05-14 04:28:47.290211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:31:32.901 [2024-05-14 04:28:47.292458] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:31:32.901 [2024-05-14 04:28:47.292491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f4558000b90 (107): Transport endpoint is not connected 00:31:32.901 [2024-05-14 04:28:47.292520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 04:28:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:32.901 04:28:47 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:31:32.901 04:28:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:32.901 04:28:47 -- common/autotest_common.sh@10 -- # set +x 00:31:32.901 [2024-05-14 04:28:47.300891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.901 [2024-05-14 04:28:47.300996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.901 [2024-05-14 04:28:47.301014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.901 [2024-05-14 04:28:47.301021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.901 [2024-05-14 04:28:47.301026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.901 [2024-05-14 04:28:47.301040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 04:28:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:32.901 04:28:47 -- host/target_disconnect.sh@58 -- # wait 4149992 00:31:32.901 [2024-05-14 04:28:47.310713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.901 [2024-05-14 04:28:47.310810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.901 [2024-05-14 04:28:47.310829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.901 [2024-05-14 04:28:47.310835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.901 [2024-05-14 04:28:47.310840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.901 [2024-05-14 04:28:47.310855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.320688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.901 [2024-05-14 04:28:47.320787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.901 [2024-05-14 04:28:47.320806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.901 [2024-05-14 04:28:47.320812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.901 [2024-05-14 04:28:47.320817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.901 [2024-05-14 04:28:47.320831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.330725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.901 [2024-05-14 04:28:47.330819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.901 [2024-05-14 04:28:47.330833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.901 [2024-05-14 04:28:47.330839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.901 [2024-05-14 04:28:47.330843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.901 [2024-05-14 04:28:47.330856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.340720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.901 [2024-05-14 04:28:47.340812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.901 [2024-05-14 04:28:47.340825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.901 [2024-05-14 04:28:47.340831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.901 [2024-05-14 04:28:47.340838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.901 [2024-05-14 04:28:47.340851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.350739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.901 [2024-05-14 04:28:47.350836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.901 [2024-05-14 04:28:47.350850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.901 [2024-05-14 04:28:47.350856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.901 [2024-05-14 04:28:47.350860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.901 [2024-05-14 04:28:47.350872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.360777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.901 [2024-05-14 04:28:47.360866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.901 [2024-05-14 04:28:47.360880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.901 [2024-05-14 04:28:47.360885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.901 [2024-05-14 04:28:47.360890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.901 [2024-05-14 04:28:47.360902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.370771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.901 [2024-05-14 04:28:47.370864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.901 [2024-05-14 04:28:47.370877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.901 [2024-05-14 04:28:47.370883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.901 [2024-05-14 04:28:47.370887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.901 [2024-05-14 04:28:47.370899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.901 qpair failed and we were unable to recover it. 00:31:32.901 [2024-05-14 04:28:47.380809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.901 [2024-05-14 04:28:47.380899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.901 [2024-05-14 04:28:47.380912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.901 [2024-05-14 04:28:47.380918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.901 [2024-05-14 04:28:47.380922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.902 [2024-05-14 04:28:47.380934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.902 qpair failed and we were unable to recover it. 00:31:32.902 [2024-05-14 04:28:47.390848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.902 [2024-05-14 04:28:47.390944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.902 [2024-05-14 04:28:47.390958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.902 [2024-05-14 04:28:47.390963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.902 [2024-05-14 04:28:47.390968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.902 [2024-05-14 04:28:47.390980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.902 qpair failed and we were unable to recover it. 00:31:32.902 [2024-05-14 04:28:47.400820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.902 [2024-05-14 04:28:47.400908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.902 [2024-05-14 04:28:47.400921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.902 [2024-05-14 04:28:47.400926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.902 [2024-05-14 04:28:47.400931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.902 [2024-05-14 04:28:47.400942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.902 qpair failed and we were unable to recover it. 00:31:32.902 [2024-05-14 04:28:47.410933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.902 [2024-05-14 04:28:47.411024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.902 [2024-05-14 04:28:47.411037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.902 [2024-05-14 04:28:47.411043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.902 [2024-05-14 04:28:47.411047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.902 [2024-05-14 04:28:47.411059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.902 qpair failed and we were unable to recover it. 00:31:32.902 [2024-05-14 04:28:47.420973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.902 [2024-05-14 04:28:47.421059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.902 [2024-05-14 04:28:47.421072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.902 [2024-05-14 04:28:47.421078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.902 [2024-05-14 04:28:47.421082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.902 [2024-05-14 04:28:47.421094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.902 qpair failed and we were unable to recover it. 00:31:32.902 [2024-05-14 04:28:47.430975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.902 [2024-05-14 04:28:47.431076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.902 [2024-05-14 04:28:47.431089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.902 [2024-05-14 04:28:47.431098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.902 [2024-05-14 04:28:47.431103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.902 [2024-05-14 04:28:47.431115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.902 qpair failed and we were unable to recover it. 00:31:32.902 [2024-05-14 04:28:47.440959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.902 [2024-05-14 04:28:47.441048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.902 [2024-05-14 04:28:47.441062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.902 [2024-05-14 04:28:47.441067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.902 [2024-05-14 04:28:47.441072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.902 [2024-05-14 04:28:47.441083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.902 qpair failed and we were unable to recover it. 00:31:32.902 [2024-05-14 04:28:47.451015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.902 [2024-05-14 04:28:47.451109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.902 [2024-05-14 04:28:47.451122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.902 [2024-05-14 04:28:47.451128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.902 [2024-05-14 04:28:47.451132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.902 [2024-05-14 04:28:47.451144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.902 qpair failed and we were unable to recover it. 00:31:32.902 [2024-05-14 04:28:47.461044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.902 [2024-05-14 04:28:47.461130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.902 [2024-05-14 04:28:47.461143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.902 [2024-05-14 04:28:47.461148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.902 [2024-05-14 04:28:47.461152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.902 [2024-05-14 04:28:47.461163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.902 qpair failed and we were unable to recover it. 00:31:32.902 [2024-05-14 04:28:47.470977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.902 [2024-05-14 04:28:47.471067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.902 [2024-05-14 04:28:47.471087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.902 [2024-05-14 04:28:47.471093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.902 [2024-05-14 04:28:47.471098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.903 [2024-05-14 04:28:47.471113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.903 qpair failed and we were unable to recover it. 00:31:32.903 [2024-05-14 04:28:47.481121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:32.903 [2024-05-14 04:28:47.481216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:32.903 [2024-05-14 04:28:47.481230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:32.903 [2024-05-14 04:28:47.481236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:32.903 [2024-05-14 04:28:47.481240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:32.903 [2024-05-14 04:28:47.481253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:32.903 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.491154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.491240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.491253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.491259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.491263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.491275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.501168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.501258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.501271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.501276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.501281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.501299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.511207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.511289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.511306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.511311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.511315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.511327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.521243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.521335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.521351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.521357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.521362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.521374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.531401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.531509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.531522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.531527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.531532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.531544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.541408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.541502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.541515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.541521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.541525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.541537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.551367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.551455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.551469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.551474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.551478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.551490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.561400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.561490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.561503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.561508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.561513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.561527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.571297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.571398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.571411] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.571416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.571421] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.571433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.581402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.581513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.581526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.581532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.581536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.581547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.166 [2024-05-14 04:28:47.591433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.166 [2024-05-14 04:28:47.591520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.166 [2024-05-14 04:28:47.591533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.166 [2024-05-14 04:28:47.591538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.166 [2024-05-14 04:28:47.591543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.166 [2024-05-14 04:28:47.591554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.166 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.601382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.601476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.601489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.601494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.601498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.601510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.611517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.611611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.611628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.611633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.611637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.611648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.621519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.621646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.621660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.621665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.621669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.621681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.631446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.631534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.631547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.631552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.631557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.631568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.641543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.641631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.641645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.641650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.641654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.641666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.651615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.651707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.651720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.651725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.651729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.651743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.661621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.661715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.661728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.661733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.661737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.661748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.671628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.671721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.671735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.671740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.671744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.671756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.681685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.681772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.681785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.681790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.681794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.681806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.691701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.691795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.691808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.691813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.691817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.691829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.701634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.701725] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.701741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.701746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.701750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.701762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.711693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.711811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.711824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.711830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.711834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.711845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.721796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.721955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.721968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.721974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.721978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.167 [2024-05-14 04:28:47.721989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.167 qpair failed and we were unable to recover it. 00:31:33.167 [2024-05-14 04:28:47.731832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.167 [2024-05-14 04:28:47.731930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.167 [2024-05-14 04:28:47.731950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.167 [2024-05-14 04:28:47.731957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.167 [2024-05-14 04:28:47.731961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.168 [2024-05-14 04:28:47.731976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.168 qpair failed and we were unable to recover it. 00:31:33.168 [2024-05-14 04:28:47.741849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.168 [2024-05-14 04:28:47.741942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.168 [2024-05-14 04:28:47.741961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.168 [2024-05-14 04:28:47.741967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.168 [2024-05-14 04:28:47.741976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.168 [2024-05-14 04:28:47.741991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.168 qpair failed and we were unable to recover it. 00:31:33.168 [2024-05-14 04:28:47.751884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.168 [2024-05-14 04:28:47.751974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.168 [2024-05-14 04:28:47.751988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.168 [2024-05-14 04:28:47.751994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.168 [2024-05-14 04:28:47.751998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.168 [2024-05-14 04:28:47.752011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.168 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.761934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.762043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.762056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.762062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.762066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.762077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.771952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.772049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.772069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.772075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.772080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.772095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.781948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.782040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.782055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.782061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.782065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.782078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.792019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.792109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.792123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.792129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.792133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.792145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.802039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.802136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.802150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.802155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.802159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.802171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.812058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.812157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.812177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.812183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.812188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.812202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.822085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.822168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.822182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.822188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.822192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.822205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.832140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.832267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.832281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.832286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.832301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.832315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.842152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.842239] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.842252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.842257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.842262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.842273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.852180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.852272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.852285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.852295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.852300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.852312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.862153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.862248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.862261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.862266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.431 [2024-05-14 04:28:47.862271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.431 [2024-05-14 04:28:47.862282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.431 qpair failed and we were unable to recover it. 00:31:33.431 [2024-05-14 04:28:47.872387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.431 [2024-05-14 04:28:47.872478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.431 [2024-05-14 04:28:47.872492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.431 [2024-05-14 04:28:47.872497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.872501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.872513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.882157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.882246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.882260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.882265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.882270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.882282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.892317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.892409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.892422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.892428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.892432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.892444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.902305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.902429] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.902442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.902448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.902452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.902464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.912367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.912457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.912470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.912476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.912480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.912492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.922376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.922474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.922487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.922495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.922500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.922512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.932425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.932514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.932527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.932532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.932537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.932549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.942446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.942531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.942545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.942550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.942554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.942566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.952416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.952501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.952514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.952520] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.952524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.952536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.962532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.962620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.962633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.962638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.962643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.962654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.972532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.972635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.972649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.972654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.972659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.972671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.982528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.982613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.982627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.982632] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.982637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.982648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:47.992564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:47.992649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:47.992662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:47.992668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:47.992672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:47.992684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:48.002598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:48.002847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.432 [2024-05-14 04:28:48.002866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.432 [2024-05-14 04:28:48.002871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.432 [2024-05-14 04:28:48.002875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.432 [2024-05-14 04:28:48.002887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.432 qpair failed and we were unable to recover it. 00:31:33.432 [2024-05-14 04:28:48.012652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.432 [2024-05-14 04:28:48.012750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.433 [2024-05-14 04:28:48.012763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.433 [2024-05-14 04:28:48.012771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.433 [2024-05-14 04:28:48.012776] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.433 [2024-05-14 04:28:48.012787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.433 qpair failed and we were unable to recover it. 00:31:33.695 [2024-05-14 04:28:48.022627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.695 [2024-05-14 04:28:48.022714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.695 [2024-05-14 04:28:48.022727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.695 [2024-05-14 04:28:48.022733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.695 [2024-05-14 04:28:48.022737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.695 [2024-05-14 04:28:48.022748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.695 qpair failed and we were unable to recover it. 00:31:33.695 [2024-05-14 04:28:48.032698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.695 [2024-05-14 04:28:48.032783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.695 [2024-05-14 04:28:48.032796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.695 [2024-05-14 04:28:48.032801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.695 [2024-05-14 04:28:48.032806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.695 [2024-05-14 04:28:48.032818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.695 qpair failed and we were unable to recover it. 00:31:33.695 [2024-05-14 04:28:48.042696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.695 [2024-05-14 04:28:48.042785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.695 [2024-05-14 04:28:48.042799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.695 [2024-05-14 04:28:48.042804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.695 [2024-05-14 04:28:48.042808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.695 [2024-05-14 04:28:48.042820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.695 qpair failed and we were unable to recover it. 00:31:33.695 [2024-05-14 04:28:48.052756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.695 [2024-05-14 04:28:48.052848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.695 [2024-05-14 04:28:48.052861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.695 [2024-05-14 04:28:48.052867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.695 [2024-05-14 04:28:48.052871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.695 [2024-05-14 04:28:48.052883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.695 qpair failed and we were unable to recover it. 00:31:33.695 [2024-05-14 04:28:48.062953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.695 [2024-05-14 04:28:48.063060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.695 [2024-05-14 04:28:48.063079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.695 [2024-05-14 04:28:48.063085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.695 [2024-05-14 04:28:48.063090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.695 [2024-05-14 04:28:48.063105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.695 qpair failed and we were unable to recover it. 00:31:33.695 [2024-05-14 04:28:48.072799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.695 [2024-05-14 04:28:48.072894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.695 [2024-05-14 04:28:48.072914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.695 [2024-05-14 04:28:48.072920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.072925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.072939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.082734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.082821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.082836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.082841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.082846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.082858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.092876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.092978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.092992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.092997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.093002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.093014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.102901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.103001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.103026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.103033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.103038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.103053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.112924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.113020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.113039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.113046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.113050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.113065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.122984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.123079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.123093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.123099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.123103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.123116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.132971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.133068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.133081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.133087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.133091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.133103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.142994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.143079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.143092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.143098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.143102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.143118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.152937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.153023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.153037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.153043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.153048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.153059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.163126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.163229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.163242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.163247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.163252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.163263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.173119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.173221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.173234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.173240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.173244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.173257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.183145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.183233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.183247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.183252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.696 [2024-05-14 04:28:48.183256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.696 [2024-05-14 04:28:48.183267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.696 qpair failed and we were unable to recover it. 00:31:33.696 [2024-05-14 04:28:48.193128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.696 [2024-05-14 04:28:48.193218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.696 [2024-05-14 04:28:48.193234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.696 [2024-05-14 04:28:48.193239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.697 [2024-05-14 04:28:48.193244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.697 [2024-05-14 04:28:48.193256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.697 qpair failed and we were unable to recover it. 00:31:33.697 [2024-05-14 04:28:48.203196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.697 [2024-05-14 04:28:48.203282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.697 [2024-05-14 04:28:48.203302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.697 [2024-05-14 04:28:48.203307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.697 [2024-05-14 04:28:48.203312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.697 [2024-05-14 04:28:48.203324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.697 qpair failed and we were unable to recover it. 00:31:33.697 [2024-05-14 04:28:48.213220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.697 [2024-05-14 04:28:48.213319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.697 [2024-05-14 04:28:48.213333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.697 [2024-05-14 04:28:48.213338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.697 [2024-05-14 04:28:48.213342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.697 [2024-05-14 04:28:48.213354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.697 qpair failed and we were unable to recover it. 00:31:33.697 [2024-05-14 04:28:48.223225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.697 [2024-05-14 04:28:48.223335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.697 [2024-05-14 04:28:48.223349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.697 [2024-05-14 04:28:48.223354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.697 [2024-05-14 04:28:48.223359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.697 [2024-05-14 04:28:48.223371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.697 qpair failed and we were unable to recover it. 00:31:33.697 [2024-05-14 04:28:48.233283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.697 [2024-05-14 04:28:48.233374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.697 [2024-05-14 04:28:48.233387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.697 [2024-05-14 04:28:48.233393] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.697 [2024-05-14 04:28:48.233400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.697 [2024-05-14 04:28:48.233412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.697 qpair failed and we were unable to recover it. 00:31:33.697 [2024-05-14 04:28:48.243324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.697 [2024-05-14 04:28:48.243442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.697 [2024-05-14 04:28:48.243455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.697 [2024-05-14 04:28:48.243461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.697 [2024-05-14 04:28:48.243465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.697 [2024-05-14 04:28:48.243477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.697 qpair failed and we were unable to recover it. 00:31:33.697 [2024-05-14 04:28:48.253220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.697 [2024-05-14 04:28:48.253315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.697 [2024-05-14 04:28:48.253328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.697 [2024-05-14 04:28:48.253334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.697 [2024-05-14 04:28:48.253338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.697 [2024-05-14 04:28:48.253350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.697 qpair failed and we were unable to recover it. 00:31:33.697 [2024-05-14 04:28:48.263364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.697 [2024-05-14 04:28:48.263485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.697 [2024-05-14 04:28:48.263499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.697 [2024-05-14 04:28:48.263504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.697 [2024-05-14 04:28:48.263508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.697 [2024-05-14 04:28:48.263520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.697 qpair failed and we were unable to recover it. 00:31:33.697 [2024-05-14 04:28:48.273395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.697 [2024-05-14 04:28:48.273486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.697 [2024-05-14 04:28:48.273500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.697 [2024-05-14 04:28:48.273505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.697 [2024-05-14 04:28:48.273509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.697 [2024-05-14 04:28:48.273521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.697 qpair failed and we were unable to recover it. 00:31:33.960 [2024-05-14 04:28:48.283377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.960 [2024-05-14 04:28:48.283475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.960 [2024-05-14 04:28:48.283488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.960 [2024-05-14 04:28:48.283493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.960 [2024-05-14 04:28:48.283497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.960 [2024-05-14 04:28:48.283509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.960 qpair failed and we were unable to recover it. 00:31:33.960 [2024-05-14 04:28:48.293454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.960 [2024-05-14 04:28:48.293544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.960 [2024-05-14 04:28:48.293558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.960 [2024-05-14 04:28:48.293563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.960 [2024-05-14 04:28:48.293567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.960 [2024-05-14 04:28:48.293579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.960 qpair failed and we were unable to recover it. 00:31:33.960 [2024-05-14 04:28:48.303438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.960 [2024-05-14 04:28:48.303524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.960 [2024-05-14 04:28:48.303538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.960 [2024-05-14 04:28:48.303543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.960 [2024-05-14 04:28:48.303547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.960 [2024-05-14 04:28:48.303559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.960 qpair failed and we were unable to recover it. 00:31:33.960 [2024-05-14 04:28:48.313487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.960 [2024-05-14 04:28:48.313573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.960 [2024-05-14 04:28:48.313586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.960 [2024-05-14 04:28:48.313591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.960 [2024-05-14 04:28:48.313596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.960 [2024-05-14 04:28:48.313607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.960 qpair failed and we were unable to recover it. 00:31:33.960 [2024-05-14 04:28:48.323519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.960 [2024-05-14 04:28:48.323609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.960 [2024-05-14 04:28:48.323623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.960 [2024-05-14 04:28:48.323628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.960 [2024-05-14 04:28:48.323635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.960 [2024-05-14 04:28:48.323647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.960 qpair failed and we were unable to recover it. 00:31:33.960 [2024-05-14 04:28:48.333552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.960 [2024-05-14 04:28:48.333645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.960 [2024-05-14 04:28:48.333659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.960 [2024-05-14 04:28:48.333664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.960 [2024-05-14 04:28:48.333668] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.960 [2024-05-14 04:28:48.333680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.960 qpair failed and we were unable to recover it. 00:31:33.960 [2024-05-14 04:28:48.343592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.960 [2024-05-14 04:28:48.343721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.960 [2024-05-14 04:28:48.343735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.960 [2024-05-14 04:28:48.343740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.343744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.343756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.353586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.353672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.353685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.353691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.353695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.353706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.363643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.363733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.363746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.363751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.363756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.363767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.373681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.373779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.373792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.373797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.373802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.373813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.383665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.383754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.383767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.383773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.383777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.383788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.393688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.393784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.393797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.393802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.393807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.393819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.403737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.403824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.403837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.403842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.403847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.403858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.413719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.413815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.413835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.413844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.413849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.413864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.423743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.423853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.423873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.423879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.423884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.423899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.433813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.433912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.433932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.433938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.433942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.433958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.443896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.443998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.444018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.444024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.444029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.444044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.453903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.454049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.454068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.454075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.454080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.454095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.463922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.464057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.464076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.464083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.464087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.464102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.473925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.961 [2024-05-14 04:28:48.474016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.961 [2024-05-14 04:28:48.474035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.961 [2024-05-14 04:28:48.474041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.961 [2024-05-14 04:28:48.474046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.961 [2024-05-14 04:28:48.474061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.961 qpair failed and we were unable to recover it. 00:31:33.961 [2024-05-14 04:28:48.483996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.962 [2024-05-14 04:28:48.484086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.962 [2024-05-14 04:28:48.484100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.962 [2024-05-14 04:28:48.484106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.962 [2024-05-14 04:28:48.484110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.962 [2024-05-14 04:28:48.484123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.962 qpair failed and we were unable to recover it. 00:31:33.962 [2024-05-14 04:28:48.494039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.962 [2024-05-14 04:28:48.494136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.962 [2024-05-14 04:28:48.494156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.962 [2024-05-14 04:28:48.494162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.962 [2024-05-14 04:28:48.494167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.962 [2024-05-14 04:28:48.494182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.962 qpair failed and we were unable to recover it. 00:31:33.962 [2024-05-14 04:28:48.504033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.962 [2024-05-14 04:28:48.504120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.962 [2024-05-14 04:28:48.504134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.962 [2024-05-14 04:28:48.504144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.962 [2024-05-14 04:28:48.504148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.962 [2024-05-14 04:28:48.504161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.962 qpair failed and we were unable to recover it. 00:31:33.962 [2024-05-14 04:28:48.513988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.962 [2024-05-14 04:28:48.514080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.962 [2024-05-14 04:28:48.514094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.962 [2024-05-14 04:28:48.514099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.962 [2024-05-14 04:28:48.514104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.962 [2024-05-14 04:28:48.514116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.962 qpair failed and we were unable to recover it. 00:31:33.962 [2024-05-14 04:28:48.524112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.962 [2024-05-14 04:28:48.524204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.962 [2024-05-14 04:28:48.524219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.962 [2024-05-14 04:28:48.524224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.962 [2024-05-14 04:28:48.524228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.962 [2024-05-14 04:28:48.524241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.962 qpair failed and we were unable to recover it. 00:31:33.962 [2024-05-14 04:28:48.534142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.962 [2024-05-14 04:28:48.534242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.962 [2024-05-14 04:28:48.534255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.962 [2024-05-14 04:28:48.534261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.962 [2024-05-14 04:28:48.534266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.962 [2024-05-14 04:28:48.534278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.962 qpair failed and we were unable to recover it. 00:31:33.962 [2024-05-14 04:28:48.544164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:33.962 [2024-05-14 04:28:48.544284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:33.962 [2024-05-14 04:28:48.544303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:33.962 [2024-05-14 04:28:48.544308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:33.962 [2024-05-14 04:28:48.544313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:33.962 [2024-05-14 04:28:48.544324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:33.962 qpair failed and we were unable to recover it. 00:31:34.225 [2024-05-14 04:28:48.554150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.225 [2024-05-14 04:28:48.554235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.225 [2024-05-14 04:28:48.554248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.225 [2024-05-14 04:28:48.554253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.225 [2024-05-14 04:28:48.554258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.225 [2024-05-14 04:28:48.554269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.225 qpair failed and we were unable to recover it. 00:31:34.225 [2024-05-14 04:28:48.564145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.225 [2024-05-14 04:28:48.564231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.225 [2024-05-14 04:28:48.564244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.225 [2024-05-14 04:28:48.564250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.225 [2024-05-14 04:28:48.564254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.225 [2024-05-14 04:28:48.564265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.225 qpair failed and we were unable to recover it. 00:31:34.225 [2024-05-14 04:28:48.574264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.225 [2024-05-14 04:28:48.574359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.225 [2024-05-14 04:28:48.574373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.225 [2024-05-14 04:28:48.574378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.225 [2024-05-14 04:28:48.574382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.225 [2024-05-14 04:28:48.574394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.225 qpair failed and we were unable to recover it. 00:31:34.225 [2024-05-14 04:28:48.584276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.225 [2024-05-14 04:28:48.584389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.225 [2024-05-14 04:28:48.584402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.225 [2024-05-14 04:28:48.584407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.225 [2024-05-14 04:28:48.584411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.225 [2024-05-14 04:28:48.584423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.225 qpair failed and we were unable to recover it. 00:31:34.225 [2024-05-14 04:28:48.594316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.225 [2024-05-14 04:28:48.594403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.225 [2024-05-14 04:28:48.594419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.225 [2024-05-14 04:28:48.594425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.225 [2024-05-14 04:28:48.594429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.225 [2024-05-14 04:28:48.594441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.225 qpair failed and we were unable to recover it. 00:31:34.225 [2024-05-14 04:28:48.604344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.225 [2024-05-14 04:28:48.604436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.225 [2024-05-14 04:28:48.604449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.225 [2024-05-14 04:28:48.604454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.225 [2024-05-14 04:28:48.604459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.225 [2024-05-14 04:28:48.604471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.225 qpair failed and we were unable to recover it. 00:31:34.225 [2024-05-14 04:28:48.614356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.225 [2024-05-14 04:28:48.614456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.225 [2024-05-14 04:28:48.614470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.225 [2024-05-14 04:28:48.614475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.225 [2024-05-14 04:28:48.614479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.225 [2024-05-14 04:28:48.614491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.225 qpair failed and we were unable to recover it. 00:31:34.225 [2024-05-14 04:28:48.624406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.225 [2024-05-14 04:28:48.624491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.225 [2024-05-14 04:28:48.624505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.624510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.624514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.624527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.634389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.634482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.634495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.634500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.634505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.634520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.644325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.644414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.644427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.644432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.644436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.644448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.654487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.654602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.654616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.654621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.654626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.654637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.664428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.664523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.664536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.664543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.664547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.664559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.674535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.674621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.674635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.674640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.674644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.674656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.684571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.684690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.684706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.684711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.684716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.684727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.694604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.694725] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.694738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.694744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.694748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.694760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.704518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.704606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.704619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.704624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.704629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.704641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.714622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.714709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.714723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.714728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.714732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.714744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.724560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.724661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.724674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.724679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.724684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.724699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.734670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.734778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.734791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.734797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.734801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.734812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.744755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.744863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.744876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.744881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.744886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.744898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.754658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.754751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.226 [2024-05-14 04:28:48.754765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.226 [2024-05-14 04:28:48.754771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.226 [2024-05-14 04:28:48.754775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.226 [2024-05-14 04:28:48.754787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.226 qpair failed and we were unable to recover it. 00:31:34.226 [2024-05-14 04:28:48.764756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.226 [2024-05-14 04:28:48.764845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.227 [2024-05-14 04:28:48.764859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.227 [2024-05-14 04:28:48.764864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.227 [2024-05-14 04:28:48.764868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.227 [2024-05-14 04:28:48.764880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.227 qpair failed and we were unable to recover it. 00:31:34.227 [2024-05-14 04:28:48.774815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.227 [2024-05-14 04:28:48.774910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.227 [2024-05-14 04:28:48.774929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.227 [2024-05-14 04:28:48.774934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.227 [2024-05-14 04:28:48.774938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.227 [2024-05-14 04:28:48.774950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.227 qpair failed and we were unable to recover it. 00:31:34.227 [2024-05-14 04:28:48.784949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.227 [2024-05-14 04:28:48.785038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.227 [2024-05-14 04:28:48.785051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.227 [2024-05-14 04:28:48.785056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.227 [2024-05-14 04:28:48.785060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.227 [2024-05-14 04:28:48.785072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.227 qpair failed and we were unable to recover it. 00:31:34.227 [2024-05-14 04:28:48.794875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.227 [2024-05-14 04:28:48.794960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.227 [2024-05-14 04:28:48.794974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.227 [2024-05-14 04:28:48.794979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.227 [2024-05-14 04:28:48.794983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.227 [2024-05-14 04:28:48.794995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.227 qpair failed and we were unable to recover it. 00:31:34.227 [2024-05-14 04:28:48.804933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.227 [2024-05-14 04:28:48.805043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.227 [2024-05-14 04:28:48.805056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.227 [2024-05-14 04:28:48.805061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.227 [2024-05-14 04:28:48.805066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.227 [2024-05-14 04:28:48.805077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.227 qpair failed and we were unable to recover it. 00:31:34.490 [2024-05-14 04:28:48.814942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.490 [2024-05-14 04:28:48.815040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.490 [2024-05-14 04:28:48.815053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.490 [2024-05-14 04:28:48.815058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.490 [2024-05-14 04:28:48.815067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.490 [2024-05-14 04:28:48.815078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.490 qpair failed and we were unable to recover it. 00:31:34.490 [2024-05-14 04:28:48.824977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.490 [2024-05-14 04:28:48.825063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.490 [2024-05-14 04:28:48.825077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.490 [2024-05-14 04:28:48.825082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.490 [2024-05-14 04:28:48.825086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.490 [2024-05-14 04:28:48.825098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.490 qpair failed and we were unable to recover it. 00:31:34.490 [2024-05-14 04:28:48.834976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.490 [2024-05-14 04:28:48.835065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.490 [2024-05-14 04:28:48.835078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.490 [2024-05-14 04:28:48.835083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.490 [2024-05-14 04:28:48.835088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.490 [2024-05-14 04:28:48.835099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.490 qpair failed and we were unable to recover it. 00:31:34.490 [2024-05-14 04:28:48.845000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.490 [2024-05-14 04:28:48.845089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.490 [2024-05-14 04:28:48.845102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.490 [2024-05-14 04:28:48.845108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.490 [2024-05-14 04:28:48.845112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.490 [2024-05-14 04:28:48.845123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.490 qpair failed and we were unable to recover it. 00:31:34.490 [2024-05-14 04:28:48.855017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.490 [2024-05-14 04:28:48.855111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.490 [2024-05-14 04:28:48.855124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.490 [2024-05-14 04:28:48.855129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.490 [2024-05-14 04:28:48.855133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.490 [2024-05-14 04:28:48.855145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.490 qpair failed and we were unable to recover it. 00:31:34.490 [2024-05-14 04:28:48.865090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.490 [2024-05-14 04:28:48.865178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.490 [2024-05-14 04:28:48.865192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.490 [2024-05-14 04:28:48.865197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.490 [2024-05-14 04:28:48.865201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.490 [2024-05-14 04:28:48.865213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.490 qpair failed and we were unable to recover it. 00:31:34.490 [2024-05-14 04:28:48.875111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.490 [2024-05-14 04:28:48.875199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.490 [2024-05-14 04:28:48.875213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.490 [2024-05-14 04:28:48.875218] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.490 [2024-05-14 04:28:48.875222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.490 [2024-05-14 04:28:48.875234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.490 qpair failed and we were unable to recover it. 00:31:34.490 [2024-05-14 04:28:48.885133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.490 [2024-05-14 04:28:48.885218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.490 [2024-05-14 04:28:48.885231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.490 [2024-05-14 04:28:48.885237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.490 [2024-05-14 04:28:48.885241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.490 [2024-05-14 04:28:48.885252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.490 qpair failed and we were unable to recover it. 00:31:34.490 [2024-05-14 04:28:48.895186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.490 [2024-05-14 04:28:48.895276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.490 [2024-05-14 04:28:48.895289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.490 [2024-05-14 04:28:48.895299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.490 [2024-05-14 04:28:48.895304] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.490 [2024-05-14 04:28:48.895315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.490 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.905142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.905230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.905243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.905252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.905256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.905267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.915217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.915310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.915324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.915329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.915333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.915345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.925252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.925349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.925362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.925368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.925372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.925384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.935156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.935248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.935261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.935266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.935270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.935282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.945160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.945247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.945260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.945266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.945270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.945282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.955318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.955406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.955420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.955425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.955430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.955441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.965337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.965428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.965441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.965447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.965451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.965463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.975413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.975509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.975522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.975527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.975531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.975544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.985412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.985542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.985555] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.985560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.985565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.985576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:48.995438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:48.995527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:48.995540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:48.995548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:48.995553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:48.995564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:49.005473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:49.005561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:49.005575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:49.005580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:49.005584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:49.005596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:49.015492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:49.015586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:49.015599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:49.015604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:49.015608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:49.015620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:49.025506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:49.025593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:49.025606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:49.025611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.491 [2024-05-14 04:28:49.025616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.491 [2024-05-14 04:28:49.025628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.491 qpair failed and we were unable to recover it. 00:31:34.491 [2024-05-14 04:28:49.035557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.491 [2024-05-14 04:28:49.035640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.491 [2024-05-14 04:28:49.035653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.491 [2024-05-14 04:28:49.035659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.492 [2024-05-14 04:28:49.035663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.492 [2024-05-14 04:28:49.035674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.492 qpair failed and we were unable to recover it. 00:31:34.492 [2024-05-14 04:28:49.045607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.492 [2024-05-14 04:28:49.045711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.492 [2024-05-14 04:28:49.045724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.492 [2024-05-14 04:28:49.045730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.492 [2024-05-14 04:28:49.045734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.492 [2024-05-14 04:28:49.045746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.492 qpair failed and we were unable to recover it. 00:31:34.492 [2024-05-14 04:28:49.055635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.492 [2024-05-14 04:28:49.055729] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.492 [2024-05-14 04:28:49.055743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.492 [2024-05-14 04:28:49.055748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.492 [2024-05-14 04:28:49.055752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.492 [2024-05-14 04:28:49.055764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.492 qpair failed and we were unable to recover it. 00:31:34.492 [2024-05-14 04:28:49.065643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.492 [2024-05-14 04:28:49.065730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.492 [2024-05-14 04:28:49.065743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.492 [2024-05-14 04:28:49.065748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.492 [2024-05-14 04:28:49.065752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.492 [2024-05-14 04:28:49.065764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.492 qpair failed and we were unable to recover it. 00:31:34.492 [2024-05-14 04:28:49.075672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.492 [2024-05-14 04:28:49.075763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.492 [2024-05-14 04:28:49.075776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.492 [2024-05-14 04:28:49.075782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.492 [2024-05-14 04:28:49.075786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.492 [2024-05-14 04:28:49.075797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.492 qpair failed and we were unable to recover it. 00:31:34.757 [2024-05-14 04:28:49.085736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.085865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.085882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.085888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.085892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.085904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.095620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.095711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.095724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.095730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.095734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.095747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.105729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.105857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.105871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.105876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.105880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.105892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.115776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.115872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.115891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.115897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.115902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.115917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.125796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.125891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.125911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.125918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.125922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.125941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.135836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.135934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.135954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.135960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.135965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.135980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.145994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.146084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.146104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.146110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.146115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.146130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.155918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.156011] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.156030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.156036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.156041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.156056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.165944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.166037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.166056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.166063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.166067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.166082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.175940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.176070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.176093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.176100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.176105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.176119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.758 qpair failed and we were unable to recover it. 00:31:34.758 [2024-05-14 04:28:49.185983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.758 [2024-05-14 04:28:49.186077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.758 [2024-05-14 04:28:49.186091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.758 [2024-05-14 04:28:49.186097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.758 [2024-05-14 04:28:49.186101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.758 [2024-05-14 04:28:49.186113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.759 qpair failed and we were unable to recover it. 00:31:34.759 [2024-05-14 04:28:49.196026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.759 [2024-05-14 04:28:49.196122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.759 [2024-05-14 04:28:49.196141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.759 [2024-05-14 04:28:49.196147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.759 [2024-05-14 04:28:49.196153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.759 [2024-05-14 04:28:49.196168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.759 qpair failed and we were unable to recover it. 00:31:34.759 [2024-05-14 04:28:49.206035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.759 [2024-05-14 04:28:49.206120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.759 [2024-05-14 04:28:49.206135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.759 [2024-05-14 04:28:49.206140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.759 [2024-05-14 04:28:49.206145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.759 [2024-05-14 04:28:49.206157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.759 qpair failed and we were unable to recover it. 00:31:34.759 [2024-05-14 04:28:49.216085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.759 [2024-05-14 04:28:49.216185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.759 [2024-05-14 04:28:49.216198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.759 [2024-05-14 04:28:49.216203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.759 [2024-05-14 04:28:49.216208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.759 [2024-05-14 04:28:49.216223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.759 qpair failed and we were unable to recover it. 00:31:34.759 [2024-05-14 04:28:49.226058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.759 [2024-05-14 04:28:49.226143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.759 [2024-05-14 04:28:49.226156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.759 [2024-05-14 04:28:49.226162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.759 [2024-05-14 04:28:49.226166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.759 [2024-05-14 04:28:49.226178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.759 qpair failed and we were unable to recover it. 00:31:34.759 [2024-05-14 04:28:49.236138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.759 [2024-05-14 04:28:49.236227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.759 [2024-05-14 04:28:49.236241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.759 [2024-05-14 04:28:49.236247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.759 [2024-05-14 04:28:49.236251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.759 [2024-05-14 04:28:49.236263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.759 qpair failed and we were unable to recover it. 00:31:34.759 [2024-05-14 04:28:49.246173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.759 [2024-05-14 04:28:49.246258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.759 [2024-05-14 04:28:49.246271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.759 [2024-05-14 04:28:49.246276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.759 [2024-05-14 04:28:49.246281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.759 [2024-05-14 04:28:49.246297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.759 qpair failed and we were unable to recover it. 00:31:34.759 [2024-05-14 04:28:49.256214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.759 [2024-05-14 04:28:49.256306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.759 [2024-05-14 04:28:49.256320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.759 [2024-05-14 04:28:49.256325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.759 [2024-05-14 04:28:49.256330] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.759 [2024-05-14 04:28:49.256341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.759 qpair failed and we were unable to recover it. 00:31:34.759 [2024-05-14 04:28:49.266092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.759 [2024-05-14 04:28:49.266189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.759 [2024-05-14 04:28:49.266205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.759 [2024-05-14 04:28:49.266211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.759 [2024-05-14 04:28:49.266215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.759 [2024-05-14 04:28:49.266227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.759 qpair failed and we were unable to recover it. 00:31:34.759 [2024-05-14 04:28:49.276140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.759 [2024-05-14 04:28:49.276229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.759 [2024-05-14 04:28:49.276242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.759 [2024-05-14 04:28:49.276248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.760 [2024-05-14 04:28:49.276252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.760 [2024-05-14 04:28:49.276264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.760 qpair failed and we were unable to recover it. 00:31:34.760 [2024-05-14 04:28:49.286255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.760 [2024-05-14 04:28:49.286346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.760 [2024-05-14 04:28:49.286359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.760 [2024-05-14 04:28:49.286365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.760 [2024-05-14 04:28:49.286369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.760 [2024-05-14 04:28:49.286381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.760 qpair failed and we were unable to recover it. 00:31:34.760 [2024-05-14 04:28:49.296427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.760 [2024-05-14 04:28:49.296525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.760 [2024-05-14 04:28:49.296538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.760 [2024-05-14 04:28:49.296544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.760 [2024-05-14 04:28:49.296548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.760 [2024-05-14 04:28:49.296560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.760 qpair failed and we were unable to recover it. 00:31:34.760 [2024-05-14 04:28:49.306297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.760 [2024-05-14 04:28:49.306384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.760 [2024-05-14 04:28:49.306397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.760 [2024-05-14 04:28:49.306403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.760 [2024-05-14 04:28:49.306410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.760 [2024-05-14 04:28:49.306423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.760 qpair failed and we were unable to recover it. 00:31:34.760 [2024-05-14 04:28:49.316388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.760 [2024-05-14 04:28:49.316475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.760 [2024-05-14 04:28:49.316488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.760 [2024-05-14 04:28:49.316493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.760 [2024-05-14 04:28:49.316497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.760 [2024-05-14 04:28:49.316509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.760 qpair failed and we were unable to recover it. 00:31:34.760 [2024-05-14 04:28:49.326398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.760 [2024-05-14 04:28:49.326505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.760 [2024-05-14 04:28:49.326518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.760 [2024-05-14 04:28:49.326524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.760 [2024-05-14 04:28:49.326528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.760 [2024-05-14 04:28:49.326540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.760 qpair failed and we were unable to recover it. 00:31:34.760 [2024-05-14 04:28:49.336438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:34.760 [2024-05-14 04:28:49.336536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:34.760 [2024-05-14 04:28:49.336549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:34.760 [2024-05-14 04:28:49.336554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:34.760 [2024-05-14 04:28:49.336558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:34.760 [2024-05-14 04:28:49.336570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:34.760 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.346400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.346490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.346504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.346509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.346513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.346526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.356437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.356527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.356540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.356545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.356550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.356561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.366696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.366788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.366801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.366806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.366811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.366822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.376375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.376458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.376471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.376477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.376481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.376493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.386557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.386658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.386671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.386677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.386681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.386692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.396513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.396593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.396606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.396611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.396619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.396630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.406643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.406731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.406744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.406749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.406753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.406765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.416633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.416721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.416734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.416739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.416743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.416755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.426654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.426739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.426753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.426758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.426762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.426773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.436667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.436751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.436764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.436770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.436774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.436785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.024 qpair failed and we were unable to recover it. 00:31:35.024 [2024-05-14 04:28:49.446706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.024 [2024-05-14 04:28:49.446798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.024 [2024-05-14 04:28:49.446811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.024 [2024-05-14 04:28:49.446817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.024 [2024-05-14 04:28:49.446821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.024 [2024-05-14 04:28:49.446832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.456694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.456779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.456793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.456798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.456802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.456813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.466667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.466760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.466774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.466779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.466783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.466795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.476809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.476895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.476908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.476913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.476918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.476929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.486783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.486877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.486890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.486899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.486903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.486915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.496718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.496811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.496831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.496837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.496842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.496856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.506827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.506913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.506928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.506933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.506938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.506950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.516902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.516991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.517010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.517016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.517021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.517036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.526965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.527058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.527078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.527084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.527089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.527104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.536985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.537087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.537106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.537113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.537118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.537133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.546983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.547076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.547095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.547102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.547106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.547121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.557111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.557205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.557224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.557230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.557235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.557250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.567135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.567260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.567277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.567282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.567287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.567306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.577067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.577153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.577167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.577176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.025 [2024-05-14 04:28:49.577181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.025 [2024-05-14 04:28:49.577193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.025 qpair failed and we were unable to recover it. 00:31:35.025 [2024-05-14 04:28:49.587010] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.025 [2024-05-14 04:28:49.587091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.025 [2024-05-14 04:28:49.587105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.025 [2024-05-14 04:28:49.587110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.026 [2024-05-14 04:28:49.587115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.026 [2024-05-14 04:28:49.587127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.026 qpair failed and we were unable to recover it. 00:31:35.026 [2024-05-14 04:28:49.597169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.026 [2024-05-14 04:28:49.597257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.026 [2024-05-14 04:28:49.597270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.026 [2024-05-14 04:28:49.597275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.026 [2024-05-14 04:28:49.597280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.026 [2024-05-14 04:28:49.597297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.026 qpair failed and we were unable to recover it. 00:31:35.026 [2024-05-14 04:28:49.607151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.026 [2024-05-14 04:28:49.607238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.026 [2024-05-14 04:28:49.607251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.026 [2024-05-14 04:28:49.607257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.026 [2024-05-14 04:28:49.607261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.026 [2024-05-14 04:28:49.607273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.026 qpair failed and we were unable to recover it. 00:31:35.287 [2024-05-14 04:28:49.617132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.287 [2024-05-14 04:28:49.617222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.287 [2024-05-14 04:28:49.617235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.287 [2024-05-14 04:28:49.617240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.287 [2024-05-14 04:28:49.617245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.287 [2024-05-14 04:28:49.617256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.287 qpair failed and we were unable to recover it. 00:31:35.287 [2024-05-14 04:28:49.627161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.287 [2024-05-14 04:28:49.627244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.287 [2024-05-14 04:28:49.627258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.287 [2024-05-14 04:28:49.627263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.287 [2024-05-14 04:28:49.627267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.287 [2024-05-14 04:28:49.627279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.287 qpair failed and we were unable to recover it. 00:31:35.287 [2024-05-14 04:28:49.637256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.287 [2024-05-14 04:28:49.637341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.287 [2024-05-14 04:28:49.637355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.287 [2024-05-14 04:28:49.637360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.287 [2024-05-14 04:28:49.637365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.287 [2024-05-14 04:28:49.637377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.287 qpair failed and we were unable to recover it. 00:31:35.287 [2024-05-14 04:28:49.647310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.647398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.647412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.647417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.647421] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.647433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.657276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.657523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.657536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.657541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.657545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.657557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.667289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.667376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.667392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.667398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.667402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.667414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.677369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.677612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.677626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.677631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.677635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.677646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.687396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.687482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.687495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.687500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.687504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.687516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.697387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.697468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.697482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.697487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.697491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.697503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.707271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.707352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.707366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.707371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.707376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.707392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.717387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.717484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.717497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.717502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.717506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.717518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.727566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.727656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.727669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.727674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.727678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.727690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.737499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.737593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.737606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.737611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.737616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.737628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.747528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.747611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.747624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.747629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.747634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.747645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.757565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.757653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.757669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.757675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.757679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.757691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.767589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.767685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.767698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.767704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.767708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.767720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.288 [2024-05-14 04:28:49.777614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.288 [2024-05-14 04:28:49.777704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.288 [2024-05-14 04:28:49.777718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.288 [2024-05-14 04:28:49.777723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.288 [2024-05-14 04:28:49.777727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.288 [2024-05-14 04:28:49.777739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.288 qpair failed and we were unable to recover it. 00:31:35.289 [2024-05-14 04:28:49.787513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.289 [2024-05-14 04:28:49.787626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.289 [2024-05-14 04:28:49.787640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.289 [2024-05-14 04:28:49.787648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.289 [2024-05-14 04:28:49.787652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.289 [2024-05-14 04:28:49.787665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.289 qpair failed and we were unable to recover it. 00:31:35.289 [2024-05-14 04:28:49.797693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.289 [2024-05-14 04:28:49.797779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.289 [2024-05-14 04:28:49.797792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.289 [2024-05-14 04:28:49.797797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.289 [2024-05-14 04:28:49.797805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.289 [2024-05-14 04:28:49.797817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.289 qpair failed and we were unable to recover it. 00:31:35.289 [2024-05-14 04:28:49.807658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.289 [2024-05-14 04:28:49.807746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.289 [2024-05-14 04:28:49.807759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.289 [2024-05-14 04:28:49.807765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.289 [2024-05-14 04:28:49.807769] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.289 [2024-05-14 04:28:49.807780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.289 qpair failed and we were unable to recover it. 00:31:35.289 [2024-05-14 04:28:49.817620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.289 [2024-05-14 04:28:49.817717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.289 [2024-05-14 04:28:49.817731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.289 [2024-05-14 04:28:49.817736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.289 [2024-05-14 04:28:49.817740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.289 [2024-05-14 04:28:49.817752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.289 qpair failed and we were unable to recover it. 00:31:35.289 [2024-05-14 04:28:49.827801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.289 [2024-05-14 04:28:49.827923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.289 [2024-05-14 04:28:49.827937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.289 [2024-05-14 04:28:49.827942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.289 [2024-05-14 04:28:49.827946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.289 [2024-05-14 04:28:49.827959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.289 qpair failed and we were unable to recover it. 00:31:35.289 [2024-05-14 04:28:49.837823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.289 [2024-05-14 04:28:49.837946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.289 [2024-05-14 04:28:49.837959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.289 [2024-05-14 04:28:49.837964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.289 [2024-05-14 04:28:49.837969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.289 [2024-05-14 04:28:49.837980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.289 qpair failed and we were unable to recover it. 00:31:35.289 [2024-05-14 04:28:49.847834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.289 [2024-05-14 04:28:49.847927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.289 [2024-05-14 04:28:49.847940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.289 [2024-05-14 04:28:49.847945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.289 [2024-05-14 04:28:49.847949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.289 [2024-05-14 04:28:49.847961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.289 qpair failed and we were unable to recover it. 00:31:35.289 [2024-05-14 04:28:49.857833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.289 [2024-05-14 04:28:49.857935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.289 [2024-05-14 04:28:49.857948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.289 [2024-05-14 04:28:49.857953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.289 [2024-05-14 04:28:49.857958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.289 [2024-05-14 04:28:49.857969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.289 qpair failed and we were unable to recover it. 00:31:35.289 [2024-05-14 04:28:49.867878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.289 [2024-05-14 04:28:49.867964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.289 [2024-05-14 04:28:49.867977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.289 [2024-05-14 04:28:49.867982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.289 [2024-05-14 04:28:49.867987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.289 [2024-05-14 04:28:49.867998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.289 qpair failed and we were unable to recover it. 00:31:35.552 [2024-05-14 04:28:49.877931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.552 [2024-05-14 04:28:49.878055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.552 [2024-05-14 04:28:49.878069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.552 [2024-05-14 04:28:49.878074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.552 [2024-05-14 04:28:49.878078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.552 [2024-05-14 04:28:49.878090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.552 qpair failed and we were unable to recover it. 00:31:35.552 [2024-05-14 04:28:49.887952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.552 [2024-05-14 04:28:49.888041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.552 [2024-05-14 04:28:49.888054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.552 [2024-05-14 04:28:49.888059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.552 [2024-05-14 04:28:49.888067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.552 [2024-05-14 04:28:49.888079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.552 qpair failed and we were unable to recover it. 00:31:35.552 [2024-05-14 04:28:49.897851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.552 [2024-05-14 04:28:49.897945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.552 [2024-05-14 04:28:49.897965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.552 [2024-05-14 04:28:49.897971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.552 [2024-05-14 04:28:49.897976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.552 [2024-05-14 04:28:49.897990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.552 qpair failed and we were unable to recover it. 00:31:35.552 [2024-05-14 04:28:49.907988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.552 [2024-05-14 04:28:49.908114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.552 [2024-05-14 04:28:49.908129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.552 [2024-05-14 04:28:49.908134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.552 [2024-05-14 04:28:49.908139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.552 [2024-05-14 04:28:49.908151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.552 qpair failed and we were unable to recover it. 00:31:35.552 [2024-05-14 04:28:49.918040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.552 [2024-05-14 04:28:49.918144] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.552 [2024-05-14 04:28:49.918163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.552 [2024-05-14 04:28:49.918169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.552 [2024-05-14 04:28:49.918174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.552 [2024-05-14 04:28:49.918189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.552 qpair failed and we were unable to recover it. 00:31:35.552 [2024-05-14 04:28:49.928064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.552 [2024-05-14 04:28:49.928153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.552 [2024-05-14 04:28:49.928168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.552 [2024-05-14 04:28:49.928173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.552 [2024-05-14 04:28:49.928178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.552 [2024-05-14 04:28:49.928191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.552 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:49.938050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:49.938138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:49.938152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:49.938157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:49.938161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:49.938174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:49.948032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:49.948110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:49.948124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:49.948129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:49.948134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:49.948145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:49.958107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:49.958196] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:49.958209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:49.958214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:49.958218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:49.958230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:49.968170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:49.968257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:49.968270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:49.968276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:49.968280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:49.968297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:49.978162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:49.978251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:49.978264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:49.978273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:49.978277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:49.978289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:49.988153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:49.988243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:49.988257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:49.988262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:49.988266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:49.988278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:49.998235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:49.998349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:49.998363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:49.998369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:49.998373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:49.998385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:50.008175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:50.008267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:50.008281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:50.008287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:50.008296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:50.008309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:50.018173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:50.018427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:50.018441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:50.018446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:50.018450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:50.018462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:50.028304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:50.028399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:50.028413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:50.028418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:50.028422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:50.028434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:50.038369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:50.038463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:50.038476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:50.038482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:50.038486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:50.038499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:50.048412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:50.048526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:50.048539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:50.048546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:50.048550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:50.048563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:50.058436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:50.058534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:50.058548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:50.058554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.553 [2024-05-14 04:28:50.058558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.553 [2024-05-14 04:28:50.058571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.553 qpair failed and we were unable to recover it. 00:31:35.553 [2024-05-14 04:28:50.068376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.553 [2024-05-14 04:28:50.068461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.553 [2024-05-14 04:28:50.068475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.553 [2024-05-14 04:28:50.068484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.554 [2024-05-14 04:28:50.068489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.554 [2024-05-14 04:28:50.068501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.554 qpair failed and we were unable to recover it. 00:31:35.554 [2024-05-14 04:28:50.078368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.554 [2024-05-14 04:28:50.078455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.554 [2024-05-14 04:28:50.078469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.554 [2024-05-14 04:28:50.078474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.554 [2024-05-14 04:28:50.078479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.554 [2024-05-14 04:28:50.078491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.554 qpair failed and we were unable to recover it. 00:31:35.554 [2024-05-14 04:28:50.088381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.554 [2024-05-14 04:28:50.088509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.554 [2024-05-14 04:28:50.088523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.554 [2024-05-14 04:28:50.088528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.554 [2024-05-14 04:28:50.088532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.554 [2024-05-14 04:28:50.088544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.554 qpair failed and we were unable to recover it. 00:31:35.554 [2024-05-14 04:28:50.098494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.554 [2024-05-14 04:28:50.098585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.554 [2024-05-14 04:28:50.098599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.554 [2024-05-14 04:28:50.098604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.554 [2024-05-14 04:28:50.098608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.554 [2024-05-14 04:28:50.098620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.554 qpair failed and we were unable to recover it. 00:31:35.554 [2024-05-14 04:28:50.108537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.554 [2024-05-14 04:28:50.108624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.554 [2024-05-14 04:28:50.108637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.554 [2024-05-14 04:28:50.108643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.554 [2024-05-14 04:28:50.108648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.554 [2024-05-14 04:28:50.108659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.554 qpair failed and we were unable to recover it. 00:31:35.554 [2024-05-14 04:28:50.118503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.554 [2024-05-14 04:28:50.118589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.554 [2024-05-14 04:28:50.118602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.554 [2024-05-14 04:28:50.118607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.554 [2024-05-14 04:28:50.118611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.554 [2024-05-14 04:28:50.118623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.554 qpair failed and we were unable to recover it. 00:31:35.554 [2024-05-14 04:28:50.128623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.554 [2024-05-14 04:28:50.128713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.554 [2024-05-14 04:28:50.128726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.554 [2024-05-14 04:28:50.128732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.554 [2024-05-14 04:28:50.128736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.554 [2024-05-14 04:28:50.128748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.554 qpair failed and we were unable to recover it. 00:31:35.554 [2024-05-14 04:28:50.138589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.554 [2024-05-14 04:28:50.138674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.554 [2024-05-14 04:28:50.138687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.554 [2024-05-14 04:28:50.138692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.554 [2024-05-14 04:28:50.138696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.554 [2024-05-14 04:28:50.138708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.554 qpair failed and we were unable to recover it. 00:31:35.817 [2024-05-14 04:28:50.148601] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.817 [2024-05-14 04:28:50.148715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.817 [2024-05-14 04:28:50.148728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.817 [2024-05-14 04:28:50.148733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.817 [2024-05-14 04:28:50.148738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.817 [2024-05-14 04:28:50.148750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.817 qpair failed and we were unable to recover it. 00:31:35.817 [2024-05-14 04:28:50.158708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.817 [2024-05-14 04:28:50.158798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.817 [2024-05-14 04:28:50.158814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.817 [2024-05-14 04:28:50.158819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.817 [2024-05-14 04:28:50.158824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.158836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.168956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.169061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.169074] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.169080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.169084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.169096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.178609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.178701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.178721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.178727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.178732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.178747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.188750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.188831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.188846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.188852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.188856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.188869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.198753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.198839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.198853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.198859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.198863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.198879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.208777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.208870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.208883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.208888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.208892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.208903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.218719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.218807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.218820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.218826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.218831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.218843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.228818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.228899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.228913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.228918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.228922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.228934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.238925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.239016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.239036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.239042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.239046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.239061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.248993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.249086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.249112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.249118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.249123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.249138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.258850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.259112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.259132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.259138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.259143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.259158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.269031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.269114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.269129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.269134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.269138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.818 [2024-05-14 04:28:50.269151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.818 qpair failed and we were unable to recover it. 00:31:35.818 [2024-05-14 04:28:50.279070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.818 [2024-05-14 04:28:50.279153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.818 [2024-05-14 04:28:50.279166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.818 [2024-05-14 04:28:50.279171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.818 [2024-05-14 04:28:50.279176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.279188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.289099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.289188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.289202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.289207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.289211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.289227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.299080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.299178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.299192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.299198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.299202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.299214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.309116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.309201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.309215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.309220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.309225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.309236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.319058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.319144] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.319157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.319162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.319166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.319179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.329223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.329347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.329360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.329366] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.329370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.329382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.339086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.339185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.339199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.339204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.339209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.339221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.349109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.349190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.349203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.349209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.349213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.349224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.359297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.359384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.359397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.359403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.359407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.359419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.369334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.369422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.369436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.369441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.369445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.369457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.379323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.379421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.379434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.379440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.379451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.379463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.389304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.389383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.389396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.389402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.389406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.389418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:35.819 [2024-05-14 04:28:50.399384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:35.819 [2024-05-14 04:28:50.399485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:35.819 [2024-05-14 04:28:50.399498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:35.819 [2024-05-14 04:28:50.399504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:35.819 [2024-05-14 04:28:50.399509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:35.819 [2024-05-14 04:28:50.399521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:35.819 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.409448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.409539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.409552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.409557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.409562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.409573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.419435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.419522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.419535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.419540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.419544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.419556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.429325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.429411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.429425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.429430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.429434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.429446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.439522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.439617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.439630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.439636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.439640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.439651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.449533] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.449624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.449637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.449642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.449646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.449657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.459530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.459779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.459792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.459797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.459801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.459812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.469498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.469618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.469631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.469639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.469644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.469655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.479590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.479688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.479701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.479706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.479711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.479722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.489662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.489798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.489811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.489816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.489820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.489832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.499612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.499754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.499774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.499780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.499785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.499800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.509670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.509764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.509784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.509790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.509795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.083 [2024-05-14 04:28:50.509809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.083 qpair failed and we were unable to recover it. 00:31:36.083 [2024-05-14 04:28:50.519631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.083 [2024-05-14 04:28:50.519715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.083 [2024-05-14 04:28:50.519730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.083 [2024-05-14 04:28:50.519735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.083 [2024-05-14 04:28:50.519739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.519754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.529765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.529860] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.529874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.529880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.529884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.529896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.539720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.539815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.539835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.539841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.539846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.539860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.549755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.549845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.549864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.549870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.549875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.549890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.559681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.559761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.559775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.559784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.559789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.559802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.569879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.569971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.569992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.569998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.570003] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.570018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.579873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.579990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.580004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.580010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.580014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.580026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.589880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.589983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.590003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.590009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.590014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.590028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.599906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.599993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.600012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.600018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.600023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.600038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.609997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.610139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.610159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.610165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.610170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.610185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.619981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.620072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.620086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.620091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.620096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.620109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.629960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.630045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.630065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.630071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.630075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.630090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.640017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.640104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.640123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.640129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.640134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.640149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.650096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.650195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.650213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.650218] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.650223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.650235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.084 [2024-05-14 04:28:50.660071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.084 [2024-05-14 04:28:50.660163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.084 [2024-05-14 04:28:50.660176] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.084 [2024-05-14 04:28:50.660181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.084 [2024-05-14 04:28:50.660186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.084 [2024-05-14 04:28:50.660198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.084 qpair failed and we were unable to recover it. 00:31:36.347 [2024-05-14 04:28:50.670081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.347 [2024-05-14 04:28:50.670196] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.347 [2024-05-14 04:28:50.670211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.347 [2024-05-14 04:28:50.670219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.347 [2024-05-14 04:28:50.670224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.347 [2024-05-14 04:28:50.670236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.347 qpair failed and we were unable to recover it. 00:31:36.347 [2024-05-14 04:28:50.680113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.347 [2024-05-14 04:28:50.680204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.347 [2024-05-14 04:28:50.680218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.347 [2024-05-14 04:28:50.680223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.680228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.680240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.690181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.690269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.690282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.690287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.690299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.690315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.700174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.700265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.700278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.700283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.700288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.700305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.710212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.710453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.710467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.710472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.710476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.710487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.720236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.720325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.720338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.720343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.720348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.720359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.730275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.730376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.730389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.730394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.730399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.730410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.740152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.740238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.740254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.740260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.740264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.740276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.750326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.750409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.750423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.750428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.750432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.750444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.760348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.760433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.760446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.760451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.760455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.760467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.770347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.770465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.770478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.770484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.770488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.770500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.780395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.780480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.780493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.780499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.780503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.780519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.790426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.790510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.790523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.790528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.790533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.790545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.800325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.800410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.800423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.800428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.800433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.800445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.810515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.810602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.348 [2024-05-14 04:28:50.810615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.348 [2024-05-14 04:28:50.810620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.348 [2024-05-14 04:28:50.810624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.348 [2024-05-14 04:28:50.810637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.348 qpair failed and we were unable to recover it. 00:31:36.348 [2024-05-14 04:28:50.820473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.348 [2024-05-14 04:28:50.820576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.820589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.820594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.820599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.820610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.830501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.830580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.830596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.830602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.830606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.830618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.840567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.840677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.840687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.840692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.840696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.840706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.850638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.850733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.850746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.850751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.850756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.850767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.860784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.860875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.860888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.860893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.860897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.860909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.870695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.870819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.870839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.870845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.870854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.870869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.880673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.880798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.880812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.880817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.880822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.880834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.890747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.890856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.890869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.890875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.890879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.890891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.900733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.900830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.900843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.900849] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.900853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.900865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.910797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.910884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.910903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.910910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.910915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.910929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.920962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.921059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.921079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.921085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.921089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.921105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.349 [2024-05-14 04:28:50.930913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.349 [2024-05-14 04:28:50.931000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.349 [2024-05-14 04:28:50.931014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.349 [2024-05-14 04:28:50.931020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.349 [2024-05-14 04:28:50.931024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.349 [2024-05-14 04:28:50.931037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.349 qpair failed and we were unable to recover it. 00:31:36.612 [2024-05-14 04:28:50.940842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.612 [2024-05-14 04:28:50.940979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.612 [2024-05-14 04:28:50.940998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.612 [2024-05-14 04:28:50.941005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.612 [2024-05-14 04:28:50.941010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.612 [2024-05-14 04:28:50.941024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.612 qpair failed and we were unable to recover it. 00:31:36.612 [2024-05-14 04:28:50.950819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.612 [2024-05-14 04:28:50.950905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.612 [2024-05-14 04:28:50.950925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.612 [2024-05-14 04:28:50.950931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.612 [2024-05-14 04:28:50.950936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.612 [2024-05-14 04:28:50.950951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.612 qpair failed and we were unable to recover it. 00:31:36.612 [2024-05-14 04:28:50.960753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.612 [2024-05-14 04:28:50.960834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.612 [2024-05-14 04:28:50.960848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.612 [2024-05-14 04:28:50.960853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:50.960865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:50.960877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:50.970956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:50.971045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:50.971058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:50.971064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:50.971068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:50.971080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:50.980929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:50.981029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:50.981042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:50.981048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:50.981052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:50.981064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:50.990955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:50.991035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:50.991049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:50.991054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:50.991058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:50.991070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.000994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.001087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.001107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.001113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.001118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.001133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.011072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.011161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.011175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.011181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.011186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.011198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.021053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.021135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.021149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.021154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.021158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.021171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.031050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.031134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.031148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.031154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.031158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.031170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.041104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.041196] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.041209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.041215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.041219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.041231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.051066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.051154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.051168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.051176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.051181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.051192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.061134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.061226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.061239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.061245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.061249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.061261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.071150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.071247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.071260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.071265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.071270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.071281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.081223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.081459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.081472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.081477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.081481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.081493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.091257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.613 [2024-05-14 04:28:51.091347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.613 [2024-05-14 04:28:51.091361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.613 [2024-05-14 04:28:51.091366] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.613 [2024-05-14 04:28:51.091370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.613 [2024-05-14 04:28:51.091382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.613 qpair failed and we were unable to recover it. 00:31:36.613 [2024-05-14 04:28:51.101280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.101373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.101387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.101392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.101397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.101409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.614 [2024-05-14 04:28:51.111246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.111337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.111352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.111357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.111362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.111374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.614 [2024-05-14 04:28:51.121313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.121404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.121418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.121423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.121428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.121440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.614 [2024-05-14 04:28:51.131379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.131463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.131476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.131482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.131486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.131498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.614 [2024-05-14 04:28:51.141378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.141464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.141478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.141486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.141490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.141502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.614 [2024-05-14 04:28:51.151404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.151519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.151532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.151537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.151541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.151553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.614 [2024-05-14 04:28:51.161430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.161511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.161525] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.161530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.161534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.161546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.614 [2024-05-14 04:28:51.171520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.171607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.171620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.171626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.171630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.171641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.614 [2024-05-14 04:28:51.181495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.181595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.181608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.181613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.181618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.181629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.614 [2024-05-14 04:28:51.191494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.614 [2024-05-14 04:28:51.191582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.614 [2024-05-14 04:28:51.191596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.614 [2024-05-14 04:28:51.191601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.614 [2024-05-14 04:28:51.191605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.614 [2024-05-14 04:28:51.191617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.614 qpair failed and we were unable to recover it. 00:31:36.877 [2024-05-14 04:28:51.201731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.877 [2024-05-14 04:28:51.201816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.877 [2024-05-14 04:28:51.201829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.877 [2024-05-14 04:28:51.201834] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.877 [2024-05-14 04:28:51.201839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.877 [2024-05-14 04:28:51.201850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.877 qpair failed and we were unable to recover it. 00:31:36.877 [2024-05-14 04:28:51.211592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.877 [2024-05-14 04:28:51.211677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.877 [2024-05-14 04:28:51.211690] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.877 [2024-05-14 04:28:51.211695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.877 [2024-05-14 04:28:51.211700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.877 [2024-05-14 04:28:51.211711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.877 qpair failed and we were unable to recover it. 00:31:36.877 [2024-05-14 04:28:51.221605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.877 [2024-05-14 04:28:51.221688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.877 [2024-05-14 04:28:51.221701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.877 [2024-05-14 04:28:51.221707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.877 [2024-05-14 04:28:51.221711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.877 [2024-05-14 04:28:51.221723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.877 qpair failed and we were unable to recover it. 00:31:36.877 [2024-05-14 04:28:51.231586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.877 [2024-05-14 04:28:51.231663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.877 [2024-05-14 04:28:51.231679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.877 [2024-05-14 04:28:51.231685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.877 [2024-05-14 04:28:51.231689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.877 [2024-05-14 04:28:51.231700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.877 qpair failed and we were unable to recover it. 00:31:36.877 [2024-05-14 04:28:51.241628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.877 [2024-05-14 04:28:51.241735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.877 [2024-05-14 04:28:51.241748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.877 [2024-05-14 04:28:51.241754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.877 [2024-05-14 04:28:51.241758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.877 [2024-05-14 04:28:51.241769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.877 qpair failed and we were unable to recover it. 00:31:36.877 [2024-05-14 04:28:51.251721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.877 [2024-05-14 04:28:51.251805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.877 [2024-05-14 04:28:51.251818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.251824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.251828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.251839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.261708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.261803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.261822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.261829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.261834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.261849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.271694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.271777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.271796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.271802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.271807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.271825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.281739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.281821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.281840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.281846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.281851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.281866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.291821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.291908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.291923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.291928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.291932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.291944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.301831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.301920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.301939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.301946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.301950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.301965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.311826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.311917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.311937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.311943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.311948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.311963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.321863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.321948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.321966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.321972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.321977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.321991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.331987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.332106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.332120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.332125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.332129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.332143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.341903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.341991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.342005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.342010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.342015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.342027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.351907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.352013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.352032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.352039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.352043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.352058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.361955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.362039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.362054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.362060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.362069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.362081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.372051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.372142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.372161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.372168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.372172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.372187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.382007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.878 [2024-05-14 04:28:51.382092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.878 [2024-05-14 04:28:51.382107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.878 [2024-05-14 04:28:51.382112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.878 [2024-05-14 04:28:51.382117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.878 [2024-05-14 04:28:51.382129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.878 qpair failed and we were unable to recover it. 00:31:36.878 [2024-05-14 04:28:51.392006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.879 [2024-05-14 04:28:51.392089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.879 [2024-05-14 04:28:51.392102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.879 [2024-05-14 04:28:51.392107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.879 [2024-05-14 04:28:51.392112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.879 [2024-05-14 04:28:51.392123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.879 qpair failed and we were unable to recover it. 00:31:36.879 [2024-05-14 04:28:51.402121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.879 [2024-05-14 04:28:51.402202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.879 [2024-05-14 04:28:51.402217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.879 [2024-05-14 04:28:51.402222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.879 [2024-05-14 04:28:51.402228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.879 [2024-05-14 04:28:51.402242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.879 qpair failed and we were unable to recover it. 00:31:36.879 [2024-05-14 04:28:51.412145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.879 [2024-05-14 04:28:51.412239] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.879 [2024-05-14 04:28:51.412254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.879 [2024-05-14 04:28:51.412260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.879 [2024-05-14 04:28:51.412265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.879 [2024-05-14 04:28:51.412277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.879 qpair failed and we were unable to recover it. 00:31:36.879 [2024-05-14 04:28:51.422095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.879 [2024-05-14 04:28:51.422207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.879 [2024-05-14 04:28:51.422217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.879 [2024-05-14 04:28:51.422222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.879 [2024-05-14 04:28:51.422226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.879 [2024-05-14 04:28:51.422236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.879 qpair failed and we were unable to recover it. 00:31:36.879 [2024-05-14 04:28:51.432161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.879 [2024-05-14 04:28:51.432237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.879 [2024-05-14 04:28:51.432250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.879 [2024-05-14 04:28:51.432256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.879 [2024-05-14 04:28:51.432260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.879 [2024-05-14 04:28:51.432272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.879 qpair failed and we were unable to recover it. 00:31:36.879 [2024-05-14 04:28:51.442199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.879 [2024-05-14 04:28:51.442288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.879 [2024-05-14 04:28:51.442305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.879 [2024-05-14 04:28:51.442310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.879 [2024-05-14 04:28:51.442314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.879 [2024-05-14 04:28:51.442326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.879 qpair failed and we were unable to recover it. 00:31:36.879 [2024-05-14 04:28:51.452225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.879 [2024-05-14 04:28:51.452315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.879 [2024-05-14 04:28:51.452328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.879 [2024-05-14 04:28:51.452333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.879 [2024-05-14 04:28:51.452340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.879 [2024-05-14 04:28:51.452352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.879 qpair failed and we were unable to recover it. 00:31:36.879 [2024-05-14 04:28:51.462240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:36.879 [2024-05-14 04:28:51.462348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:36.879 [2024-05-14 04:28:51.462362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:36.879 [2024-05-14 04:28:51.462367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:36.879 [2024-05-14 04:28:51.462371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:36.879 [2024-05-14 04:28:51.462383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:36.879 qpair failed and we were unable to recover it. 00:31:37.142 [2024-05-14 04:28:51.472119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.142 [2024-05-14 04:28:51.472204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.142 [2024-05-14 04:28:51.472216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.142 [2024-05-14 04:28:51.472222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.142 [2024-05-14 04:28:51.472226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.142 [2024-05-14 04:28:51.472238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.142 qpair failed and we were unable to recover it. 00:31:37.142 [2024-05-14 04:28:51.482296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.142 [2024-05-14 04:28:51.482381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.142 [2024-05-14 04:28:51.482395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.142 [2024-05-14 04:28:51.482400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.482404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.482416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.492376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.492462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.492475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.492480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.492484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.492496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.502336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.502425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.502438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.502444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.502448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.502459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.512373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.512457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.512470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.512475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.512480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.512492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.522392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.522471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.522484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.522489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.522494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.522506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.532443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.532538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.532552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.532557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.532561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.532574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.542424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.542513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.542527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.542535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.542539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.542551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.552473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.552809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.552823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.552828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.552832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.552844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.562551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.562634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.562647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.562652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.562657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.562668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.572449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.572538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.572551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.572556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.572561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.572572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.582561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.582646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.582660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.582665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.582669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.582681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.592587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.592686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.592699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.592704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.592709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.592720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.602768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.602852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.602865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.602870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.602874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.602886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.612610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.612702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.143 [2024-05-14 04:28:51.612722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.143 [2024-05-14 04:28:51.612728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.143 [2024-05-14 04:28:51.612733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.143 [2024-05-14 04:28:51.612747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.143 qpair failed and we were unable to recover it. 00:31:37.143 [2024-05-14 04:28:51.622700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.143 [2024-05-14 04:28:51.622799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.622813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.622818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.622823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.622835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.632604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.632687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.632701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.632710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.632715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.632727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.642735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.642816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.642830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.642835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.642839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.642851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.652818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.652914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.652927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.652932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.652937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.652948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.662757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.662850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.662870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.662876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.662881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.662895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.672715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.672820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.672835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.672841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.672845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.672858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.682856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.682942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.682961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.682967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.682972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.682987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.692939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.693031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.693051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.693058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.693062] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.693078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.702891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.702983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.703002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.703009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.703014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.703029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.712954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.713051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.713071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.713078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.713082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.713097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.144 [2024-05-14 04:28:51.722985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.144 [2024-05-14 04:28:51.723072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.144 [2024-05-14 04:28:51.723090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.144 [2024-05-14 04:28:51.723096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.144 [2024-05-14 04:28:51.723101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.144 [2024-05-14 04:28:51.723113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.144 qpair failed and we were unable to recover it. 00:31:37.407 [2024-05-14 04:28:51.733028] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.407 [2024-05-14 04:28:51.733130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.407 [2024-05-14 04:28:51.733144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.407 [2024-05-14 04:28:51.733149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.407 [2024-05-14 04:28:51.733154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.407 [2024-05-14 04:28:51.733166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.407 qpair failed and we were unable to recover it. 00:31:37.407 [2024-05-14 04:28:51.743052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.407 [2024-05-14 04:28:51.743173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.407 [2024-05-14 04:28:51.743193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.407 [2024-05-14 04:28:51.743200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.407 [2024-05-14 04:28:51.743205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.407 [2024-05-14 04:28:51.743219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.753028] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.753111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.753125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.753131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.753136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.753148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.763093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.763178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.763192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.763197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.763202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.763218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.773060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.773197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.773211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.773216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.773221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.773233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.783143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.783240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.783254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.783259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.783263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.783275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.793149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.793229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.793243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.793248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.793252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.793264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.803188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.803267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.803280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.803286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.803296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.803308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.813324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.813413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.813429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.813435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.813440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.813451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.823285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.823405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.823420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.823425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.823429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.823442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.833304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.833390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.833404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.833409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.833413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.833425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.843329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.843416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.843429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.843434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.843439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.843450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.853413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.853535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.853548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.853553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.853557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.853571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.863392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.863483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.863496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.863501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.863505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.863517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.873367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.873446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.873459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.408 [2024-05-14 04:28:51.873465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.408 [2024-05-14 04:28:51.873469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.408 [2024-05-14 04:28:51.873481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.408 qpair failed and we were unable to recover it. 00:31:37.408 [2024-05-14 04:28:51.883297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.408 [2024-05-14 04:28:51.883383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.408 [2024-05-14 04:28:51.883396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.883402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.883406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.883418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.893373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.893459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.893473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.893479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.893483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.893495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.903476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.903562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.903576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.903582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.903586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.903598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.913527] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.913606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.913620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.913625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.913630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.913641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.923582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.923665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.923678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.923684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.923688] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.923700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.933624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.933711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.933725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.933730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.933734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.933746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.943580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.943670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.943683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.943688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.943695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.943707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.953496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.953580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.953593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.953598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.953603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.953614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.963615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.963711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.963724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.963729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.963733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.963745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.973731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.973816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.973830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.973835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.973839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.973851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.983713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.983845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.983858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.983864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.983868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.983880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.409 [2024-05-14 04:28:51.993672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.409 [2024-05-14 04:28:51.993754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.409 [2024-05-14 04:28:51.993767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.409 [2024-05-14 04:28:51.993773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.409 [2024-05-14 04:28:51.993777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.409 [2024-05-14 04:28:51.993788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.409 qpair failed and we were unable to recover it. 00:31:37.672 [2024-05-14 04:28:52.003764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.672 [2024-05-14 04:28:52.003849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.672 [2024-05-14 04:28:52.003862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.672 [2024-05-14 04:28:52.003867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.672 [2024-05-14 04:28:52.003871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.672 [2024-05-14 04:28:52.003883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.672 qpair failed and we were unable to recover it. 00:31:37.672 [2024-05-14 04:28:52.013812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.672 [2024-05-14 04:28:52.013899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.672 [2024-05-14 04:28:52.013913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.672 [2024-05-14 04:28:52.013918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.672 [2024-05-14 04:28:52.013923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.672 [2024-05-14 04:28:52.013934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.672 qpair failed and we were unable to recover it. 00:31:37.672 [2024-05-14 04:28:52.023832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.023924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.023937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.023943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.023947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.023958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.033839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.033924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.033943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.033953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.033958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.033974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.043880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.043967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.043986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.043992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.043997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.044012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.053934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.054034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.054054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.054060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.054065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.054079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.063857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.063948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.063968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.063974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.063978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.063994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.073888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.073992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.074012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.074018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.074024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.074039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.083982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.084065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.084085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.084091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.084096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.084111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.094075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.094165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.094185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.094191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.094195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.094210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.104066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.104176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.104191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.104196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.104200] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.104213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.114110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.114195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.114208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.114213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.114218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.114229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.123977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.124055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.124068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.124077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.124081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.124093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.134156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.134243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.134256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.134262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.134266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.134277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.144231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.144331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.144344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.144349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.144354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.673 [2024-05-14 04:28:52.144366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.673 qpair failed and we were unable to recover it. 00:31:37.673 [2024-05-14 04:28:52.154178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.673 [2024-05-14 04:28:52.154256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.673 [2024-05-14 04:28:52.154270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.673 [2024-05-14 04:28:52.154275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.673 [2024-05-14 04:28:52.154279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.154296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.164209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.164327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.164340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.164346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.164350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.164362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.174238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.174328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.174341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.174347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.174351] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.174362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.184316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.184401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.184414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.184419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.184423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.184435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.194286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.194369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.194383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.194388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.194392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.194404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.204185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.204266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.204280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.204285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.204290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.204308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.214254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.214348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.214365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.214370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.214375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.214386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.224371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.224497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.224510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.224516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.224520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.224532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.234277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.234366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.234380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.234386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.234390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.234402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.244431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.244513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.244527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.244532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.244536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.244548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.674 [2024-05-14 04:28:52.254482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.674 [2024-05-14 04:28:52.254570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.674 [2024-05-14 04:28:52.254584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.674 [2024-05-14 04:28:52.254589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.674 [2024-05-14 04:28:52.254593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.674 [2024-05-14 04:28:52.254608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.674 qpair failed and we were unable to recover it. 00:31:37.937 [2024-05-14 04:28:52.264669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.937 [2024-05-14 04:28:52.264755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.937 [2024-05-14 04:28:52.264768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.937 [2024-05-14 04:28:52.264773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.937 [2024-05-14 04:28:52.264777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.937 [2024-05-14 04:28:52.264789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.937 qpair failed and we were unable to recover it. 00:31:37.937 [2024-05-14 04:28:52.274522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.937 [2024-05-14 04:28:52.274602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.937 [2024-05-14 04:28:52.274615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.937 [2024-05-14 04:28:52.274621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.937 [2024-05-14 04:28:52.274625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.937 [2024-05-14 04:28:52.274636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.937 qpair failed and we were unable to recover it. 00:31:37.937 [2024-05-14 04:28:52.284554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.937 [2024-05-14 04:28:52.284633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.284646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.284652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.284656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.284668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.294603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.294691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.294704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.294709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.294713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.294725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.304615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.304700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.304716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.304721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.304726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.304737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.314596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.314683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.314697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.314702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.314706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.314718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.324645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.324725] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.324739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.324744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.324748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.324759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.334688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.334774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.334787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.334792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.334797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.334808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.344639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.344768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.344782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.344787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.344791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.344805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.354734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.354818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.354831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.354836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.354841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.354852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.364767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.364845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.364858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.364863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.364867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.364878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.374800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.374885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.374899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.374904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.374908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.374920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.384844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.384937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.384957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.384963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.384968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.384983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.394851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.394964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.394983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.394989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.394994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.395007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.404908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.404995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.405014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.405021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.405026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.405041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.938 qpair failed and we were unable to recover it. 00:31:37.938 [2024-05-14 04:28:52.414952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.938 [2024-05-14 04:28:52.415048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.938 [2024-05-14 04:28:52.415068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.938 [2024-05-14 04:28:52.415074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.938 [2024-05-14 04:28:52.415078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.938 [2024-05-14 04:28:52.415093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.424954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.425089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.425108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.425115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.425120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.425135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.434916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.435001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.435020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.435027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.435038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.435053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.445018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.445104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.445124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.445130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.445135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.445149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.454938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.455031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.455051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.455057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.455061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.455076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.465044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.465135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.465155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.465161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.465166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.465181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.475109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.475194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.475209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.475214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.475218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.475231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.485090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.485175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.485189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.485194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.485198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.485210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.495085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.495175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.495189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.495194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.495198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.495210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.505165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.505250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.505264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.505269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.505274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.505285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:37.939 [2024-05-14 04:28:52.515140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:37.939 [2024-05-14 04:28:52.515227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:37.939 [2024-05-14 04:28:52.515240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:37.939 [2024-05-14 04:28:52.515246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:37.939 [2024-05-14 04:28:52.515250] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:37.939 [2024-05-14 04:28:52.515261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:37.939 qpair failed and we were unable to recover it. 00:31:38.202 [2024-05-14 04:28:52.525077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.202 [2024-05-14 04:28:52.525161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.202 [2024-05-14 04:28:52.525174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.202 [2024-05-14 04:28:52.525180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.202 [2024-05-14 04:28:52.525187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.525199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 [2024-05-14 04:28:52.535309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.535424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.535438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.203 [2024-05-14 04:28:52.535443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.203 [2024-05-14 04:28:52.535447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.535460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 [2024-05-14 04:28:52.545307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.545413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.545426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.203 [2024-05-14 04:28:52.545431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.203 [2024-05-14 04:28:52.545436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.545447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 [2024-05-14 04:28:52.555243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.555331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.555344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.203 [2024-05-14 04:28:52.555350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.203 [2024-05-14 04:28:52.555354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.555366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 [2024-05-14 04:28:52.565234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.565322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.565336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.203 [2024-05-14 04:28:52.565341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.203 [2024-05-14 04:28:52.565346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.565357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 [2024-05-14 04:28:52.575392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.575481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.575494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.203 [2024-05-14 04:28:52.575500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.203 [2024-05-14 04:28:52.575504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.575516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 [2024-05-14 04:28:52.585408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.585496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.585509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.203 [2024-05-14 04:28:52.585514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.203 [2024-05-14 04:28:52.585519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.585531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 [2024-05-14 04:28:52.595420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.595546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.595560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.203 [2024-05-14 04:28:52.595566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.203 [2024-05-14 04:28:52.595570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.595581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 [2024-05-14 04:28:52.605474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.605590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.605603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.203 [2024-05-14 04:28:52.605609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.203 [2024-05-14 04:28:52.605613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.605624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 [2024-05-14 04:28:52.615524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.615648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.615661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.203 [2024-05-14 04:28:52.615670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.203 [2024-05-14 04:28:52.615674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4558000b90 00:31:38.203 [2024-05-14 04:28:52.615686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:31:38.203 qpair failed and we were unable to recover it. 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Write completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Write completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Write completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Write completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Write completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Write completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Write completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Write completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 Read completed with error (sct=0, sc=8) 00:31:38.203 starting I/O failed 00:31:38.203 [2024-05-14 04:28:52.616561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:38.203 [2024-05-14 04:28:52.625608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.203 [2024-05-14 04:28:52.625871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.203 [2024-05-14 04:28:52.625927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.204 [2024-05-14 04:28:52.625951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.204 [2024-05-14 04:28:52.625971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4560000b90 00:31:38.204 [2024-05-14 04:28:52.626018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:38.204 qpair failed and we were unable to recover it. 00:31:38.204 [2024-05-14 04:28:52.635639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.204 [2024-05-14 04:28:52.635846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.204 [2024-05-14 04:28:52.635899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.204 [2024-05-14 04:28:52.635918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.204 [2024-05-14 04:28:52.635940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4560000b90 00:31:38.204 [2024-05-14 04:28:52.635981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:31:38.204 qpair failed and we were unable to recover it. 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 [2024-05-14 04:28:52.636833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:38.204 [2024-05-14 04:28:52.645692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.204 [2024-05-14 04:28:52.645970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.204 [2024-05-14 04:28:52.646037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.204 [2024-05-14 04:28:52.646063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.204 [2024-05-14 04:28:52.646084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4550000b90 00:31:38.204 [2024-05-14 04:28:52.646138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:38.204 qpair failed and we were unable to recover it. 00:31:38.204 [2024-05-14 04:28:52.655715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.204 [2024-05-14 04:28:52.655932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.204 [2024-05-14 04:28:52.655965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.204 [2024-05-14 04:28:52.655980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.204 [2024-05-14 04:28:52.655993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f4550000b90 00:31:38.204 [2024-05-14 04:28:52.656024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:31:38.204 qpair failed and we were unable to recover it. 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Read completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 Write completed with error (sct=0, sc=8) 00:31:38.204 starting I/O failed 00:31:38.204 [2024-05-14 04:28:52.656454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:31:38.204 [2024-05-14 04:28:52.665607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.204 [2024-05-14 04:28:52.665736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.204 [2024-05-14 04:28:52.665762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.204 [2024-05-14 04:28:52.665771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.204 [2024-05-14 04:28:52.665778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf88d90 00:31:38.204 [2024-05-14 04:28:52.665798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:31:38.204 qpair failed and we were unable to recover it. 00:31:38.204 [2024-05-14 04:28:52.675792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:31:38.204 [2024-05-14 04:28:52.675903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:31:38.204 [2024-05-14 04:28:52.675929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:31:38.204 [2024-05-14 04:28:52.675938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:31:38.204 [2024-05-14 04:28:52.675945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf88d90 00:31:38.204 [2024-05-14 04:28:52.675965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:31:38.204 qpair failed and we were unable to recover it. 00:31:38.204 [2024-05-14 04:28:52.676343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf87b50 is same with the state(5) to be set 00:31:38.204 [2024-05-14 04:28:52.676656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf87b50 (9): Bad file descriptor 00:31:38.204 Initializing NVMe Controllers 00:31:38.204 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:31:38.204 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:31:38.204 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:31:38.205 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:31:38.205 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:31:38.205 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:31:38.205 Initialization complete. Launching workers. 00:31:38.205 Starting thread on core 1 00:31:38.205 Starting thread on core 2 00:31:38.205 Starting thread on core 3 00:31:38.205 Starting thread on core 0 00:31:38.205 04:28:52 -- host/target_disconnect.sh@59 -- # sync 00:31:38.205 00:31:38.205 real 0m11.375s 00:31:38.205 user 0m19.673s 00:31:38.205 sys 0m4.417s 00:31:38.205 04:28:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:38.205 04:28:52 -- common/autotest_common.sh@10 -- # set +x 00:31:38.205 ************************************ 00:31:38.205 END TEST nvmf_target_disconnect_tc2 00:31:38.205 ************************************ 00:31:38.205 04:28:52 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:31:38.205 04:28:52 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:31:38.205 04:28:52 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:31:38.205 04:28:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:38.205 04:28:52 -- nvmf/common.sh@116 -- # sync 00:31:38.205 04:28:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:38.205 04:28:52 -- nvmf/common.sh@119 -- # set +e 00:31:38.205 04:28:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:38.205 04:28:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:38.205 rmmod nvme_tcp 00:31:38.205 rmmod nvme_fabrics 00:31:38.205 rmmod nvme_keyring 00:31:38.205 04:28:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:38.205 04:28:52 -- nvmf/common.sh@123 -- # set -e 00:31:38.205 04:28:52 -- nvmf/common.sh@124 -- # return 0 00:31:38.205 04:28:52 -- nvmf/common.sh@477 -- # '[' -n 4150680 ']' 00:31:38.205 04:28:52 -- nvmf/common.sh@478 -- # killprocess 4150680 00:31:38.205 04:28:52 -- common/autotest_common.sh@926 -- # '[' -z 4150680 ']' 00:31:38.205 04:28:52 -- common/autotest_common.sh@930 -- # kill -0 4150680 00:31:38.466 04:28:52 -- common/autotest_common.sh@931 -- # uname 00:31:38.466 04:28:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:38.466 04:28:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4150680 00:31:38.466 04:28:52 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:31:38.466 04:28:52 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:31:38.466 04:28:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4150680' 00:31:38.466 killing process with pid 4150680 00:31:38.466 04:28:52 -- common/autotest_common.sh@945 -- # kill 4150680 00:31:38.466 04:28:52 -- common/autotest_common.sh@950 -- # wait 4150680 00:31:38.466 04:28:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:38.466 04:28:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:38.466 04:28:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:38.467 04:28:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:38.467 04:28:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:38.467 04:28:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:38.467 04:28:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:38.467 04:28:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:41.016 04:28:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:41.016 00:31:41.016 real 0m21.337s 00:31:41.016 user 0m47.406s 00:31:41.016 sys 0m10.191s 00:31:41.016 04:28:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:41.016 04:28:55 -- common/autotest_common.sh@10 -- # set +x 00:31:41.016 ************************************ 00:31:41.016 END TEST nvmf_target_disconnect 00:31:41.016 ************************************ 00:31:41.016 04:28:55 -- nvmf/nvmf.sh@126 -- # timing_exit host 00:31:41.016 04:28:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:41.016 04:28:55 -- common/autotest_common.sh@10 -- # set +x 00:31:41.016 04:28:55 -- nvmf/nvmf.sh@128 -- # trap - SIGINT SIGTERM EXIT 00:31:41.016 00:31:41.016 real 24m20.086s 00:31:41.016 user 63m53.392s 00:31:41.016 sys 6m41.927s 00:31:41.016 04:28:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:41.016 04:28:55 -- common/autotest_common.sh@10 -- # set +x 00:31:41.016 ************************************ 00:31:41.016 END TEST nvmf_tcp 00:31:41.016 ************************************ 00:31:41.016 04:28:55 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:31:41.016 04:28:55 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:41.016 04:28:55 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:31:41.016 04:28:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:41.016 04:28:55 -- common/autotest_common.sh@10 -- # set +x 00:31:41.016 ************************************ 00:31:41.016 START TEST spdkcli_nvmf_tcp 00:31:41.016 ************************************ 00:31:41.016 04:28:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:31:41.016 * Looking for test storage... 00:31:41.016 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:31:41.016 04:28:55 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:31:41.016 04:28:55 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:31:41.016 04:28:55 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:31:41.016 04:28:55 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:41.016 04:28:55 -- nvmf/common.sh@7 -- # uname -s 00:31:41.016 04:28:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:41.016 04:28:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:41.016 04:28:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:41.017 04:28:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:41.017 04:28:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:41.017 04:28:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:41.017 04:28:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:41.017 04:28:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:41.017 04:28:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:41.017 04:28:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:41.017 04:28:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:31:41.017 04:28:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:31:41.017 04:28:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:41.017 04:28:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:41.017 04:28:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:41.017 04:28:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:41.017 04:28:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:41.017 04:28:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:41.017 04:28:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:41.017 04:28:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.017 04:28:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.017 04:28:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.017 04:28:55 -- paths/export.sh@5 -- # export PATH 00:31:41.017 04:28:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.017 04:28:55 -- nvmf/common.sh@46 -- # : 0 00:31:41.017 04:28:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:41.017 04:28:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:41.017 04:28:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:41.017 04:28:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:41.017 04:28:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:41.017 04:28:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:41.017 04:28:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:41.017 04:28:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:41.017 04:28:55 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:31:41.017 04:28:55 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:31:41.017 04:28:55 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:31:41.017 04:28:55 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:31:41.017 04:28:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:41.017 04:28:55 -- common/autotest_common.sh@10 -- # set +x 00:31:41.017 04:28:55 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:31:41.017 04:28:55 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=4152528 00:31:41.017 04:28:55 -- spdkcli/common.sh@34 -- # waitforlisten 4152528 00:31:41.017 04:28:55 -- common/autotest_common.sh@819 -- # '[' -z 4152528 ']' 00:31:41.017 04:28:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:41.017 04:28:55 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:31:41.017 04:28:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:41.017 04:28:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:41.017 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:41.017 04:28:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:41.017 04:28:55 -- common/autotest_common.sh@10 -- # set +x 00:31:41.017 [2024-05-14 04:28:55.367874] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:31:41.017 [2024-05-14 04:28:55.367935] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4152528 ] 00:31:41.017 EAL: No free 2048 kB hugepages reported on node 1 00:31:41.017 [2024-05-14 04:28:55.427225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:31:41.017 [2024-05-14 04:28:55.491082] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:41.017 [2024-05-14 04:28:55.491323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:41.017 [2024-05-14 04:28:55.491350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:41.590 04:28:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:41.590 04:28:56 -- common/autotest_common.sh@852 -- # return 0 00:31:41.590 04:28:56 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:31:41.590 04:28:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:41.590 04:28:56 -- common/autotest_common.sh@10 -- # set +x 00:31:41.590 04:28:56 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:31:41.590 04:28:56 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:31:41.590 04:28:56 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:31:41.590 04:28:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:41.590 04:28:56 -- common/autotest_common.sh@10 -- # set +x 00:31:41.590 04:28:56 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:31:41.590 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:31:41.590 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:31:41.590 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:31:41.590 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:31:41.590 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:31:41.590 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:31:41.590 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:41.590 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:41.590 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:31:41.590 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:31:41.590 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:31:41.590 ' 00:31:42.162 [2024-05-14 04:28:56.495613] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:44.108 [2024-05-14 04:28:58.639419] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:45.493 [2024-05-14 04:28:59.939604] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:31:48.040 [2024-05-14 04:29:02.371040] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:31:49.954 [2024-05-14 04:29:04.453229] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:31:51.870 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:31:51.870 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:31:51.870 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:31:51.870 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:31:51.870 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:31:51.870 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:31:51.870 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:31:51.870 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:51.870 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:51.870 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:31:51.870 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:31:51.870 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:31:51.870 04:29:06 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:31:51.870 04:29:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:51.870 04:29:06 -- common/autotest_common.sh@10 -- # set +x 00:31:51.870 04:29:06 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:31:51.870 04:29:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:51.870 04:29:06 -- common/autotest_common.sh@10 -- # set +x 00:31:51.870 04:29:06 -- spdkcli/nvmf.sh@69 -- # check_match 00:31:51.870 04:29:06 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:31:52.132 04:29:06 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:31:52.132 04:29:06 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:31:52.132 04:29:06 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:31:52.132 04:29:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:52.132 04:29:06 -- common/autotest_common.sh@10 -- # set +x 00:31:52.132 04:29:06 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:31:52.132 04:29:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:52.132 04:29:06 -- common/autotest_common.sh@10 -- # set +x 00:31:52.132 04:29:06 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:31:52.132 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:31:52.132 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:52.132 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:31:52.132 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:31:52.132 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:31:52.132 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:31:52.132 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:52.132 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:31:52.132 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:31:52.132 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:31:52.132 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:31:52.132 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:31:52.132 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:31:52.132 ' 00:31:57.424 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:57.424 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:57.424 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:57.424 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:57.424 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:57.424 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:57.424 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:57.424 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:57.424 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:57.424 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:57.424 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:57.424 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:57.424 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:57.424 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:57.424 04:29:11 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:57.424 04:29:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:57.424 04:29:11 -- common/autotest_common.sh@10 -- # set +x 00:31:57.424 04:29:11 -- spdkcli/nvmf.sh@90 -- # killprocess 4152528 00:31:57.424 04:29:11 -- common/autotest_common.sh@926 -- # '[' -z 4152528 ']' 00:31:57.424 04:29:11 -- common/autotest_common.sh@930 -- # kill -0 4152528 00:31:57.424 04:29:11 -- common/autotest_common.sh@931 -- # uname 00:31:57.424 04:29:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:57.424 04:29:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4152528 00:31:57.424 04:29:11 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:31:57.424 04:29:11 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:31:57.424 04:29:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4152528' 00:31:57.424 killing process with pid 4152528 00:31:57.424 04:29:11 -- common/autotest_common.sh@945 -- # kill 4152528 00:31:57.424 [2024-05-14 04:29:11.614522] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:57.424 04:29:11 -- common/autotest_common.sh@950 -- # wait 4152528 00:31:57.424 04:29:11 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:57.424 04:29:11 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:57.424 04:29:11 -- spdkcli/common.sh@13 -- # '[' -n 4152528 ']' 00:31:57.424 04:29:11 -- spdkcli/common.sh@14 -- # killprocess 4152528 00:31:57.424 04:29:11 -- common/autotest_common.sh@926 -- # '[' -z 4152528 ']' 00:31:57.424 04:29:11 -- common/autotest_common.sh@930 -- # kill -0 4152528 00:31:57.424 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (4152528) - No such process 00:31:57.424 04:29:11 -- common/autotest_common.sh@953 -- # echo 'Process with pid 4152528 is not found' 00:31:57.424 Process with pid 4152528 is not found 00:31:57.424 04:29:11 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:57.424 04:29:11 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:57.424 04:29:11 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:57.424 00:31:57.424 real 0m16.559s 00:31:57.424 user 0m35.384s 00:31:57.424 sys 0m0.852s 00:31:57.424 04:29:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:57.424 04:29:11 -- common/autotest_common.sh@10 -- # set +x 00:31:57.424 ************************************ 00:31:57.424 END TEST spdkcli_nvmf_tcp 00:31:57.424 ************************************ 00:31:57.424 04:29:11 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:57.424 04:29:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:31:57.424 04:29:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:57.424 04:29:11 -- common/autotest_common.sh@10 -- # set +x 00:31:57.424 ************************************ 00:31:57.424 START TEST nvmf_identify_passthru 00:31:57.424 ************************************ 00:31:57.424 04:29:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:57.424 * Looking for test storage... 00:31:57.424 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:57.424 04:29:11 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:57.424 04:29:11 -- nvmf/common.sh@7 -- # uname -s 00:31:57.424 04:29:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:57.424 04:29:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:57.424 04:29:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:57.424 04:29:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:57.424 04:29:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:57.424 04:29:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:57.424 04:29:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:57.424 04:29:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:57.424 04:29:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:57.424 04:29:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:57.424 04:29:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:31:57.424 04:29:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:31:57.424 04:29:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:57.424 04:29:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:57.424 04:29:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:57.424 04:29:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:57.424 04:29:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:57.424 04:29:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:57.424 04:29:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:57.424 04:29:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:57.424 04:29:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:57.424 04:29:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:57.424 04:29:11 -- paths/export.sh@5 -- # export PATH 00:31:57.424 04:29:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:57.424 04:29:11 -- nvmf/common.sh@46 -- # : 0 00:31:57.424 04:29:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:57.424 04:29:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:57.424 04:29:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:57.424 04:29:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:57.424 04:29:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:57.424 04:29:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:57.424 04:29:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:57.424 04:29:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:57.424 04:29:11 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:57.424 04:29:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:57.424 04:29:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:57.424 04:29:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:57.424 04:29:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:57.425 04:29:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:57.425 04:29:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:57.425 04:29:11 -- paths/export.sh@5 -- # export PATH 00:31:57.425 04:29:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:57.425 04:29:11 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:57.425 04:29:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:57.425 04:29:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:57.425 04:29:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:57.425 04:29:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:57.425 04:29:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:57.425 04:29:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:57.425 04:29:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:57.425 04:29:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:57.425 04:29:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:57.425 04:29:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:57.425 04:29:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:57.425 04:29:11 -- common/autotest_common.sh@10 -- # set +x 00:32:04.021 04:29:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:04.021 04:29:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:04.021 04:29:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:04.021 04:29:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:04.021 04:29:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:04.021 04:29:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:04.021 04:29:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:04.021 04:29:18 -- nvmf/common.sh@294 -- # net_devs=() 00:32:04.021 04:29:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:04.021 04:29:18 -- nvmf/common.sh@295 -- # e810=() 00:32:04.021 04:29:18 -- nvmf/common.sh@295 -- # local -ga e810 00:32:04.021 04:29:18 -- nvmf/common.sh@296 -- # x722=() 00:32:04.021 04:29:18 -- nvmf/common.sh@296 -- # local -ga x722 00:32:04.021 04:29:18 -- nvmf/common.sh@297 -- # mlx=() 00:32:04.021 04:29:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:04.021 04:29:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:04.021 04:29:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:04.021 04:29:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:04.021 04:29:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:04.021 04:29:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:04.021 04:29:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:32:04.021 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:32:04.021 04:29:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:04.021 04:29:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:32:04.021 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:32:04.021 04:29:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:04.021 04:29:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:04.021 04:29:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:04.021 04:29:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:04.021 04:29:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:04.021 04:29:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:32:04.021 Found net devices under 0000:4b:00.0: cvl_0_0 00:32:04.021 04:29:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:04.021 04:29:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:04.021 04:29:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:04.021 04:29:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:04.021 04:29:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:04.021 04:29:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:32:04.021 Found net devices under 0000:4b:00.1: cvl_0_1 00:32:04.021 04:29:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:04.021 04:29:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:04.021 04:29:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:04.021 04:29:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:04.021 04:29:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:04.021 04:29:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:04.022 04:29:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:04.022 04:29:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:04.022 04:29:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:04.022 04:29:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:04.022 04:29:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:04.022 04:29:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:04.022 04:29:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:04.022 04:29:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:04.022 04:29:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:04.022 04:29:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:04.022 04:29:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:04.022 04:29:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:04.284 04:29:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:04.284 04:29:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:04.284 04:29:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:04.284 04:29:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:04.284 04:29:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:04.284 04:29:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:04.546 04:29:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:04.546 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:04.546 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.591 ms 00:32:04.546 00:32:04.546 --- 10.0.0.2 ping statistics --- 00:32:04.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:04.546 rtt min/avg/max/mdev = 0.591/0.591/0.591/0.000 ms 00:32:04.546 04:29:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:04.546 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:04.546 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.441 ms 00:32:04.546 00:32:04.546 --- 10.0.0.1 ping statistics --- 00:32:04.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:04.546 rtt min/avg/max/mdev = 0.441/0.441/0.441/0.000 ms 00:32:04.546 04:29:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:04.546 04:29:18 -- nvmf/common.sh@410 -- # return 0 00:32:04.546 04:29:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:32:04.546 04:29:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:04.546 04:29:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:04.546 04:29:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:04.546 04:29:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:04.546 04:29:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:04.546 04:29:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:04.546 04:29:18 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:32:04.546 04:29:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:32:04.546 04:29:18 -- common/autotest_common.sh@10 -- # set +x 00:32:04.546 04:29:18 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:32:04.546 04:29:18 -- common/autotest_common.sh@1509 -- # bdfs=() 00:32:04.546 04:29:18 -- common/autotest_common.sh@1509 -- # local bdfs 00:32:04.546 04:29:18 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:32:04.546 04:29:18 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:32:04.546 04:29:18 -- common/autotest_common.sh@1498 -- # bdfs=() 00:32:04.546 04:29:18 -- common/autotest_common.sh@1498 -- # local bdfs 00:32:04.546 04:29:18 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:32:04.546 04:29:18 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:32:04.546 04:29:18 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:32:04.546 04:29:19 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:32:04.546 04:29:19 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:65:00.0 00:32:04.546 04:29:19 -- common/autotest_common.sh@1512 -- # echo 0000:65:00.0 00:32:04.546 04:29:19 -- target/identify_passthru.sh@16 -- # bdf=0000:65:00.0 00:32:04.546 04:29:19 -- target/identify_passthru.sh@17 -- # '[' -z 0000:65:00.0 ']' 00:32:04.546 04:29:19 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:65:00.0' -i 0 00:32:04.546 04:29:19 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:32:04.546 04:29:19 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:32:04.546 EAL: No free 2048 kB hugepages reported on node 1 00:32:05.120 04:29:19 -- target/identify_passthru.sh@23 -- # nvme_serial_number=S64GNE0R605487 00:32:05.120 04:29:19 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:65:00.0' -i 0 00:32:05.120 04:29:19 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:32:05.120 04:29:19 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:32:05.120 EAL: No free 2048 kB hugepages reported on node 1 00:32:05.690 04:29:19 -- target/identify_passthru.sh@24 -- # nvme_model_number=SAMSUNG 00:32:05.690 04:29:19 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:32:05.690 04:29:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:05.690 04:29:19 -- common/autotest_common.sh@10 -- # set +x 00:32:05.690 04:29:20 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:32:05.690 04:29:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:32:05.690 04:29:20 -- common/autotest_common.sh@10 -- # set +x 00:32:05.690 04:29:20 -- target/identify_passthru.sh@31 -- # nvmfpid=4159644 00:32:05.690 04:29:20 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:32:05.690 04:29:20 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:32:05.690 04:29:20 -- target/identify_passthru.sh@35 -- # waitforlisten 4159644 00:32:05.690 04:29:20 -- common/autotest_common.sh@819 -- # '[' -z 4159644 ']' 00:32:05.690 04:29:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:05.690 04:29:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:32:05.690 04:29:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:05.690 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:05.690 04:29:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:32:05.690 04:29:20 -- common/autotest_common.sh@10 -- # set +x 00:32:05.690 [2024-05-14 04:29:20.075869] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:32:05.691 [2024-05-14 04:29:20.075925] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:05.691 EAL: No free 2048 kB hugepages reported on node 1 00:32:05.691 [2024-05-14 04:29:20.148798] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:05.691 [2024-05-14 04:29:20.215996] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:05.691 [2024-05-14 04:29:20.216131] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:05.691 [2024-05-14 04:29:20.216140] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:05.691 [2024-05-14 04:29:20.216149] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:05.691 [2024-05-14 04:29:20.216191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:05.691 [2024-05-14 04:29:20.216307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:05.691 [2024-05-14 04:29:20.216458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:05.691 [2024-05-14 04:29:20.216459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:06.263 04:29:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:32:06.263 04:29:20 -- common/autotest_common.sh@852 -- # return 0 00:32:06.263 04:29:20 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:32:06.263 04:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:06.263 04:29:20 -- common/autotest_common.sh@10 -- # set +x 00:32:06.525 INFO: Log level set to 20 00:32:06.525 INFO: Requests: 00:32:06.525 { 00:32:06.525 "jsonrpc": "2.0", 00:32:06.525 "method": "nvmf_set_config", 00:32:06.525 "id": 1, 00:32:06.525 "params": { 00:32:06.525 "admin_cmd_passthru": { 00:32:06.525 "identify_ctrlr": true 00:32:06.525 } 00:32:06.525 } 00:32:06.525 } 00:32:06.525 00:32:06.525 INFO: response: 00:32:06.525 { 00:32:06.525 "jsonrpc": "2.0", 00:32:06.525 "id": 1, 00:32:06.525 "result": true 00:32:06.525 } 00:32:06.525 00:32:06.525 04:29:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:06.525 04:29:20 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:32:06.525 04:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:06.525 04:29:20 -- common/autotest_common.sh@10 -- # set +x 00:32:06.525 INFO: Setting log level to 20 00:32:06.525 INFO: Setting log level to 20 00:32:06.525 INFO: Log level set to 20 00:32:06.525 INFO: Log level set to 20 00:32:06.525 INFO: Requests: 00:32:06.525 { 00:32:06.525 "jsonrpc": "2.0", 00:32:06.525 "method": "framework_start_init", 00:32:06.525 "id": 1 00:32:06.525 } 00:32:06.525 00:32:06.525 INFO: Requests: 00:32:06.525 { 00:32:06.525 "jsonrpc": "2.0", 00:32:06.525 "method": "framework_start_init", 00:32:06.525 "id": 1 00:32:06.525 } 00:32:06.525 00:32:06.525 [2024-05-14 04:29:20.930032] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:32:06.525 INFO: response: 00:32:06.525 { 00:32:06.525 "jsonrpc": "2.0", 00:32:06.525 "id": 1, 00:32:06.525 "result": true 00:32:06.525 } 00:32:06.525 00:32:06.525 INFO: response: 00:32:06.525 { 00:32:06.525 "jsonrpc": "2.0", 00:32:06.525 "id": 1, 00:32:06.525 "result": true 00:32:06.525 } 00:32:06.525 00:32:06.525 04:29:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:06.525 04:29:20 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:06.525 04:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:06.525 04:29:20 -- common/autotest_common.sh@10 -- # set +x 00:32:06.525 INFO: Setting log level to 40 00:32:06.525 INFO: Setting log level to 40 00:32:06.525 INFO: Setting log level to 40 00:32:06.525 [2024-05-14 04:29:20.943303] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:06.525 04:29:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:06.525 04:29:20 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:32:06.525 04:29:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:06.525 04:29:20 -- common/autotest_common.sh@10 -- # set +x 00:32:06.525 04:29:20 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:65:00.0 00:32:06.525 04:29:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:06.525 04:29:20 -- common/autotest_common.sh@10 -- # set +x 00:32:06.787 Nvme0n1 00:32:06.787 04:29:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:06.787 04:29:21 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:32:06.787 04:29:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:06.787 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:32:06.787 04:29:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:06.787 04:29:21 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:32:06.787 04:29:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:06.787 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:32:06.787 04:29:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:06.787 04:29:21 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:06.787 04:29:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:06.787 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:32:06.787 [2024-05-14 04:29:21.326583] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:06.787 04:29:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:06.787 04:29:21 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:32:06.787 04:29:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:06.787 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:32:06.787 [2024-05-14 04:29:21.338385] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:32:06.787 [ 00:32:06.787 { 00:32:06.787 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:32:06.787 "subtype": "Discovery", 00:32:06.787 "listen_addresses": [], 00:32:06.787 "allow_any_host": true, 00:32:06.787 "hosts": [] 00:32:06.787 }, 00:32:06.787 { 00:32:06.787 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:32:06.787 "subtype": "NVMe", 00:32:06.787 "listen_addresses": [ 00:32:06.787 { 00:32:06.787 "transport": "TCP", 00:32:06.787 "trtype": "TCP", 00:32:06.787 "adrfam": "IPv4", 00:32:06.787 "traddr": "10.0.0.2", 00:32:06.787 "trsvcid": "4420" 00:32:06.787 } 00:32:06.787 ], 00:32:06.787 "allow_any_host": true, 00:32:06.787 "hosts": [], 00:32:06.787 "serial_number": "SPDK00000000000001", 00:32:06.787 "model_number": "SPDK bdev Controller", 00:32:06.787 "max_namespaces": 1, 00:32:06.787 "min_cntlid": 1, 00:32:06.787 "max_cntlid": 65519, 00:32:06.787 "namespaces": [ 00:32:06.787 { 00:32:06.787 "nsid": 1, 00:32:06.787 "bdev_name": "Nvme0n1", 00:32:06.787 "name": "Nvme0n1", 00:32:06.787 "nguid": "3634473052605487002538450000003C", 00:32:06.787 "uuid": "36344730-5260-5487-0025-38450000003c" 00:32:06.787 } 00:32:06.787 ] 00:32:06.787 } 00:32:06.787 ] 00:32:06.787 04:29:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:06.787 04:29:21 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:32:06.787 04:29:21 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:32:06.787 04:29:21 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:32:07.048 EAL: No free 2048 kB hugepages reported on node 1 00:32:07.048 04:29:21 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=S64GNE0R605487 00:32:07.048 04:29:21 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:32:07.048 04:29:21 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:32:07.048 04:29:21 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:32:07.048 EAL: No free 2048 kB hugepages reported on node 1 00:32:07.310 04:29:21 -- target/identify_passthru.sh@61 -- # nvmf_model_number=SAMSUNG 00:32:07.310 04:29:21 -- target/identify_passthru.sh@63 -- # '[' S64GNE0R605487 '!=' S64GNE0R605487 ']' 00:32:07.310 04:29:21 -- target/identify_passthru.sh@68 -- # '[' SAMSUNG '!=' SAMSUNG ']' 00:32:07.310 04:29:21 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:07.310 04:29:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:07.310 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:32:07.310 04:29:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:07.310 04:29:21 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:32:07.310 04:29:21 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:32:07.310 04:29:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:07.310 04:29:21 -- nvmf/common.sh@116 -- # sync 00:32:07.310 04:29:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:07.310 04:29:21 -- nvmf/common.sh@119 -- # set +e 00:32:07.310 04:29:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:07.310 04:29:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:07.310 rmmod nvme_tcp 00:32:07.310 rmmod nvme_fabrics 00:32:07.310 rmmod nvme_keyring 00:32:07.310 04:29:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:07.310 04:29:21 -- nvmf/common.sh@123 -- # set -e 00:32:07.310 04:29:21 -- nvmf/common.sh@124 -- # return 0 00:32:07.310 04:29:21 -- nvmf/common.sh@477 -- # '[' -n 4159644 ']' 00:32:07.310 04:29:21 -- nvmf/common.sh@478 -- # killprocess 4159644 00:32:07.310 04:29:21 -- common/autotest_common.sh@926 -- # '[' -z 4159644 ']' 00:32:07.310 04:29:21 -- common/autotest_common.sh@930 -- # kill -0 4159644 00:32:07.310 04:29:21 -- common/autotest_common.sh@931 -- # uname 00:32:07.310 04:29:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:32:07.310 04:29:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4159644 00:32:07.310 04:29:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:32:07.310 04:29:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:32:07.310 04:29:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4159644' 00:32:07.310 killing process with pid 4159644 00:32:07.310 04:29:21 -- common/autotest_common.sh@945 -- # kill 4159644 00:32:07.310 [2024-05-14 04:29:21.834838] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:32:07.310 04:29:21 -- common/autotest_common.sh@950 -- # wait 4159644 00:32:07.572 04:29:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:32:07.572 04:29:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:07.572 04:29:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:07.572 04:29:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:07.572 04:29:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:07.572 04:29:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:07.572 04:29:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:07.572 04:29:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:10.161 04:29:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:10.161 00:32:10.161 real 0m12.373s 00:32:10.161 user 0m9.862s 00:32:10.161 sys 0m5.801s 00:32:10.161 04:29:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:10.161 04:29:24 -- common/autotest_common.sh@10 -- # set +x 00:32:10.161 ************************************ 00:32:10.161 END TEST nvmf_identify_passthru 00:32:10.161 ************************************ 00:32:10.161 04:29:24 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:32:10.161 04:29:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:10.161 04:29:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:10.161 04:29:24 -- common/autotest_common.sh@10 -- # set +x 00:32:10.161 ************************************ 00:32:10.161 START TEST nvmf_dif 00:32:10.161 ************************************ 00:32:10.162 04:29:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:32:10.162 * Looking for test storage... 00:32:10.162 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:10.162 04:29:24 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:10.162 04:29:24 -- nvmf/common.sh@7 -- # uname -s 00:32:10.162 04:29:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:10.162 04:29:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:10.162 04:29:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:10.162 04:29:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:10.162 04:29:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:10.162 04:29:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:10.162 04:29:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:10.162 04:29:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:10.162 04:29:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:10.162 04:29:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:10.162 04:29:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:32:10.162 04:29:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:32:10.162 04:29:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:10.162 04:29:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:10.162 04:29:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:10.162 04:29:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:10.162 04:29:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:10.162 04:29:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:10.162 04:29:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:10.162 04:29:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:10.162 04:29:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:10.162 04:29:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:10.162 04:29:24 -- paths/export.sh@5 -- # export PATH 00:32:10.162 04:29:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:10.162 04:29:24 -- nvmf/common.sh@46 -- # : 0 00:32:10.162 04:29:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:10.162 04:29:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:10.162 04:29:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:10.162 04:29:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:10.162 04:29:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:10.162 04:29:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:10.162 04:29:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:10.162 04:29:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:10.162 04:29:24 -- target/dif.sh@15 -- # NULL_META=16 00:32:10.162 04:29:24 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:32:10.162 04:29:24 -- target/dif.sh@15 -- # NULL_SIZE=64 00:32:10.162 04:29:24 -- target/dif.sh@15 -- # NULL_DIF=1 00:32:10.162 04:29:24 -- target/dif.sh@135 -- # nvmftestinit 00:32:10.162 04:29:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:10.162 04:29:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:10.162 04:29:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:10.162 04:29:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:10.162 04:29:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:10.162 04:29:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:10.162 04:29:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:10.162 04:29:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:10.162 04:29:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:10.162 04:29:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:10.162 04:29:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:10.162 04:29:24 -- common/autotest_common.sh@10 -- # set +x 00:32:16.756 04:29:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:16.756 04:29:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:16.756 04:29:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:16.756 04:29:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:16.756 04:29:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:16.756 04:29:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:16.756 04:29:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:16.756 04:29:31 -- nvmf/common.sh@294 -- # net_devs=() 00:32:16.756 04:29:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:16.756 04:29:31 -- nvmf/common.sh@295 -- # e810=() 00:32:16.756 04:29:31 -- nvmf/common.sh@295 -- # local -ga e810 00:32:16.756 04:29:31 -- nvmf/common.sh@296 -- # x722=() 00:32:16.756 04:29:31 -- nvmf/common.sh@296 -- # local -ga x722 00:32:16.756 04:29:31 -- nvmf/common.sh@297 -- # mlx=() 00:32:16.756 04:29:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:16.756 04:29:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:16.756 04:29:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:16.756 04:29:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:16.756 04:29:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:16.756 04:29:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:16.756 04:29:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:32:16.756 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:32:16.756 04:29:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:16.756 04:29:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:32:16.756 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:32:16.756 04:29:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:16.756 04:29:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:16.756 04:29:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:16.756 04:29:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:16.756 04:29:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:16.756 04:29:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:32:16.756 Found net devices under 0000:4b:00.0: cvl_0_0 00:32:16.756 04:29:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:16.756 04:29:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:16.756 04:29:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:16.756 04:29:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:16.756 04:29:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:16.756 04:29:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:32:16.756 Found net devices under 0000:4b:00.1: cvl_0_1 00:32:16.756 04:29:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:16.756 04:29:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:16.756 04:29:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:16.756 04:29:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:16.756 04:29:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:16.756 04:29:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:16.756 04:29:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:16.756 04:29:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:16.756 04:29:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:16.756 04:29:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:16.756 04:29:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:16.756 04:29:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:16.756 04:29:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:16.756 04:29:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:16.756 04:29:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:16.756 04:29:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:16.756 04:29:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:16.756 04:29:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:16.756 04:29:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:16.756 04:29:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:16.756 04:29:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:16.756 04:29:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:17.018 04:29:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:17.018 04:29:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:17.018 04:29:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:17.018 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:17.018 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.636 ms 00:32:17.018 00:32:17.018 --- 10.0.0.2 ping statistics --- 00:32:17.018 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:17.018 rtt min/avg/max/mdev = 0.636/0.636/0.636/0.000 ms 00:32:17.018 04:29:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:17.018 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:17.018 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.403 ms 00:32:17.018 00:32:17.018 --- 10.0.0.1 ping statistics --- 00:32:17.018 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:17.018 rtt min/avg/max/mdev = 0.403/0.403/0.403/0.000 ms 00:32:17.018 04:29:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:17.018 04:29:31 -- nvmf/common.sh@410 -- # return 0 00:32:17.018 04:29:31 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:17.018 04:29:31 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:20.325 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:32:20.325 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:32:20.325 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:32:20.586 04:29:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:20.586 04:29:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:20.586 04:29:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:20.586 04:29:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:20.586 04:29:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:20.586 04:29:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:20.586 04:29:35 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:32:20.586 04:29:35 -- target/dif.sh@137 -- # nvmfappstart 00:32:20.586 04:29:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:20.586 04:29:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:32:20.586 04:29:35 -- common/autotest_common.sh@10 -- # set +x 00:32:20.586 04:29:35 -- nvmf/common.sh@469 -- # nvmfpid=4165567 00:32:20.586 04:29:35 -- nvmf/common.sh@470 -- # waitforlisten 4165567 00:32:20.586 04:29:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:32:20.586 04:29:35 -- common/autotest_common.sh@819 -- # '[' -z 4165567 ']' 00:32:20.586 04:29:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:20.586 04:29:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:32:20.586 04:29:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:20.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:20.586 04:29:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:32:20.586 04:29:35 -- common/autotest_common.sh@10 -- # set +x 00:32:20.848 [2024-05-14 04:29:35.180272] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:32:20.848 [2024-05-14 04:29:35.180331] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:20.848 EAL: No free 2048 kB hugepages reported on node 1 00:32:20.848 [2024-05-14 04:29:35.246454] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:32:20.848 [2024-05-14 04:29:35.311878] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:20.848 [2024-05-14 04:29:35.311997] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:20.849 [2024-05-14 04:29:35.312004] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:20.849 [2024-05-14 04:29:35.312011] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:20.849 [2024-05-14 04:29:35.312034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:21.421 04:29:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:32:21.421 04:29:35 -- common/autotest_common.sh@852 -- # return 0 00:32:21.421 04:29:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:21.421 04:29:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:21.421 04:29:35 -- common/autotest_common.sh@10 -- # set +x 00:32:21.421 04:29:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:21.421 04:29:35 -- target/dif.sh@139 -- # create_transport 00:32:21.421 04:29:35 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:32:21.421 04:29:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.421 04:29:35 -- common/autotest_common.sh@10 -- # set +x 00:32:21.421 [2024-05-14 04:29:35.994575] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:21.421 04:29:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.421 04:29:35 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:32:21.421 04:29:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:21.421 04:29:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:21.421 04:29:36 -- common/autotest_common.sh@10 -- # set +x 00:32:21.421 ************************************ 00:32:21.421 START TEST fio_dif_1_default 00:32:21.421 ************************************ 00:32:21.421 04:29:36 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:32:21.421 04:29:36 -- target/dif.sh@86 -- # create_subsystems 0 00:32:21.421 04:29:36 -- target/dif.sh@28 -- # local sub 00:32:21.421 04:29:36 -- target/dif.sh@30 -- # for sub in "$@" 00:32:21.421 04:29:36 -- target/dif.sh@31 -- # create_subsystem 0 00:32:21.682 04:29:36 -- target/dif.sh@18 -- # local sub_id=0 00:32:21.682 04:29:36 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:21.682 04:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.682 04:29:36 -- common/autotest_common.sh@10 -- # set +x 00:32:21.682 bdev_null0 00:32:21.682 04:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.682 04:29:36 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:21.682 04:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.682 04:29:36 -- common/autotest_common.sh@10 -- # set +x 00:32:21.682 04:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.682 04:29:36 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:21.682 04:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.682 04:29:36 -- common/autotest_common.sh@10 -- # set +x 00:32:21.682 04:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.682 04:29:36 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:21.682 04:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:21.682 04:29:36 -- common/autotest_common.sh@10 -- # set +x 00:32:21.682 [2024-05-14 04:29:36.050861] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:21.682 04:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:21.682 04:29:36 -- target/dif.sh@87 -- # fio /dev/fd/62 00:32:21.682 04:29:36 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:32:21.682 04:29:36 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:21.682 04:29:36 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:21.682 04:29:36 -- nvmf/common.sh@520 -- # config=() 00:32:21.682 04:29:36 -- nvmf/common.sh@520 -- # local subsystem config 00:32:21.682 04:29:36 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:21.682 04:29:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:21.682 04:29:36 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:21.682 04:29:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:21.682 { 00:32:21.682 "params": { 00:32:21.682 "name": "Nvme$subsystem", 00:32:21.682 "trtype": "$TEST_TRANSPORT", 00:32:21.682 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:21.682 "adrfam": "ipv4", 00:32:21.682 "trsvcid": "$NVMF_PORT", 00:32:21.682 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:21.682 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:21.682 "hdgst": ${hdgst:-false}, 00:32:21.682 "ddgst": ${ddgst:-false} 00:32:21.682 }, 00:32:21.682 "method": "bdev_nvme_attach_controller" 00:32:21.682 } 00:32:21.682 EOF 00:32:21.682 )") 00:32:21.682 04:29:36 -- target/dif.sh@82 -- # gen_fio_conf 00:32:21.682 04:29:36 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:21.682 04:29:36 -- target/dif.sh@54 -- # local file 00:32:21.682 04:29:36 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:21.682 04:29:36 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:21.682 04:29:36 -- target/dif.sh@56 -- # cat 00:32:21.682 04:29:36 -- common/autotest_common.sh@1320 -- # shift 00:32:21.682 04:29:36 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:21.682 04:29:36 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:21.682 04:29:36 -- nvmf/common.sh@542 -- # cat 00:32:21.682 04:29:36 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:21.682 04:29:36 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:21.682 04:29:36 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:21.682 04:29:36 -- target/dif.sh@72 -- # (( file <= files )) 00:32:21.682 04:29:36 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:21.682 04:29:36 -- nvmf/common.sh@544 -- # jq . 00:32:21.682 04:29:36 -- nvmf/common.sh@545 -- # IFS=, 00:32:21.682 04:29:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:21.682 "params": { 00:32:21.682 "name": "Nvme0", 00:32:21.682 "trtype": "tcp", 00:32:21.682 "traddr": "10.0.0.2", 00:32:21.682 "adrfam": "ipv4", 00:32:21.682 "trsvcid": "4420", 00:32:21.682 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:21.682 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:21.682 "hdgst": false, 00:32:21.682 "ddgst": false 00:32:21.682 }, 00:32:21.682 "method": "bdev_nvme_attach_controller" 00:32:21.682 }' 00:32:21.682 04:29:36 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:21.682 04:29:36 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:21.682 04:29:36 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:21.682 04:29:36 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:21.682 04:29:36 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:21.682 04:29:36 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:21.682 04:29:36 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:21.682 04:29:36 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:21.682 04:29:36 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:21.682 04:29:36 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:21.943 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:21.943 fio-3.35 00:32:21.943 Starting 1 thread 00:32:21.943 EAL: No free 2048 kB hugepages reported on node 1 00:32:22.204 [2024-05-14 04:29:36.789783] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:22.204 [2024-05-14 04:29:36.789832] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:34.443 00:32:34.443 filename0: (groupid=0, jobs=1): err= 0: pid=4166066: Tue May 14 04:29:46 2024 00:32:34.443 read: IOPS=95, BW=381KiB/s (390kB/s)(3808KiB/10002msec) 00:32:34.443 slat (nsec): min=5330, max=31776, avg=6192.50, stdev=1552.15 00:32:34.443 clat (usec): min=41858, max=43688, avg=42006.89, stdev=166.91 00:32:34.443 lat (usec): min=41866, max=43720, avg=42013.08, stdev=167.27 00:32:34.443 clat percentiles (usec): 00:32:34.443 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[42206], 00:32:34.443 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:32:34.443 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:32:34.443 | 99.00th=[42730], 99.50th=[42730], 99.90th=[43779], 99.95th=[43779], 00:32:34.443 | 99.99th=[43779] 00:32:34.443 bw ( KiB/s): min= 352, max= 384, per=99.81%, avg=380.63, stdev=10.09, samples=19 00:32:34.443 iops : min= 88, max= 96, avg=95.16, stdev= 2.52, samples=19 00:32:34.443 lat (msec) : 50=100.00% 00:32:34.443 cpu : usr=96.03%, sys=3.78%, ctx=14, majf=0, minf=225 00:32:34.443 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:34.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.443 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:34.443 issued rwts: total=952,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:34.443 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:34.443 00:32:34.443 Run status group 0 (all jobs): 00:32:34.443 READ: bw=381KiB/s (390kB/s), 381KiB/s-381KiB/s (390kB/s-390kB/s), io=3808KiB (3899kB), run=10002-10002msec 00:32:34.443 04:29:47 -- target/dif.sh@88 -- # destroy_subsystems 0 00:32:34.443 04:29:47 -- target/dif.sh@43 -- # local sub 00:32:34.443 04:29:47 -- target/dif.sh@45 -- # for sub in "$@" 00:32:34.443 04:29:47 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:34.443 04:29:47 -- target/dif.sh@36 -- # local sub_id=0 00:32:34.443 04:29:47 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:34.443 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.443 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.443 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.443 04:29:47 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:34.443 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.443 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.443 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.443 00:32:34.443 real 0m11.025s 00:32:34.443 user 0m26.756s 00:32:34.443 sys 0m0.666s 00:32:34.443 04:29:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:34.443 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.443 ************************************ 00:32:34.443 END TEST fio_dif_1_default 00:32:34.443 ************************************ 00:32:34.443 04:29:47 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:32:34.443 04:29:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:34.443 04:29:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:34.443 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.443 ************************************ 00:32:34.443 START TEST fio_dif_1_multi_subsystems 00:32:34.443 ************************************ 00:32:34.443 04:29:47 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:32:34.443 04:29:47 -- target/dif.sh@92 -- # local files=1 00:32:34.443 04:29:47 -- target/dif.sh@94 -- # create_subsystems 0 1 00:32:34.443 04:29:47 -- target/dif.sh@28 -- # local sub 00:32:34.443 04:29:47 -- target/dif.sh@30 -- # for sub in "$@" 00:32:34.443 04:29:47 -- target/dif.sh@31 -- # create_subsystem 0 00:32:34.443 04:29:47 -- target/dif.sh@18 -- # local sub_id=0 00:32:34.443 04:29:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:34.443 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.443 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.443 bdev_null0 00:32:34.443 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.443 04:29:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:34.443 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.443 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.443 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.443 04:29:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:34.443 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.443 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.443 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.443 04:29:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:34.443 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.443 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.443 [2024-05-14 04:29:47.123786] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:34.443 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.443 04:29:47 -- target/dif.sh@30 -- # for sub in "$@" 00:32:34.443 04:29:47 -- target/dif.sh@31 -- # create_subsystem 1 00:32:34.443 04:29:47 -- target/dif.sh@18 -- # local sub_id=1 00:32:34.443 04:29:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:34.443 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.443 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.443 bdev_null1 00:32:34.443 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.444 04:29:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:34.444 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.444 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.444 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.444 04:29:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:34.444 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.444 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.444 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.444 04:29:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:34.444 04:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.444 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:32:34.444 04:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:34.444 04:29:47 -- target/dif.sh@95 -- # fio /dev/fd/62 00:32:34.444 04:29:47 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:32:34.444 04:29:47 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:34.444 04:29:47 -- nvmf/common.sh@520 -- # config=() 00:32:34.444 04:29:47 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:34.444 04:29:47 -- nvmf/common.sh@520 -- # local subsystem config 00:32:34.444 04:29:47 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:34.444 04:29:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:34.444 04:29:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:34.444 { 00:32:34.444 "params": { 00:32:34.444 "name": "Nvme$subsystem", 00:32:34.444 "trtype": "$TEST_TRANSPORT", 00:32:34.444 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:34.444 "adrfam": "ipv4", 00:32:34.444 "trsvcid": "$NVMF_PORT", 00:32:34.444 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:34.444 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:34.444 "hdgst": ${hdgst:-false}, 00:32:34.444 "ddgst": ${ddgst:-false} 00:32:34.444 }, 00:32:34.444 "method": "bdev_nvme_attach_controller" 00:32:34.444 } 00:32:34.444 EOF 00:32:34.444 )") 00:32:34.444 04:29:47 -- target/dif.sh@82 -- # gen_fio_conf 00:32:34.444 04:29:47 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:34.444 04:29:47 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:34.444 04:29:47 -- target/dif.sh@54 -- # local file 00:32:34.444 04:29:47 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:34.444 04:29:47 -- target/dif.sh@56 -- # cat 00:32:34.444 04:29:47 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:34.444 04:29:47 -- common/autotest_common.sh@1320 -- # shift 00:32:34.444 04:29:47 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:34.444 04:29:47 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:34.444 04:29:47 -- nvmf/common.sh@542 -- # cat 00:32:34.444 04:29:47 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:34.444 04:29:47 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:34.444 04:29:47 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:34.444 04:29:47 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:34.444 04:29:47 -- target/dif.sh@72 -- # (( file <= files )) 00:32:34.444 04:29:47 -- target/dif.sh@73 -- # cat 00:32:34.444 04:29:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:34.444 04:29:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:34.444 { 00:32:34.444 "params": { 00:32:34.444 "name": "Nvme$subsystem", 00:32:34.444 "trtype": "$TEST_TRANSPORT", 00:32:34.444 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:34.444 "adrfam": "ipv4", 00:32:34.444 "trsvcid": "$NVMF_PORT", 00:32:34.444 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:34.444 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:34.444 "hdgst": ${hdgst:-false}, 00:32:34.444 "ddgst": ${ddgst:-false} 00:32:34.444 }, 00:32:34.444 "method": "bdev_nvme_attach_controller" 00:32:34.444 } 00:32:34.444 EOF 00:32:34.444 )") 00:32:34.444 04:29:47 -- target/dif.sh@72 -- # (( file++ )) 00:32:34.444 04:29:47 -- target/dif.sh@72 -- # (( file <= files )) 00:32:34.444 04:29:47 -- nvmf/common.sh@542 -- # cat 00:32:34.444 04:29:47 -- nvmf/common.sh@544 -- # jq . 00:32:34.444 04:29:47 -- nvmf/common.sh@545 -- # IFS=, 00:32:34.444 04:29:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:34.444 "params": { 00:32:34.444 "name": "Nvme0", 00:32:34.444 "trtype": "tcp", 00:32:34.444 "traddr": "10.0.0.2", 00:32:34.444 "adrfam": "ipv4", 00:32:34.444 "trsvcid": "4420", 00:32:34.444 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:34.444 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:34.444 "hdgst": false, 00:32:34.444 "ddgst": false 00:32:34.444 }, 00:32:34.444 "method": "bdev_nvme_attach_controller" 00:32:34.444 },{ 00:32:34.444 "params": { 00:32:34.444 "name": "Nvme1", 00:32:34.444 "trtype": "tcp", 00:32:34.444 "traddr": "10.0.0.2", 00:32:34.444 "adrfam": "ipv4", 00:32:34.444 "trsvcid": "4420", 00:32:34.444 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:34.444 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:34.444 "hdgst": false, 00:32:34.444 "ddgst": false 00:32:34.444 }, 00:32:34.444 "method": "bdev_nvme_attach_controller" 00:32:34.444 }' 00:32:34.444 04:29:47 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:34.444 04:29:47 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:34.444 04:29:47 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:34.444 04:29:47 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:34.444 04:29:47 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:34.444 04:29:47 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:34.444 04:29:47 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:34.444 04:29:47 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:34.444 04:29:47 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:34.444 04:29:47 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:34.444 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:34.444 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:32:34.444 fio-3.35 00:32:34.444 Starting 2 threads 00:32:34.444 EAL: No free 2048 kB hugepages reported on node 1 00:32:34.444 [2024-05-14 04:29:48.227549] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:34.444 [2024-05-14 04:29:48.227591] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:44.500 00:32:44.500 filename0: (groupid=0, jobs=1): err= 0: pid=4168606: Tue May 14 04:29:58 2024 00:32:44.500 read: IOPS=181, BW=726KiB/s (743kB/s)(7280KiB/10031msec) 00:32:44.500 slat (nsec): min=5383, max=27918, avg=6247.52, stdev=1309.38 00:32:44.500 clat (usec): min=1392, max=44347, avg=22027.55, stdev=20218.64 00:32:44.500 lat (usec): min=1398, max=44375, avg=22033.79, stdev=20218.62 00:32:44.500 clat percentiles (usec): 00:32:44.500 | 1.00th=[ 1500], 5.00th=[ 1696], 10.00th=[ 1729], 20.00th=[ 1762], 00:32:44.500 | 30.00th=[ 1778], 40.00th=[ 1827], 50.00th=[41681], 60.00th=[42206], 00:32:44.500 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:32:44.500 | 99.00th=[42730], 99.50th=[42730], 99.90th=[44303], 99.95th=[44303], 00:32:44.500 | 99.99th=[44303] 00:32:44.500 bw ( KiB/s): min= 704, max= 768, per=50.07%, avg=726.40, stdev=29.55, samples=20 00:32:44.500 iops : min= 176, max= 192, avg=181.60, stdev= 7.39, samples=20 00:32:44.500 lat (msec) : 2=49.45%, 4=0.44%, 50=50.11% 00:32:44.500 cpu : usr=97.55%, sys=2.22%, ctx=19, majf=0, minf=99 00:32:44.500 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:44.500 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:44.500 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:44.500 issued rwts: total=1820,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:44.500 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:44.500 filename1: (groupid=0, jobs=1): err= 0: pid=4168607: Tue May 14 04:29:58 2024 00:32:44.500 read: IOPS=181, BW=724KiB/s (742kB/s)(7264KiB/10030msec) 00:32:44.500 slat (nsec): min=5317, max=35433, avg=6256.03, stdev=1595.09 00:32:44.500 clat (usec): min=1412, max=43379, avg=22073.88, stdev=20253.62 00:32:44.500 lat (usec): min=1418, max=43406, avg=22080.14, stdev=20253.52 00:32:44.500 clat percentiles (usec): 00:32:44.500 | 1.00th=[ 1516], 5.00th=[ 1549], 10.00th=[ 1696], 20.00th=[ 1745], 00:32:44.500 | 30.00th=[ 1778], 40.00th=[ 1795], 50.00th=[41681], 60.00th=[42206], 00:32:44.500 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:32:44.500 | 99.00th=[42730], 99.50th=[42730], 99.90th=[43254], 99.95th=[43254], 00:32:44.500 | 99.99th=[43254] 00:32:44.500 bw ( KiB/s): min= 670, max= 768, per=49.93%, avg=724.70, stdev=31.80, samples=20 00:32:44.500 iops : min= 167, max= 192, avg=181.15, stdev= 8.00, samples=20 00:32:44.500 lat (msec) : 2=49.56%, 4=0.22%, 50=50.22% 00:32:44.500 cpu : usr=97.50%, sys=2.26%, ctx=14, majf=0, minf=216 00:32:44.500 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:44.500 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:44.500 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:44.500 issued rwts: total=1816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:44.500 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:44.500 00:32:44.500 Run status group 0 (all jobs): 00:32:44.500 READ: bw=1450KiB/s (1485kB/s), 724KiB/s-726KiB/s (742kB/s-743kB/s), io=14.2MiB (14.9MB), run=10030-10031msec 00:32:44.500 04:29:58 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:32:44.500 04:29:58 -- target/dif.sh@43 -- # local sub 00:32:44.500 04:29:58 -- target/dif.sh@45 -- # for sub in "$@" 00:32:44.500 04:29:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:44.500 04:29:58 -- target/dif.sh@36 -- # local sub_id=0 00:32:44.500 04:29:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:44.500 04:29:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:44.500 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.500 04:29:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:44.500 04:29:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:44.500 04:29:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:44.500 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.500 04:29:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:44.500 04:29:58 -- target/dif.sh@45 -- # for sub in "$@" 00:32:44.500 04:29:58 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:44.500 04:29:58 -- target/dif.sh@36 -- # local sub_id=1 00:32:44.500 04:29:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:44.500 04:29:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:44.500 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.501 04:29:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:44.501 04:29:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:44.501 04:29:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:44.501 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.501 04:29:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:44.501 00:32:44.501 real 0m11.487s 00:32:44.501 user 0m32.629s 00:32:44.501 sys 0m0.790s 00:32:44.501 04:29:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:44.501 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.501 ************************************ 00:32:44.501 END TEST fio_dif_1_multi_subsystems 00:32:44.501 ************************************ 00:32:44.501 04:29:58 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:32:44.501 04:29:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:44.501 04:29:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:44.501 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.501 ************************************ 00:32:44.501 START TEST fio_dif_rand_params 00:32:44.501 ************************************ 00:32:44.501 04:29:58 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:32:44.501 04:29:58 -- target/dif.sh@100 -- # local NULL_DIF 00:32:44.501 04:29:58 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:32:44.501 04:29:58 -- target/dif.sh@103 -- # NULL_DIF=3 00:32:44.501 04:29:58 -- target/dif.sh@103 -- # bs=128k 00:32:44.501 04:29:58 -- target/dif.sh@103 -- # numjobs=3 00:32:44.501 04:29:58 -- target/dif.sh@103 -- # iodepth=3 00:32:44.501 04:29:58 -- target/dif.sh@103 -- # runtime=5 00:32:44.501 04:29:58 -- target/dif.sh@105 -- # create_subsystems 0 00:32:44.501 04:29:58 -- target/dif.sh@28 -- # local sub 00:32:44.501 04:29:58 -- target/dif.sh@30 -- # for sub in "$@" 00:32:44.501 04:29:58 -- target/dif.sh@31 -- # create_subsystem 0 00:32:44.501 04:29:58 -- target/dif.sh@18 -- # local sub_id=0 00:32:44.501 04:29:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:44.501 04:29:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:44.501 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.501 bdev_null0 00:32:44.501 04:29:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:44.501 04:29:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:44.501 04:29:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:44.501 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.501 04:29:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:44.501 04:29:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:44.501 04:29:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:44.501 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.501 04:29:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:44.501 04:29:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:44.501 04:29:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:44.501 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.501 [2024-05-14 04:29:58.661140] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:44.501 04:29:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:44.501 04:29:58 -- target/dif.sh@106 -- # fio /dev/fd/62 00:32:44.501 04:29:58 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:32:44.501 04:29:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:44.501 04:29:58 -- nvmf/common.sh@520 -- # config=() 00:32:44.501 04:29:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:44.501 04:29:58 -- nvmf/common.sh@520 -- # local subsystem config 00:32:44.501 04:29:58 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:44.501 04:29:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:44.501 04:29:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:44.501 { 00:32:44.501 "params": { 00:32:44.501 "name": "Nvme$subsystem", 00:32:44.501 "trtype": "$TEST_TRANSPORT", 00:32:44.501 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:44.501 "adrfam": "ipv4", 00:32:44.501 "trsvcid": "$NVMF_PORT", 00:32:44.501 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:44.501 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:44.501 "hdgst": ${hdgst:-false}, 00:32:44.501 "ddgst": ${ddgst:-false} 00:32:44.501 }, 00:32:44.501 "method": "bdev_nvme_attach_controller" 00:32:44.501 } 00:32:44.501 EOF 00:32:44.501 )") 00:32:44.501 04:29:58 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:44.501 04:29:58 -- target/dif.sh@82 -- # gen_fio_conf 00:32:44.501 04:29:58 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:44.501 04:29:58 -- target/dif.sh@54 -- # local file 00:32:44.501 04:29:58 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:44.501 04:29:58 -- target/dif.sh@56 -- # cat 00:32:44.501 04:29:58 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:44.501 04:29:58 -- common/autotest_common.sh@1320 -- # shift 00:32:44.501 04:29:58 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:44.501 04:29:58 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:44.501 04:29:58 -- nvmf/common.sh@542 -- # cat 00:32:44.501 04:29:58 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:44.501 04:29:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:44.501 04:29:58 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:44.501 04:29:58 -- target/dif.sh@72 -- # (( file <= files )) 00:32:44.501 04:29:58 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:44.501 04:29:58 -- nvmf/common.sh@544 -- # jq . 00:32:44.501 04:29:58 -- nvmf/common.sh@545 -- # IFS=, 00:32:44.501 04:29:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:44.501 "params": { 00:32:44.501 "name": "Nvme0", 00:32:44.501 "trtype": "tcp", 00:32:44.501 "traddr": "10.0.0.2", 00:32:44.501 "adrfam": "ipv4", 00:32:44.501 "trsvcid": "4420", 00:32:44.501 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:44.501 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:44.501 "hdgst": false, 00:32:44.501 "ddgst": false 00:32:44.501 }, 00:32:44.501 "method": "bdev_nvme_attach_controller" 00:32:44.501 }' 00:32:44.501 04:29:58 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:44.501 04:29:58 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:44.501 04:29:58 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:44.501 04:29:58 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:44.501 04:29:58 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:44.501 04:29:58 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:44.501 04:29:58 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:44.501 04:29:58 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:44.501 04:29:58 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:44.501 04:29:58 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:44.501 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:44.501 ... 00:32:44.501 fio-3.35 00:32:44.501 Starting 3 threads 00:32:44.761 EAL: No free 2048 kB hugepages reported on node 1 00:32:45.022 [2024-05-14 04:29:59.554095] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:45.022 [2024-05-14 04:29:59.554148] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:50.310 00:32:50.310 filename0: (groupid=0, jobs=1): err= 0: pid=4170826: Tue May 14 04:30:04 2024 00:32:50.310 read: IOPS=120, BW=15.1MiB/s (15.8MB/s)(75.4MiB/5004msec) 00:32:50.310 slat (nsec): min=5338, max=35182, avg=6989.78, stdev=1776.13 00:32:50.310 clat (usec): min=6968, max=59607, avg=24878.90, stdev=20057.54 00:32:50.310 lat (usec): min=6973, max=59616, avg=24885.89, stdev=20057.71 00:32:50.310 clat percentiles (usec): 00:32:50.310 | 1.00th=[ 7439], 5.00th=[ 8094], 10.00th=[ 8717], 20.00th=[ 9896], 00:32:50.310 | 30.00th=[11207], 40.00th=[12125], 50.00th=[13173], 60.00th=[14222], 00:32:50.310 | 70.00th=[50594], 80.00th=[53740], 90.00th=[55837], 95.00th=[56886], 00:32:50.310 | 99.00th=[58459], 99.50th=[59507], 99.90th=[59507], 99.95th=[59507], 00:32:50.310 | 99.99th=[59507] 00:32:50.310 bw ( KiB/s): min=10752, max=27648, per=32.61%, avg=15360.00, stdev=4910.93, samples=10 00:32:50.310 iops : min= 84, max= 216, avg=120.00, stdev=38.37, samples=10 00:32:50.310 lat (msec) : 10=21.23%, 20=47.93%, 50=0.50%, 100=30.35% 00:32:50.310 cpu : usr=96.90%, sys=2.76%, ctx=8, majf=0, minf=52 00:32:50.310 IO depths : 1=8.0%, 2=92.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:50.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:50.310 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:50.310 issued rwts: total=603,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:50.310 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:50.310 filename0: (groupid=0, jobs=1): err= 0: pid=4170827: Tue May 14 04:30:04 2024 00:32:50.310 read: IOPS=113, BW=14.1MiB/s (14.8MB/s)(71.2MiB/5043msec) 00:32:50.310 slat (nsec): min=5327, max=34861, avg=6964.85, stdev=1833.15 00:32:50.310 clat (usec): min=7643, max=65613, avg=26529.45, stdev=19984.99 00:32:50.310 lat (usec): min=7649, max=65648, avg=26536.41, stdev=19985.33 00:32:50.310 clat percentiles (usec): 00:32:50.310 | 1.00th=[ 7898], 5.00th=[ 8848], 10.00th=[ 9896], 20.00th=[11076], 00:32:50.310 | 30.00th=[12256], 40.00th=[12780], 50.00th=[13960], 60.00th=[15533], 00:32:50.310 | 70.00th=[51643], 80.00th=[54264], 90.00th=[55313], 95.00th=[56361], 00:32:50.310 | 99.00th=[57934], 99.50th=[64226], 99.90th=[65799], 99.95th=[65799], 00:32:50.310 | 99.99th=[65799] 00:32:50.310 bw ( KiB/s): min= 9984, max=23808, per=30.81%, avg=14515.20, stdev=4166.59, samples=10 00:32:50.310 iops : min= 78, max= 186, avg=113.40, stdev=32.55, samples=10 00:32:50.310 lat (msec) : 10=10.00%, 20=56.32%, 50=1.75%, 100=31.93% 00:32:50.310 cpu : usr=96.83%, sys=2.84%, ctx=9, majf=0, minf=69 00:32:50.310 IO depths : 1=9.8%, 2=90.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:50.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:50.310 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:50.310 issued rwts: total=570,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:50.310 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:50.310 filename0: (groupid=0, jobs=1): err= 0: pid=4170828: Tue May 14 04:30:04 2024 00:32:50.310 read: IOPS=136, BW=17.0MiB/s (17.8MB/s)(85.4MiB/5019msec) 00:32:50.310 slat (nsec): min=5335, max=53661, avg=7011.26, stdev=2450.16 00:32:50.310 clat (usec): min=6477, max=97838, avg=22025.96, stdev=20132.31 00:32:50.310 lat (usec): min=6485, max=97844, avg=22032.97, stdev=20132.46 00:32:50.310 clat percentiles (usec): 00:32:50.310 | 1.00th=[ 6718], 5.00th=[ 7373], 10.00th=[ 7963], 20.00th=[ 9241], 00:32:50.310 | 30.00th=[10159], 40.00th=[10814], 50.00th=[11994], 60.00th=[12911], 00:32:50.310 | 70.00th=[14484], 80.00th=[52691], 90.00th=[55313], 95.00th=[56361], 00:32:50.310 | 99.00th=[93848], 99.50th=[94897], 99.90th=[98042], 99.95th=[98042], 00:32:50.310 | 99.99th=[98042] 00:32:50.310 bw ( KiB/s): min= 9984, max=30976, per=36.96%, avg=17410.90, stdev=6452.42, samples=10 00:32:50.310 iops : min= 78, max= 242, avg=136.00, stdev=50.42, samples=10 00:32:50.310 lat (msec) : 10=27.82%, 20=47.73%, 100=24.45% 00:32:50.310 cpu : usr=96.65%, sys=2.99%, ctx=9, majf=0, minf=211 00:32:50.310 IO depths : 1=4.0%, 2=96.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:50.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:50.310 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:50.310 issued rwts: total=683,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:50.310 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:50.310 00:32:50.310 Run status group 0 (all jobs): 00:32:50.310 READ: bw=46.0MiB/s (48.2MB/s), 14.1MiB/s-17.0MiB/s (14.8MB/s-17.8MB/s), io=232MiB (243MB), run=5004-5043msec 00:32:50.310 04:30:04 -- target/dif.sh@107 -- # destroy_subsystems 0 00:32:50.310 04:30:04 -- target/dif.sh@43 -- # local sub 00:32:50.310 04:30:04 -- target/dif.sh@45 -- # for sub in "$@" 00:32:50.310 04:30:04 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:50.310 04:30:04 -- target/dif.sh@36 -- # local sub_id=0 00:32:50.310 04:30:04 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:50.310 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.310 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.310 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.310 04:30:04 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:50.310 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.310 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.571 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.571 04:30:04 -- target/dif.sh@109 -- # NULL_DIF=2 00:32:50.571 04:30:04 -- target/dif.sh@109 -- # bs=4k 00:32:50.571 04:30:04 -- target/dif.sh@109 -- # numjobs=8 00:32:50.571 04:30:04 -- target/dif.sh@109 -- # iodepth=16 00:32:50.571 04:30:04 -- target/dif.sh@109 -- # runtime= 00:32:50.571 04:30:04 -- target/dif.sh@109 -- # files=2 00:32:50.571 04:30:04 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:32:50.571 04:30:04 -- target/dif.sh@28 -- # local sub 00:32:50.571 04:30:04 -- target/dif.sh@30 -- # for sub in "$@" 00:32:50.571 04:30:04 -- target/dif.sh@31 -- # create_subsystem 0 00:32:50.571 04:30:04 -- target/dif.sh@18 -- # local sub_id=0 00:32:50.571 04:30:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:32:50.571 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.571 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.571 bdev_null0 00:32:50.571 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:50.572 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:50.572 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:50.572 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 [2024-05-14 04:30:04.944638] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:50.572 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:04 -- target/dif.sh@30 -- # for sub in "$@" 00:32:50.572 04:30:04 -- target/dif.sh@31 -- # create_subsystem 1 00:32:50.572 04:30:04 -- target/dif.sh@18 -- # local sub_id=1 00:32:50.572 04:30:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:32:50.572 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 bdev_null1 00:32:50.572 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:50.572 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:50.572 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:50.572 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 04:30:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:04 -- target/dif.sh@30 -- # for sub in "$@" 00:32:50.572 04:30:04 -- target/dif.sh@31 -- # create_subsystem 2 00:32:50.572 04:30:04 -- target/dif.sh@18 -- # local sub_id=2 00:32:50.572 04:30:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:32:50.572 04:30:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:04 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 bdev_null2 00:32:50.572 04:30:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:05 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:32:50.572 04:30:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:05 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 04:30:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:05 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:32:50.572 04:30:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:05 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 04:30:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:05 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:32:50.572 04:30:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:50.572 04:30:05 -- common/autotest_common.sh@10 -- # set +x 00:32:50.572 04:30:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:50.572 04:30:05 -- target/dif.sh@112 -- # fio /dev/fd/62 00:32:50.572 04:30:05 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:32:50.572 04:30:05 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:32:50.572 04:30:05 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:50.572 04:30:05 -- nvmf/common.sh@520 -- # config=() 00:32:50.572 04:30:05 -- nvmf/common.sh@520 -- # local subsystem config 00:32:50.572 04:30:05 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:50.572 04:30:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:50.572 04:30:05 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:50.572 04:30:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:50.572 { 00:32:50.572 "params": { 00:32:50.572 "name": "Nvme$subsystem", 00:32:50.572 "trtype": "$TEST_TRANSPORT", 00:32:50.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:50.572 "adrfam": "ipv4", 00:32:50.572 "trsvcid": "$NVMF_PORT", 00:32:50.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:50.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:50.572 "hdgst": ${hdgst:-false}, 00:32:50.572 "ddgst": ${ddgst:-false} 00:32:50.572 }, 00:32:50.572 "method": "bdev_nvme_attach_controller" 00:32:50.572 } 00:32:50.572 EOF 00:32:50.572 )") 00:32:50.572 04:30:05 -- target/dif.sh@82 -- # gen_fio_conf 00:32:50.572 04:30:05 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:50.572 04:30:05 -- target/dif.sh@54 -- # local file 00:32:50.572 04:30:05 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:50.572 04:30:05 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:50.572 04:30:05 -- target/dif.sh@56 -- # cat 00:32:50.572 04:30:05 -- common/autotest_common.sh@1320 -- # shift 00:32:50.572 04:30:05 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:50.572 04:30:05 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:50.572 04:30:05 -- nvmf/common.sh@542 -- # cat 00:32:50.572 04:30:05 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:50.572 04:30:05 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:50.572 04:30:05 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:50.572 04:30:05 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:50.572 04:30:05 -- target/dif.sh@72 -- # (( file <= files )) 00:32:50.572 04:30:05 -- target/dif.sh@73 -- # cat 00:32:50.572 04:30:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:50.572 04:30:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:50.572 { 00:32:50.572 "params": { 00:32:50.572 "name": "Nvme$subsystem", 00:32:50.572 "trtype": "$TEST_TRANSPORT", 00:32:50.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:50.572 "adrfam": "ipv4", 00:32:50.572 "trsvcid": "$NVMF_PORT", 00:32:50.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:50.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:50.572 "hdgst": ${hdgst:-false}, 00:32:50.572 "ddgst": ${ddgst:-false} 00:32:50.572 }, 00:32:50.572 "method": "bdev_nvme_attach_controller" 00:32:50.572 } 00:32:50.572 EOF 00:32:50.572 )") 00:32:50.572 04:30:05 -- target/dif.sh@72 -- # (( file++ )) 00:32:50.572 04:30:05 -- nvmf/common.sh@542 -- # cat 00:32:50.572 04:30:05 -- target/dif.sh@72 -- # (( file <= files )) 00:32:50.572 04:30:05 -- target/dif.sh@73 -- # cat 00:32:50.572 04:30:05 -- target/dif.sh@72 -- # (( file++ )) 00:32:50.572 04:30:05 -- target/dif.sh@72 -- # (( file <= files )) 00:32:50.572 04:30:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:50.572 04:30:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:50.572 { 00:32:50.572 "params": { 00:32:50.572 "name": "Nvme$subsystem", 00:32:50.572 "trtype": "$TEST_TRANSPORT", 00:32:50.572 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:50.572 "adrfam": "ipv4", 00:32:50.572 "trsvcid": "$NVMF_PORT", 00:32:50.572 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:50.572 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:50.572 "hdgst": ${hdgst:-false}, 00:32:50.573 "ddgst": ${ddgst:-false} 00:32:50.573 }, 00:32:50.573 "method": "bdev_nvme_attach_controller" 00:32:50.573 } 00:32:50.573 EOF 00:32:50.573 )") 00:32:50.573 04:30:05 -- nvmf/common.sh@542 -- # cat 00:32:50.573 04:30:05 -- nvmf/common.sh@544 -- # jq . 00:32:50.573 04:30:05 -- nvmf/common.sh@545 -- # IFS=, 00:32:50.573 04:30:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:50.573 "params": { 00:32:50.573 "name": "Nvme0", 00:32:50.573 "trtype": "tcp", 00:32:50.573 "traddr": "10.0.0.2", 00:32:50.573 "adrfam": "ipv4", 00:32:50.573 "trsvcid": "4420", 00:32:50.573 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:50.573 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:50.573 "hdgst": false, 00:32:50.573 "ddgst": false 00:32:50.573 }, 00:32:50.573 "method": "bdev_nvme_attach_controller" 00:32:50.573 },{ 00:32:50.573 "params": { 00:32:50.573 "name": "Nvme1", 00:32:50.573 "trtype": "tcp", 00:32:50.573 "traddr": "10.0.0.2", 00:32:50.573 "adrfam": "ipv4", 00:32:50.573 "trsvcid": "4420", 00:32:50.573 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:50.573 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:50.573 "hdgst": false, 00:32:50.573 "ddgst": false 00:32:50.573 }, 00:32:50.573 "method": "bdev_nvme_attach_controller" 00:32:50.573 },{ 00:32:50.573 "params": { 00:32:50.573 "name": "Nvme2", 00:32:50.573 "trtype": "tcp", 00:32:50.573 "traddr": "10.0.0.2", 00:32:50.573 "adrfam": "ipv4", 00:32:50.573 "trsvcid": "4420", 00:32:50.573 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:32:50.573 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:32:50.573 "hdgst": false, 00:32:50.573 "ddgst": false 00:32:50.573 }, 00:32:50.573 "method": "bdev_nvme_attach_controller" 00:32:50.573 }' 00:32:50.573 04:30:05 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:50.573 04:30:05 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:50.573 04:30:05 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:50.573 04:30:05 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:50.573 04:30:05 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:50.573 04:30:05 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:50.573 04:30:05 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:50.573 04:30:05 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:50.573 04:30:05 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:50.573 04:30:05 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:51.145 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:51.145 ... 00:32:51.145 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:51.145 ... 00:32:51.145 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:51.145 ... 00:32:51.145 fio-3.35 00:32:51.145 Starting 24 threads 00:32:51.145 EAL: No free 2048 kB hugepages reported on node 1 00:32:52.087 [2024-05-14 04:30:06.345593] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:52.087 [2024-05-14 04:30:06.345659] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:33:02.094 00:33:02.094 filename0: (groupid=0, jobs=1): err= 0: pid=4172453: Tue May 14 04:30:16 2024 00:33:02.094 read: IOPS=515, BW=2062KiB/s (2112kB/s)(20.2MiB/10025msec) 00:33:02.094 slat (nsec): min=5380, max=89602, avg=9820.82, stdev=7304.74 00:33:02.094 clat (msec): min=6, max=378, avg=30.94, stdev=17.31 00:33:02.094 lat (msec): min=6, max=378, avg=30.95, stdev=17.31 00:33:02.094 clat percentiles (msec): 00:33:02.094 | 1.00th=[ 13], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 28], 00:33:02.094 | 30.00th=[ 29], 40.00th=[ 29], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.094 | 70.00th=[ 31], 80.00th=[ 33], 90.00th=[ 39], 95.00th=[ 42], 00:33:02.094 | 99.00th=[ 49], 99.50th=[ 120], 99.90th=[ 380], 99.95th=[ 380], 00:33:02.094 | 99.99th=[ 380] 00:33:02.094 bw ( KiB/s): min= 640, max= 2480, per=4.33%, avg=2063.60, stdev=352.23, samples=20 00:33:02.094 iops : min= 160, max= 620, avg=515.90, stdev=88.06, samples=20 00:33:02.094 lat (msec) : 10=0.93%, 20=4.93%, 50=93.34%, 100=0.29%, 250=0.31% 00:33:02.094 lat (msec) : 500=0.19% 00:33:02.094 cpu : usr=98.80%, sys=0.86%, ctx=16, majf=0, minf=105 00:33:02.094 IO depths : 1=1.5%, 2=3.0%, 4=11.2%, 8=72.2%, 16=12.1%, 32=0.0%, >=64=0.0% 00:33:02.094 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.094 complete : 0=0.0%, 4=90.6%, 8=4.8%, 16=4.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.094 issued rwts: total=5169,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.094 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.094 filename0: (groupid=0, jobs=1): err= 0: pid=4172454: Tue May 14 04:30:16 2024 00:33:02.094 read: IOPS=488, BW=1954KiB/s (2001kB/s)(19.1MiB/10007msec) 00:33:02.094 slat (nsec): min=5349, max=85494, avg=13225.33, stdev=10928.34 00:33:02.094 clat (msec): min=13, max=389, avg=32.67, stdev=19.77 00:33:02.094 lat (msec): min=13, max=389, avg=32.68, stdev=19.77 00:33:02.094 clat percentiles (msec): 00:33:02.094 | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.094 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.094 | 70.00th=[ 32], 80.00th=[ 38], 90.00th=[ 41], 95.00th=[ 44], 00:33:02.094 | 99.00th=[ 52], 99.50th=[ 61], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.094 | 99.99th=[ 388] 00:33:02.094 bw ( KiB/s): min= 736, max= 2152, per=4.10%, avg=1953.35, stdev=298.58, samples=20 00:33:02.094 iops : min= 184, max= 538, avg=488.30, stdev=74.66, samples=20 00:33:02.094 lat (msec) : 20=3.68%, 50=95.01%, 100=0.86%, 250=0.12%, 500=0.33% 00:33:02.094 cpu : usr=99.06%, sys=0.60%, ctx=21, majf=0, minf=44 00:33:02.094 IO depths : 1=0.7%, 2=1.4%, 4=8.4%, 8=75.4%, 16=14.1%, 32=0.0%, >=64=0.0% 00:33:02.094 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.094 complete : 0=0.0%, 4=90.3%, 8=6.3%, 16=3.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.094 issued rwts: total=4889,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.094 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.094 filename0: (groupid=0, jobs=1): err= 0: pid=4172455: Tue May 14 04:30:16 2024 00:33:02.094 read: IOPS=475, BW=1903KiB/s (1949kB/s)(18.6MiB/10008msec) 00:33:02.094 slat (nsec): min=5346, max=90251, avg=14826.65, stdev=12279.61 00:33:02.094 clat (msec): min=7, max=395, avg=33.52, stdev=19.03 00:33:02.094 lat (msec): min=7, max=395, avg=33.53, stdev=19.03 00:33:02.094 clat percentiles (msec): 00:33:02.094 | 1.00th=[ 15], 5.00th=[ 22], 10.00th=[ 28], 20.00th=[ 29], 00:33:02.094 | 30.00th=[ 30], 40.00th=[ 30], 50.00th=[ 31], 60.00th=[ 32], 00:33:02.094 | 70.00th=[ 36], 80.00th=[ 39], 90.00th=[ 42], 95.00th=[ 45], 00:33:02.094 | 99.00th=[ 52], 99.50th=[ 132], 99.90th=[ 397], 99.95th=[ 397], 00:33:02.094 | 99.99th=[ 397] 00:33:02.094 bw ( KiB/s): min= 776, max= 2176, per=3.98%, avg=1897.26, stdev=301.11, samples=19 00:33:02.094 iops : min= 194, max= 544, avg=474.32, stdev=75.28, samples=19 00:33:02.094 lat (msec) : 10=0.21%, 20=4.09%, 50=94.08%, 100=1.07%, 250=0.21% 00:33:02.094 lat (msec) : 500=0.34% 00:33:02.094 cpu : usr=98.98%, sys=0.67%, ctx=16, majf=0, minf=47 00:33:02.094 IO depths : 1=1.5%, 2=3.7%, 4=14.7%, 8=68.2%, 16=11.8%, 32=0.0%, >=64=0.0% 00:33:02.094 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.094 complete : 0=0.0%, 4=92.0%, 8=3.0%, 16=4.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.094 issued rwts: total=4762,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.094 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.094 filename0: (groupid=0, jobs=1): err= 0: pid=4172456: Tue May 14 04:30:16 2024 00:33:02.094 read: IOPS=499, BW=1997KiB/s (2045kB/s)(19.5MiB/10004msec) 00:33:02.094 slat (usec): min=6, max=100, avg=17.72, stdev=14.97 00:33:02.094 clat (msec): min=4, max=334, avg=31.95, stdev=17.05 00:33:02.094 lat (msec): min=4, max=334, avg=31.97, stdev=17.05 00:33:02.094 clat percentiles (msec): 00:33:02.095 | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 27], 20.00th=[ 28], 00:33:02.095 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.095 | 70.00th=[ 32], 80.00th=[ 36], 90.00th=[ 40], 95.00th=[ 43], 00:33:02.095 | 99.00th=[ 53], 99.50th=[ 130], 99.90th=[ 288], 99.95th=[ 334], 00:33:02.095 | 99.99th=[ 334] 00:33:02.095 bw ( KiB/s): min= 768, max= 2192, per=4.14%, avg=1971.11, stdev=309.52, samples=19 00:33:02.095 iops : min= 192, max= 548, avg=492.74, stdev=77.40, samples=19 00:33:02.095 lat (msec) : 10=0.52%, 20=3.44%, 50=94.65%, 100=0.82%, 250=0.24% 00:33:02.095 lat (msec) : 500=0.32% 00:33:02.095 cpu : usr=98.87%, sys=0.74%, ctx=59, majf=0, minf=38 00:33:02.095 IO depths : 1=0.1%, 2=0.9%, 4=7.9%, 8=76.0%, 16=15.1%, 32=0.0%, >=64=0.0% 00:33:02.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 complete : 0=0.0%, 4=90.5%, 8=6.3%, 16=3.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 issued rwts: total=4995,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.095 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.095 filename0: (groupid=0, jobs=1): err= 0: pid=4172457: Tue May 14 04:30:16 2024 00:33:02.095 read: IOPS=522, BW=2090KiB/s (2140kB/s)(20.4MiB/10014msec) 00:33:02.095 slat (usec): min=5, max=282, avg=15.50, stdev=14.74 00:33:02.095 clat (msec): min=13, max=289, avg=30.48, stdev=15.89 00:33:02.095 lat (msec): min=13, max=289, avg=30.49, stdev=15.89 00:33:02.095 clat percentiles (msec): 00:33:02.095 | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 28], 00:33:02.095 | 30.00th=[ 29], 40.00th=[ 29], 50.00th=[ 30], 60.00th=[ 30], 00:33:02.095 | 70.00th=[ 31], 80.00th=[ 31], 90.00th=[ 35], 95.00th=[ 40], 00:33:02.095 | 99.00th=[ 47], 99.50th=[ 122], 99.90th=[ 288], 99.95th=[ 288], 00:33:02.095 | 99.99th=[ 288] 00:33:02.095 bw ( KiB/s): min= 752, max= 2304, per=4.39%, avg=2092.00, stdev=320.59, samples=20 00:33:02.095 iops : min= 188, max= 576, avg=523.00, stdev=80.15, samples=20 00:33:02.095 lat (msec) : 20=4.26%, 50=94.97%, 100=0.15%, 250=0.31%, 500=0.31% 00:33:02.095 cpu : usr=96.04%, sys=1.75%, ctx=147, majf=0, minf=55 00:33:02.095 IO depths : 1=1.8%, 2=6.6%, 4=20.8%, 8=59.7%, 16=11.1%, 32=0.0%, >=64=0.0% 00:33:02.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 complete : 0=0.0%, 4=93.3%, 8=1.4%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 issued rwts: total=5232,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.095 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.095 filename0: (groupid=0, jobs=1): err= 0: pid=4172458: Tue May 14 04:30:16 2024 00:33:02.095 read: IOPS=504, BW=2020KiB/s (2068kB/s)(19.8MiB/10014msec) 00:33:02.095 slat (usec): min=5, max=107, avg=16.47, stdev=13.46 00:33:02.095 clat (msec): min=15, max=289, avg=31.57, stdev=16.13 00:33:02.095 lat (msec): min=15, max=289, avg=31.59, stdev=16.13 00:33:02.095 clat percentiles (msec): 00:33:02.095 | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 29], 00:33:02.095 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.095 | 70.00th=[ 31], 80.00th=[ 32], 90.00th=[ 38], 95.00th=[ 41], 00:33:02.095 | 99.00th=[ 49], 99.50th=[ 130], 99.90th=[ 288], 99.95th=[ 288], 00:33:02.095 | 99.99th=[ 288] 00:33:02.095 bw ( KiB/s): min= 688, max= 2304, per=4.23%, avg=2016.00, stdev=327.43, samples=20 00:33:02.095 iops : min= 172, max= 576, avg=504.00, stdev=81.86, samples=20 00:33:02.095 lat (msec) : 20=2.31%, 50=96.80%, 100=0.26%, 250=0.32%, 500=0.32% 00:33:02.095 cpu : usr=99.09%, sys=0.53%, ctx=51, majf=0, minf=42 00:33:02.095 IO depths : 1=3.4%, 2=6.9%, 4=17.1%, 8=62.6%, 16=10.0%, 32=0.0%, >=64=0.0% 00:33:02.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 complete : 0=0.0%, 4=92.3%, 8=2.9%, 16=4.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.095 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.095 filename0: (groupid=0, jobs=1): err= 0: pid=4172459: Tue May 14 04:30:16 2024 00:33:02.095 read: IOPS=485, BW=1944KiB/s (1990kB/s)(19.0MiB/10027msec) 00:33:02.095 slat (usec): min=5, max=100, avg=14.78, stdev=12.35 00:33:02.095 clat (msec): min=6, max=389, avg=32.83, stdev=20.01 00:33:02.095 lat (msec): min=6, max=389, avg=32.85, stdev=20.01 00:33:02.095 clat percentiles (msec): 00:33:02.095 | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.095 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 31], 60.00th=[ 31], 00:33:02.095 | 70.00th=[ 35], 80.00th=[ 39], 90.00th=[ 41], 95.00th=[ 44], 00:33:02.095 | 99.00th=[ 55], 99.50th=[ 59], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.095 | 99.99th=[ 388] 00:33:02.095 bw ( KiB/s): min= 608, max= 2332, per=4.08%, avg=1942.60, stdev=330.05, samples=20 00:33:02.095 iops : min= 152, max= 583, avg=485.65, stdev=82.51, samples=20 00:33:02.095 lat (msec) : 10=0.62%, 20=3.28%, 50=94.46%, 100=1.19%, 250=0.12% 00:33:02.095 lat (msec) : 500=0.33% 00:33:02.095 cpu : usr=98.96%, sys=0.69%, ctx=20, majf=0, minf=47 00:33:02.095 IO depths : 1=0.7%, 2=1.5%, 4=9.0%, 8=75.2%, 16=13.6%, 32=0.0%, >=64=0.0% 00:33:02.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 complete : 0=0.0%, 4=90.3%, 8=5.9%, 16=3.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 issued rwts: total=4872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.095 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.095 filename0: (groupid=0, jobs=1): err= 0: pid=4172460: Tue May 14 04:30:16 2024 00:33:02.095 read: IOPS=489, BW=1957KiB/s (2004kB/s)(19.1MiB/10013msec) 00:33:02.095 slat (nsec): min=5357, max=82934, avg=12462.12, stdev=10184.38 00:33:02.095 clat (msec): min=12, max=396, avg=32.62, stdev=17.48 00:33:02.095 lat (msec): min=12, max=396, avg=32.64, stdev=17.48 00:33:02.095 clat percentiles (msec): 00:33:02.095 | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.095 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 31], 60.00th=[ 31], 00:33:02.095 | 70.00th=[ 33], 80.00th=[ 38], 90.00th=[ 41], 95.00th=[ 44], 00:33:02.095 | 99.00th=[ 54], 99.50th=[ 122], 99.90th=[ 288], 99.95th=[ 288], 00:33:02.095 | 99.99th=[ 397] 00:33:02.095 bw ( KiB/s): min= 720, max= 2120, per=4.08%, avg=1942.74, stdev=304.01, samples=19 00:33:02.095 iops : min= 180, max= 530, avg=485.68, stdev=76.00, samples=19 00:33:02.095 lat (msec) : 20=3.92%, 50=94.33%, 100=1.14%, 250=0.29%, 500=0.33% 00:33:02.095 cpu : usr=98.92%, sys=0.73%, ctx=47, majf=0, minf=56 00:33:02.095 IO depths : 1=0.7%, 2=1.4%, 4=9.2%, 8=75.0%, 16=13.7%, 32=0.0%, >=64=0.0% 00:33:02.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 complete : 0=0.0%, 4=90.4%, 8=5.8%, 16=3.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 issued rwts: total=4899,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.095 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.095 filename1: (groupid=0, jobs=1): err= 0: pid=4172461: Tue May 14 04:30:16 2024 00:33:02.095 read: IOPS=503, BW=2012KiB/s (2061kB/s)(19.7MiB/10004msec) 00:33:02.095 slat (usec): min=5, max=108, avg=17.22, stdev=14.86 00:33:02.095 clat (msec): min=4, max=395, avg=31.70, stdev=18.61 00:33:02.095 lat (msec): min=4, max=395, avg=31.72, stdev=18.61 00:33:02.095 clat percentiles (msec): 00:33:02.095 | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 28], 00:33:02.095 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.095 | 70.00th=[ 31], 80.00th=[ 36], 90.00th=[ 40], 95.00th=[ 43], 00:33:02.095 | 99.00th=[ 51], 99.50th=[ 58], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.095 | 99.99th=[ 397] 00:33:02.095 bw ( KiB/s): min= 808, max= 2384, per=4.18%, avg=1990.32, stdev=322.52, samples=19 00:33:02.095 iops : min= 202, max= 596, avg=497.58, stdev=80.63, samples=19 00:33:02.095 lat (msec) : 10=0.32%, 20=4.27%, 50=94.50%, 100=0.44%, 250=0.28% 00:33:02.095 lat (msec) : 500=0.20% 00:33:02.095 cpu : usr=99.06%, sys=0.56%, ctx=22, majf=0, minf=56 00:33:02.095 IO depths : 1=0.3%, 2=1.9%, 4=11.4%, 8=72.3%, 16=14.1%, 32=0.0%, >=64=0.0% 00:33:02.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 complete : 0=0.0%, 4=91.2%, 8=4.9%, 16=3.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 issued rwts: total=5033,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.095 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.095 filename1: (groupid=0, jobs=1): err= 0: pid=4172462: Tue May 14 04:30:16 2024 00:33:02.095 read: IOPS=474, BW=1897KiB/s (1942kB/s)(18.5MiB/10008msec) 00:33:02.095 slat (usec): min=5, max=621, avg=16.00, stdev=16.41 00:33:02.095 clat (msec): min=11, max=294, avg=33.63, stdev=17.20 00:33:02.095 lat (msec): min=11, max=294, avg=33.65, stdev=17.20 00:33:02.095 clat percentiles (msec): 00:33:02.095 | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.095 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 31], 60.00th=[ 32], 00:33:02.095 | 70.00th=[ 37], 80.00th=[ 39], 90.00th=[ 42], 95.00th=[ 46], 00:33:02.095 | 99.00th=[ 58], 99.50th=[ 120], 99.90th=[ 296], 99.95th=[ 296], 00:33:02.095 | 99.99th=[ 296] 00:33:02.095 bw ( KiB/s): min= 672, max= 2104, per=3.98%, avg=1894.55, stdev=304.57, samples=20 00:33:02.095 iops : min= 168, max= 526, avg=473.60, stdev=76.16, samples=20 00:33:02.095 lat (msec) : 20=2.80%, 50=95.15%, 100=1.37%, 250=0.34%, 500=0.34% 00:33:02.095 cpu : usr=97.20%, sys=1.44%, ctx=43, majf=0, minf=46 00:33:02.095 IO depths : 1=0.9%, 2=2.2%, 4=10.5%, 8=73.6%, 16=12.7%, 32=0.0%, >=64=0.0% 00:33:02.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 complete : 0=0.0%, 4=90.7%, 8=4.6%, 16=4.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 issued rwts: total=4746,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.095 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.095 filename1: (groupid=0, jobs=1): err= 0: pid=4172463: Tue May 14 04:30:16 2024 00:33:02.095 read: IOPS=486, BW=1946KiB/s (1993kB/s)(19.0MiB/10018msec) 00:33:02.095 slat (nsec): min=5370, max=93914, avg=16821.40, stdev=14059.00 00:33:02.095 clat (msec): min=12, max=310, avg=32.75, stdev=17.49 00:33:02.095 lat (msec): min=12, max=310, avg=32.77, stdev=17.49 00:33:02.095 clat percentiles (msec): 00:33:02.095 | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 28], 00:33:02.095 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.095 | 70.00th=[ 34], 80.00th=[ 39], 90.00th=[ 41], 95.00th=[ 43], 00:33:02.095 | 99.00th=[ 54], 99.50th=[ 121], 99.90th=[ 309], 99.95th=[ 309], 00:33:02.095 | 99.99th=[ 309] 00:33:02.095 bw ( KiB/s): min= 640, max= 2264, per=4.08%, avg=1943.60, stdev=326.72, samples=20 00:33:02.095 iops : min= 160, max= 566, avg=485.90, stdev=81.68, samples=20 00:33:02.095 lat (msec) : 20=3.69%, 50=95.10%, 100=0.55%, 250=0.33%, 500=0.33% 00:33:02.095 cpu : usr=98.90%, sys=0.73%, ctx=16, majf=0, minf=45 00:33:02.095 IO depths : 1=1.1%, 2=2.2%, 4=10.7%, 8=73.0%, 16=13.0%, 32=0.0%, >=64=0.0% 00:33:02.095 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 complete : 0=0.0%, 4=90.8%, 8=5.1%, 16=4.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.095 issued rwts: total=4875,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.096 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.096 filename1: (groupid=0, jobs=1): err= 0: pid=4172464: Tue May 14 04:30:16 2024 00:33:02.096 read: IOPS=501, BW=2005KiB/s (2053kB/s)(19.6MiB/10007msec) 00:33:02.096 slat (nsec): min=5372, max=90862, avg=15562.51, stdev=13542.75 00:33:02.096 clat (msec): min=8, max=396, avg=31.81, stdev=18.66 00:33:02.096 lat (msec): min=8, max=396, avg=31.82, stdev=18.66 00:33:02.096 clat percentiles (msec): 00:33:02.096 | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.096 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.096 | 70.00th=[ 31], 80.00th=[ 34], 90.00th=[ 39], 95.00th=[ 42], 00:33:02.096 | 99.00th=[ 50], 99.50th=[ 58], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.096 | 99.99th=[ 397] 00:33:02.096 bw ( KiB/s): min= 880, max= 2192, per=4.18%, avg=1992.84, stdev=289.60, samples=19 00:33:02.096 iops : min= 220, max= 548, avg=498.21, stdev=72.40, samples=19 00:33:02.096 lat (msec) : 10=0.04%, 20=3.07%, 50=96.07%, 100=0.38%, 250=0.24% 00:33:02.096 lat (msec) : 500=0.20% 00:33:02.096 cpu : usr=99.03%, sys=0.62%, ctx=18, majf=0, minf=50 00:33:02.096 IO depths : 1=1.7%, 2=4.4%, 4=13.9%, 8=67.7%, 16=12.3%, 32=0.0%, >=64=0.0% 00:33:02.096 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 complete : 0=0.0%, 4=91.7%, 8=3.9%, 16=4.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 issued rwts: total=5015,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.096 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.096 filename1: (groupid=0, jobs=1): err= 0: pid=4172465: Tue May 14 04:30:16 2024 00:33:02.096 read: IOPS=475, BW=1902KiB/s (1948kB/s)(18.6MiB/10004msec) 00:33:02.096 slat (nsec): min=5340, max=95136, avg=15981.57, stdev=13377.04 00:33:02.096 clat (msec): min=6, max=395, avg=33.56, stdev=18.83 00:33:02.096 lat (msec): min=6, max=395, avg=33.58, stdev=18.83 00:33:02.096 clat percentiles (msec): 00:33:02.096 | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 29], 00:33:02.096 | 30.00th=[ 30], 40.00th=[ 30], 50.00th=[ 31], 60.00th=[ 32], 00:33:02.096 | 70.00th=[ 36], 80.00th=[ 39], 90.00th=[ 42], 95.00th=[ 45], 00:33:02.096 | 99.00th=[ 53], 99.50th=[ 126], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.096 | 99.99th=[ 397] 00:33:02.096 bw ( KiB/s): min= 712, max= 2096, per=3.96%, avg=1888.84, stdev=303.00, samples=19 00:33:02.096 iops : min= 178, max= 524, avg=472.21, stdev=75.75, samples=19 00:33:02.096 lat (msec) : 10=0.27%, 20=2.27%, 50=95.75%, 100=1.18%, 250=0.32% 00:33:02.096 lat (msec) : 500=0.21% 00:33:02.096 cpu : usr=98.90%, sys=0.75%, ctx=16, majf=0, minf=59 00:33:02.096 IO depths : 1=0.3%, 2=0.7%, 4=8.9%, 8=76.0%, 16=14.2%, 32=0.0%, >=64=0.0% 00:33:02.096 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 complete : 0=0.0%, 4=90.6%, 8=5.5%, 16=3.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 issued rwts: total=4757,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.096 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.096 filename1: (groupid=0, jobs=1): err= 0: pid=4172466: Tue May 14 04:30:16 2024 00:33:02.096 read: IOPS=542, BW=2171KiB/s (2223kB/s)(21.2MiB/10016msec) 00:33:02.096 slat (nsec): min=5356, max=95040, avg=7604.96, stdev=4656.95 00:33:02.096 clat (msec): min=7, max=388, avg=29.43, stdev=17.68 00:33:02.096 lat (msec): min=7, max=388, avg=29.43, stdev=17.68 00:33:02.096 clat percentiles (msec): 00:33:02.096 | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 25], 00:33:02.096 | 30.00th=[ 29], 40.00th=[ 29], 50.00th=[ 30], 60.00th=[ 30], 00:33:02.096 | 70.00th=[ 31], 80.00th=[ 31], 90.00th=[ 35], 95.00th=[ 38], 00:33:02.096 | 99.00th=[ 48], 99.50th=[ 58], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.096 | 99.99th=[ 388] 00:33:02.096 bw ( KiB/s): min= 640, max= 2624, per=4.55%, avg=2168.20, stdev=393.60, samples=20 00:33:02.096 iops : min= 160, max= 656, avg=542.05, stdev=98.40, samples=20 00:33:02.096 lat (msec) : 10=0.13%, 20=10.36%, 50=88.96%, 100=0.07%, 250=0.18% 00:33:02.096 lat (msec) : 500=0.29% 00:33:02.096 cpu : usr=99.01%, sys=0.65%, ctx=15, majf=0, minf=49 00:33:02.096 IO depths : 1=3.2%, 2=6.9%, 4=17.5%, 8=62.5%, 16=9.9%, 32=0.0%, >=64=0.0% 00:33:02.096 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 complete : 0=0.0%, 4=92.3%, 8=2.4%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 issued rwts: total=5436,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.096 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.096 filename1: (groupid=0, jobs=1): err= 0: pid=4172467: Tue May 14 04:30:16 2024 00:33:02.096 read: IOPS=499, BW=1997KiB/s (2045kB/s)(19.5MiB/10006msec) 00:33:02.096 slat (nsec): min=5365, max=84324, avg=13563.88, stdev=11041.50 00:33:02.096 clat (msec): min=15, max=389, avg=31.98, stdev=19.81 00:33:02.096 lat (msec): min=15, max=389, avg=31.99, stdev=19.81 00:33:02.096 clat percentiles (msec): 00:33:02.096 | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 29], 00:33:02.096 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.096 | 70.00th=[ 31], 80.00th=[ 32], 90.00th=[ 39], 95.00th=[ 41], 00:33:02.096 | 99.00th=[ 51], 99.50th=[ 61], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.096 | 99.99th=[ 388] 00:33:02.096 bw ( KiB/s): min= 672, max= 2224, per=4.17%, avg=1984.42, stdev=344.17, samples=19 00:33:02.096 iops : min= 168, max= 556, avg=496.11, stdev=86.04, samples=19 00:33:02.096 lat (msec) : 20=1.32%, 50=97.72%, 100=0.56%, 250=0.08%, 500=0.32% 00:33:02.096 cpu : usr=98.96%, sys=0.69%, ctx=16, majf=0, minf=44 00:33:02.096 IO depths : 1=0.5%, 2=1.1%, 4=6.5%, 8=77.0%, 16=14.9%, 32=0.0%, >=64=0.0% 00:33:02.096 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 complete : 0=0.0%, 4=90.3%, 8=6.5%, 16=3.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 issued rwts: total=4995,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.096 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.096 filename1: (groupid=0, jobs=1): err= 0: pid=4172468: Tue May 14 04:30:16 2024 00:33:02.096 read: IOPS=495, BW=1981KiB/s (2029kB/s)(19.4MiB/10028msec) 00:33:02.096 slat (nsec): min=5356, max=73136, avg=12582.46, stdev=9804.70 00:33:02.096 clat (msec): min=13, max=328, avg=32.22, stdev=16.78 00:33:02.096 lat (msec): min=14, max=328, avg=32.24, stdev=16.78 00:33:02.096 clat percentiles (msec): 00:33:02.096 | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.096 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.096 | 70.00th=[ 32], 80.00th=[ 37], 90.00th=[ 41], 95.00th=[ 43], 00:33:02.096 | 99.00th=[ 52], 99.50th=[ 114], 99.90th=[ 288], 99.95th=[ 330], 00:33:02.096 | 99.99th=[ 330] 00:33:02.096 bw ( KiB/s): min= 696, max= 2152, per=4.16%, avg=1980.40, stdev=306.91, samples=20 00:33:02.096 iops : min= 174, max= 538, avg=495.10, stdev=76.73, samples=20 00:33:02.096 lat (msec) : 20=3.04%, 50=95.79%, 100=0.58%, 250=0.26%, 500=0.32% 00:33:02.096 cpu : usr=98.92%, sys=0.72%, ctx=18, majf=0, minf=47 00:33:02.096 IO depths : 1=0.8%, 2=1.5%, 4=8.9%, 8=75.4%, 16=13.4%, 32=0.0%, >=64=0.0% 00:33:02.096 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 complete : 0=0.0%, 4=90.3%, 8=5.8%, 16=3.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 issued rwts: total=4967,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.096 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.096 filename2: (groupid=0, jobs=1): err= 0: pid=4172469: Tue May 14 04:30:16 2024 00:33:02.096 read: IOPS=488, BW=1953KiB/s (2000kB/s)(19.1MiB/10009msec) 00:33:02.096 slat (nsec): min=5346, max=84553, avg=14600.29, stdev=11771.13 00:33:02.096 clat (msec): min=12, max=299, avg=32.68, stdev=16.95 00:33:02.096 lat (msec): min=12, max=299, avg=32.69, stdev=16.95 00:33:02.096 clat percentiles (msec): 00:33:02.096 | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.096 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.096 | 70.00th=[ 32], 80.00th=[ 37], 90.00th=[ 41], 95.00th=[ 44], 00:33:02.096 | 99.00th=[ 52], 99.50th=[ 121], 99.90th=[ 296], 99.95th=[ 300], 00:33:02.096 | 99.99th=[ 300] 00:33:02.096 bw ( KiB/s): min= 864, max= 2128, per=4.08%, avg=1942.32, stdev=272.89, samples=19 00:33:02.096 iops : min= 216, max= 532, avg=485.58, stdev=68.22, samples=19 00:33:02.096 lat (msec) : 20=2.29%, 50=96.22%, 100=0.84%, 250=0.33%, 500=0.33% 00:33:02.096 cpu : usr=98.88%, sys=0.76%, ctx=16, majf=0, minf=50 00:33:02.096 IO depths : 1=0.5%, 2=1.3%, 4=9.3%, 8=74.7%, 16=14.1%, 32=0.0%, >=64=0.0% 00:33:02.096 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 complete : 0=0.0%, 4=90.7%, 8=5.7%, 16=3.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 issued rwts: total=4888,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.096 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.096 filename2: (groupid=0, jobs=1): err= 0: pid=4172470: Tue May 14 04:30:16 2024 00:33:02.096 read: IOPS=488, BW=1955KiB/s (2002kB/s)(19.1MiB/10018msec) 00:33:02.096 slat (nsec): min=5348, max=90381, avg=15136.71, stdev=12786.99 00:33:02.096 clat (msec): min=12, max=289, avg=32.64, stdev=16.84 00:33:02.096 lat (msec): min=12, max=289, avg=32.65, stdev=16.84 00:33:02.096 clat percentiles (msec): 00:33:02.096 | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.096 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.096 | 70.00th=[ 32], 80.00th=[ 38], 90.00th=[ 41], 95.00th=[ 44], 00:33:02.096 | 99.00th=[ 57], 99.50th=[ 122], 99.90th=[ 288], 99.95th=[ 288], 00:33:02.096 | 99.99th=[ 288] 00:33:02.096 bw ( KiB/s): min= 768, max= 2216, per=4.10%, avg=1952.40, stdev=295.40, samples=20 00:33:02.096 iops : min= 192, max= 554, avg=488.10, stdev=73.85, samples=20 00:33:02.096 lat (msec) : 20=2.35%, 50=96.06%, 100=0.94%, 250=0.33%, 500=0.33% 00:33:02.096 cpu : usr=98.83%, sys=0.82%, ctx=17, majf=0, minf=33 00:33:02.096 IO depths : 1=0.7%, 2=1.6%, 4=9.5%, 8=74.4%, 16=13.9%, 32=0.0%, >=64=0.0% 00:33:02.096 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 complete : 0=0.0%, 4=90.6%, 8=5.5%, 16=3.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.096 issued rwts: total=4897,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.096 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.096 filename2: (groupid=0, jobs=1): err= 0: pid=4172471: Tue May 14 04:30:16 2024 00:33:02.096 read: IOPS=499, BW=1997KiB/s (2045kB/s)(19.5MiB/10004msec) 00:33:02.096 slat (nsec): min=5356, max=87699, avg=17112.15, stdev=13636.85 00:33:02.096 clat (msec): min=4, max=389, avg=31.93, stdev=18.08 00:33:02.096 lat (msec): min=4, max=389, avg=31.94, stdev=18.08 00:33:02.096 clat percentiles (msec): 00:33:02.096 | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.096 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.096 | 70.00th=[ 31], 80.00th=[ 34], 90.00th=[ 40], 95.00th=[ 43], 00:33:02.096 | 99.00th=[ 48], 99.50th=[ 131], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.096 | 99.99th=[ 388] 00:33:02.096 bw ( KiB/s): min= 800, max= 2320, per=4.16%, avg=1981.63, stdev=319.49, samples=19 00:33:02.096 iops : min= 200, max= 580, avg=495.37, stdev=79.89, samples=19 00:33:02.097 lat (msec) : 10=0.34%, 20=2.74%, 50=96.18%, 100=0.22%, 250=0.32% 00:33:02.097 lat (msec) : 500=0.20% 00:33:02.097 cpu : usr=98.99%, sys=0.66%, ctx=15, majf=0, minf=41 00:33:02.097 IO depths : 1=2.7%, 2=5.3%, 4=14.5%, 8=66.2%, 16=11.3%, 32=0.0%, >=64=0.0% 00:33:02.097 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 complete : 0=0.0%, 4=91.7%, 8=4.0%, 16=4.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 issued rwts: total=4994,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.097 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.097 filename2: (groupid=0, jobs=1): err= 0: pid=4172472: Tue May 14 04:30:16 2024 00:33:02.097 read: IOPS=515, BW=2061KiB/s (2110kB/s)(20.2MiB/10029msec) 00:33:02.097 slat (nsec): min=5350, max=87083, avg=12116.62, stdev=10547.29 00:33:02.097 clat (msec): min=6, max=288, avg=30.96, stdev=15.89 00:33:02.097 lat (msec): min=6, max=288, avg=30.97, stdev=15.89 00:33:02.097 clat percentiles (msec): 00:33:02.097 | 1.00th=[ 15], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 29], 00:33:02.097 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.097 | 70.00th=[ 31], 80.00th=[ 32], 90.00th=[ 37], 95.00th=[ 39], 00:33:02.097 | 99.00th=[ 52], 99.50th=[ 114], 99.90th=[ 288], 99.95th=[ 288], 00:33:02.097 | 99.99th=[ 288] 00:33:02.097 bw ( KiB/s): min= 640, max= 2304, per=4.33%, avg=2060.40, stdev=340.36, samples=20 00:33:02.097 iops : min= 160, max= 576, avg=515.10, stdev=85.09, samples=20 00:33:02.097 lat (msec) : 10=0.50%, 20=2.59%, 50=95.76%, 100=0.52%, 250=0.31% 00:33:02.097 lat (msec) : 500=0.31% 00:33:02.097 cpu : usr=98.97%, sys=0.67%, ctx=19, majf=0, minf=61 00:33:02.097 IO depths : 1=0.7%, 2=1.6%, 4=9.1%, 8=75.7%, 16=12.9%, 32=0.0%, >=64=0.0% 00:33:02.097 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 complete : 0=0.0%, 4=90.3%, 8=5.0%, 16=4.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 issued rwts: total=5167,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.097 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.097 filename2: (groupid=0, jobs=1): err= 0: pid=4172473: Tue May 14 04:30:16 2024 00:33:02.097 read: IOPS=496, BW=1986KiB/s (2034kB/s)(19.4MiB/10004msec) 00:33:02.097 slat (nsec): min=5354, max=91261, avg=14242.21, stdev=12285.44 00:33:02.097 clat (msec): min=4, max=311, avg=32.14, stdev=16.22 00:33:02.097 lat (msec): min=4, max=311, avg=32.15, stdev=16.22 00:33:02.097 clat percentiles (msec): 00:33:02.097 | 1.00th=[ 17], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 29], 00:33:02.097 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.097 | 70.00th=[ 31], 80.00th=[ 36], 90.00th=[ 40], 95.00th=[ 43], 00:33:02.097 | 99.00th=[ 48], 99.50th=[ 144], 99.90th=[ 313], 99.95th=[ 313], 00:33:02.097 | 99.99th=[ 313] 00:33:02.097 bw ( KiB/s): min= 872, max= 2176, per=4.12%, avg=1963.53, stdev=294.23, samples=19 00:33:02.097 iops : min= 218, max= 544, avg=490.84, stdev=73.55, samples=19 00:33:02.097 lat (msec) : 10=0.24%, 20=2.54%, 50=96.36%, 100=0.22%, 250=0.32% 00:33:02.097 lat (msec) : 500=0.32% 00:33:02.097 cpu : usr=98.87%, sys=0.78%, ctx=26, majf=0, minf=47 00:33:02.097 IO depths : 1=1.2%, 2=3.4%, 4=13.1%, 8=69.0%, 16=13.3%, 32=0.0%, >=64=0.0% 00:33:02.097 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 complete : 0=0.0%, 4=91.8%, 8=4.5%, 16=3.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 issued rwts: total=4967,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.097 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.097 filename2: (groupid=0, jobs=1): err= 0: pid=4172474: Tue May 14 04:30:16 2024 00:33:02.097 read: IOPS=489, BW=1958KiB/s (2005kB/s)(19.1MiB/10013msec) 00:33:02.097 slat (nsec): min=5345, max=95086, avg=13676.07, stdev=12382.82 00:33:02.097 clat (msec): min=12, max=387, avg=32.58, stdev=18.38 00:33:02.097 lat (msec): min=12, max=387, avg=32.60, stdev=18.38 00:33:02.097 clat percentiles (msec): 00:33:02.097 | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.097 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.097 | 70.00th=[ 32], 80.00th=[ 37], 90.00th=[ 41], 95.00th=[ 44], 00:33:02.097 | 99.00th=[ 50], 99.50th=[ 140], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.097 | 99.99th=[ 388] 00:33:02.097 bw ( KiB/s): min= 640, max= 2176, per=4.11%, avg=1959.35, stdev=323.04, samples=20 00:33:02.097 iops : min= 160, max= 544, avg=489.80, stdev=80.76, samples=20 00:33:02.097 lat (msec) : 20=2.43%, 50=96.59%, 100=0.45%, 250=0.20%, 500=0.33% 00:33:02.097 cpu : usr=98.80%, sys=0.86%, ctx=16, majf=0, minf=49 00:33:02.097 IO depths : 1=0.6%, 2=1.2%, 4=8.2%, 8=75.7%, 16=14.3%, 32=0.0%, >=64=0.0% 00:33:02.097 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 complete : 0=0.0%, 4=90.3%, 8=6.4%, 16=3.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 issued rwts: total=4901,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.097 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.097 filename2: (groupid=0, jobs=1): err= 0: pid=4172475: Tue May 14 04:30:16 2024 00:33:02.097 read: IOPS=506, BW=2024KiB/s (2073kB/s)(19.8MiB/10008msec) 00:33:02.097 slat (nsec): min=5534, max=97141, avg=15773.83, stdev=12293.85 00:33:02.097 clat (msec): min=13, max=395, avg=31.47, stdev=20.88 00:33:02.097 lat (msec): min=13, max=395, avg=31.49, stdev=20.88 00:33:02.097 clat percentiles (msec): 00:33:02.097 | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 27], 20.00th=[ 29], 00:33:02.097 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 31], 00:33:02.097 | 70.00th=[ 31], 80.00th=[ 32], 90.00th=[ 39], 95.00th=[ 42], 00:33:02.097 | 99.00th=[ 50], 99.50th=[ 54], 99.90th=[ 388], 99.95th=[ 388], 00:33:02.097 | 99.99th=[ 397] 00:33:02.097 bw ( KiB/s): min= 640, max= 2176, per=4.25%, avg=2025.20, stdev=337.47, samples=20 00:33:02.097 iops : min= 160, max= 544, avg=506.30, stdev=84.37, samples=20 00:33:02.097 lat (msec) : 20=4.01%, 50=95.14%, 100=0.53%, 500=0.32% 00:33:02.097 cpu : usr=96.54%, sys=1.73%, ctx=35, majf=0, minf=59 00:33:02.097 IO depths : 1=3.4%, 2=7.3%, 4=19.0%, 8=60.9%, 16=9.5%, 32=0.0%, >=64=0.0% 00:33:02.097 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 complete : 0=0.0%, 4=92.8%, 8=1.8%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 issued rwts: total=5065,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.097 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.097 filename2: (groupid=0, jobs=1): err= 0: pid=4172476: Tue May 14 04:30:16 2024 00:33:02.097 read: IOPS=481, BW=1928KiB/s (1974kB/s)(18.9MiB/10030msec) 00:33:02.097 slat (nsec): min=5370, max=92066, avg=14756.92, stdev=12813.52 00:33:02.097 clat (msec): min=7, max=288, avg=33.10, stdev=17.23 00:33:02.097 lat (msec): min=7, max=288, avg=33.12, stdev=17.24 00:33:02.097 clat percentiles (msec): 00:33:02.097 | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 29], 00:33:02.097 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 31], 60.00th=[ 32], 00:33:02.097 | 70.00th=[ 36], 80.00th=[ 39], 90.00th=[ 42], 95.00th=[ 45], 00:33:02.097 | 99.00th=[ 56], 99.50th=[ 130], 99.90th=[ 288], 99.95th=[ 288], 00:33:02.097 | 99.99th=[ 288] 00:33:02.097 bw ( KiB/s): min= 608, max= 2224, per=4.05%, avg=1927.20, stdev=324.51, samples=20 00:33:02.097 iops : min= 152, max= 556, avg=481.80, stdev=81.13, samples=20 00:33:02.097 lat (msec) : 10=0.48%, 20=4.20%, 50=93.55%, 100=1.12%, 250=0.33% 00:33:02.097 lat (msec) : 500=0.33% 00:33:02.097 cpu : usr=99.02%, sys=0.64%, ctx=18, majf=0, minf=56 00:33:02.097 IO depths : 1=0.7%, 2=1.5%, 4=9.9%, 8=74.5%, 16=13.4%, 32=0.0%, >=64=0.0% 00:33:02.097 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 complete : 0=0.0%, 4=90.5%, 8=5.5%, 16=4.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:02.097 issued rwts: total=4834,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:02.097 latency : target=0, window=0, percentile=100.00%, depth=16 00:33:02.097 00:33:02.097 Run status group 0 (all jobs): 00:33:02.097 READ: bw=46.5MiB/s (48.8MB/s), 1897KiB/s-2171KiB/s (1942kB/s-2223kB/s), io=466MiB (489MB), run=10004-10030msec 00:33:02.359 04:30:16 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:33:02.359 04:30:16 -- target/dif.sh@43 -- # local sub 00:33:02.359 04:30:16 -- target/dif.sh@45 -- # for sub in "$@" 00:33:02.359 04:30:16 -- target/dif.sh@46 -- # destroy_subsystem 0 00:33:02.359 04:30:16 -- target/dif.sh@36 -- # local sub_id=0 00:33:02.359 04:30:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@45 -- # for sub in "$@" 00:33:02.359 04:30:16 -- target/dif.sh@46 -- # destroy_subsystem 1 00:33:02.359 04:30:16 -- target/dif.sh@36 -- # local sub_id=1 00:33:02.359 04:30:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@45 -- # for sub in "$@" 00:33:02.359 04:30:16 -- target/dif.sh@46 -- # destroy_subsystem 2 00:33:02.359 04:30:16 -- target/dif.sh@36 -- # local sub_id=2 00:33:02.359 04:30:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@115 -- # NULL_DIF=1 00:33:02.359 04:30:16 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:33:02.359 04:30:16 -- target/dif.sh@115 -- # numjobs=2 00:33:02.359 04:30:16 -- target/dif.sh@115 -- # iodepth=8 00:33:02.359 04:30:16 -- target/dif.sh@115 -- # runtime=5 00:33:02.359 04:30:16 -- target/dif.sh@115 -- # files=1 00:33:02.359 04:30:16 -- target/dif.sh@117 -- # create_subsystems 0 1 00:33:02.359 04:30:16 -- target/dif.sh@28 -- # local sub 00:33:02.359 04:30:16 -- target/dif.sh@30 -- # for sub in "$@" 00:33:02.359 04:30:16 -- target/dif.sh@31 -- # create_subsystem 0 00:33:02.359 04:30:16 -- target/dif.sh@18 -- # local sub_id=0 00:33:02.359 04:30:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 bdev_null0 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 [2024-05-14 04:30:16.847995] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@30 -- # for sub in "$@" 00:33:02.359 04:30:16 -- target/dif.sh@31 -- # create_subsystem 1 00:33:02.359 04:30:16 -- target/dif.sh@18 -- # local sub_id=1 00:33:02.359 04:30:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 bdev_null1 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:33:02.359 04:30:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:02.359 04:30:16 -- common/autotest_common.sh@10 -- # set +x 00:33:02.359 04:30:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:02.359 04:30:16 -- target/dif.sh@118 -- # fio /dev/fd/62 00:33:02.359 04:30:16 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:33:02.359 04:30:16 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:33:02.359 04:30:16 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:02.359 04:30:16 -- nvmf/common.sh@520 -- # config=() 00:33:02.359 04:30:16 -- nvmf/common.sh@520 -- # local subsystem config 00:33:02.359 04:30:16 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:02.359 04:30:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:02.359 04:30:16 -- target/dif.sh@82 -- # gen_fio_conf 00:33:02.359 04:30:16 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:33:02.359 04:30:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:02.359 { 00:33:02.359 "params": { 00:33:02.359 "name": "Nvme$subsystem", 00:33:02.359 "trtype": "$TEST_TRANSPORT", 00:33:02.359 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:02.359 "adrfam": "ipv4", 00:33:02.359 "trsvcid": "$NVMF_PORT", 00:33:02.359 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:02.359 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:02.359 "hdgst": ${hdgst:-false}, 00:33:02.359 "ddgst": ${ddgst:-false} 00:33:02.359 }, 00:33:02.359 "method": "bdev_nvme_attach_controller" 00:33:02.359 } 00:33:02.359 EOF 00:33:02.359 )") 00:33:02.359 04:30:16 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:33:02.359 04:30:16 -- target/dif.sh@54 -- # local file 00:33:02.359 04:30:16 -- common/autotest_common.sh@1318 -- # local sanitizers 00:33:02.359 04:30:16 -- target/dif.sh@56 -- # cat 00:33:02.359 04:30:16 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:02.359 04:30:16 -- common/autotest_common.sh@1320 -- # shift 00:33:02.359 04:30:16 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:33:02.360 04:30:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:33:02.360 04:30:16 -- nvmf/common.sh@542 -- # cat 00:33:02.360 04:30:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:02.360 04:30:16 -- target/dif.sh@72 -- # (( file = 1 )) 00:33:02.360 04:30:16 -- common/autotest_common.sh@1324 -- # grep libasan 00:33:02.360 04:30:16 -- target/dif.sh@72 -- # (( file <= files )) 00:33:02.360 04:30:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:33:02.360 04:30:16 -- target/dif.sh@73 -- # cat 00:33:02.360 04:30:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:02.360 04:30:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:02.360 { 00:33:02.360 "params": { 00:33:02.360 "name": "Nvme$subsystem", 00:33:02.360 "trtype": "$TEST_TRANSPORT", 00:33:02.360 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:02.360 "adrfam": "ipv4", 00:33:02.360 "trsvcid": "$NVMF_PORT", 00:33:02.360 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:02.360 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:02.360 "hdgst": ${hdgst:-false}, 00:33:02.360 "ddgst": ${ddgst:-false} 00:33:02.360 }, 00:33:02.360 "method": "bdev_nvme_attach_controller" 00:33:02.360 } 00:33:02.360 EOF 00:33:02.360 )") 00:33:02.360 04:30:16 -- target/dif.sh@72 -- # (( file++ )) 00:33:02.360 04:30:16 -- target/dif.sh@72 -- # (( file <= files )) 00:33:02.360 04:30:16 -- nvmf/common.sh@542 -- # cat 00:33:02.360 04:30:16 -- nvmf/common.sh@544 -- # jq . 00:33:02.360 04:30:16 -- nvmf/common.sh@545 -- # IFS=, 00:33:02.360 04:30:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:33:02.360 "params": { 00:33:02.360 "name": "Nvme0", 00:33:02.360 "trtype": "tcp", 00:33:02.360 "traddr": "10.0.0.2", 00:33:02.360 "adrfam": "ipv4", 00:33:02.360 "trsvcid": "4420", 00:33:02.360 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:33:02.360 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:33:02.360 "hdgst": false, 00:33:02.360 "ddgst": false 00:33:02.360 }, 00:33:02.360 "method": "bdev_nvme_attach_controller" 00:33:02.360 },{ 00:33:02.360 "params": { 00:33:02.360 "name": "Nvme1", 00:33:02.360 "trtype": "tcp", 00:33:02.360 "traddr": "10.0.0.2", 00:33:02.360 "adrfam": "ipv4", 00:33:02.360 "trsvcid": "4420", 00:33:02.360 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:33:02.360 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:33:02.360 "hdgst": false, 00:33:02.360 "ddgst": false 00:33:02.360 }, 00:33:02.360 "method": "bdev_nvme_attach_controller" 00:33:02.360 }' 00:33:02.360 04:30:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:33:02.360 04:30:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:33:02.360 04:30:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:33:02.360 04:30:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:02.360 04:30:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:33:02.360 04:30:16 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:33:02.652 04:30:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:33:02.652 04:30:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:33:02.652 04:30:16 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:33:02.652 04:30:16 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:02.917 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:33:02.917 ... 00:33:02.917 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:33:02.917 ... 00:33:02.917 fio-3.35 00:33:02.917 Starting 4 threads 00:33:02.917 EAL: No free 2048 kB hugepages reported on node 1 00:33:03.178 [2024-05-14 04:30:17.744050] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:33:03.178 [2024-05-14 04:30:17.744100] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:33:08.472 00:33:08.472 filename0: (groupid=0, jobs=1): err= 0: pid=4175142: Tue May 14 04:30:22 2024 00:33:08.472 read: IOPS=2559, BW=20.0MiB/s (21.0MB/s)(100MiB/5003msec) 00:33:08.472 slat (nsec): min=5333, max=53905, avg=6330.53, stdev=1865.59 00:33:08.472 clat (usec): min=691, max=5687, avg=3107.16, stdev=585.75 00:33:08.472 lat (usec): min=698, max=5693, avg=3113.50, stdev=585.63 00:33:08.472 clat percentiles (usec): 00:33:08.472 | 1.00th=[ 1844], 5.00th=[ 2245], 10.00th=[ 2409], 20.00th=[ 2671], 00:33:08.472 | 30.00th=[ 2802], 40.00th=[ 2966], 50.00th=[ 3064], 60.00th=[ 3195], 00:33:08.472 | 70.00th=[ 3326], 80.00th=[ 3490], 90.00th=[ 3851], 95.00th=[ 4228], 00:33:08.472 | 99.00th=[ 4752], 99.50th=[ 4948], 99.90th=[ 5276], 99.95th=[ 5407], 00:33:08.472 | 99.99th=[ 5669] 00:33:08.472 bw ( KiB/s): min=20160, max=20752, per=30.11%, avg=20467.56, stdev=204.87, samples=9 00:33:08.472 iops : min= 2520, max= 2594, avg=2558.44, stdev=25.61, samples=9 00:33:08.472 lat (usec) : 750=0.01%, 1000=0.01% 00:33:08.472 lat (msec) : 2=1.69%, 4=90.37%, 10=7.92% 00:33:08.472 cpu : usr=96.92%, sys=2.78%, ctx=13, majf=0, minf=129 00:33:08.472 IO depths : 1=0.2%, 2=1.2%, 4=70.2%, 8=28.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:08.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:08.472 complete : 0=0.0%, 4=93.2%, 8=6.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:08.472 issued rwts: total=12807,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:08.472 latency : target=0, window=0, percentile=100.00%, depth=8 00:33:08.472 filename0: (groupid=0, jobs=1): err= 0: pid=4175143: Tue May 14 04:30:22 2024 00:33:08.472 read: IOPS=2023, BW=15.8MiB/s (16.6MB/s)(79.1MiB/5002msec) 00:33:08.472 slat (nsec): min=5331, max=55045, avg=7377.80, stdev=2759.78 00:33:08.472 clat (usec): min=2050, max=7309, avg=3934.00, stdev=606.88 00:33:08.472 lat (usec): min=2055, max=7349, avg=3941.38, stdev=606.88 00:33:08.472 clat percentiles (usec): 00:33:08.472 | 1.00th=[ 2671], 5.00th=[ 2999], 10.00th=[ 3195], 20.00th=[ 3458], 00:33:08.472 | 30.00th=[ 3621], 40.00th=[ 3752], 50.00th=[ 3916], 60.00th=[ 4047], 00:33:08.472 | 70.00th=[ 4178], 80.00th=[ 4359], 90.00th=[ 4686], 95.00th=[ 5014], 00:33:08.472 | 99.00th=[ 5604], 99.50th=[ 5800], 99.90th=[ 6587], 99.95th=[ 6718], 00:33:08.472 | 99.99th=[ 7242] 00:33:08.472 bw ( KiB/s): min=15840, max=16544, per=23.89%, avg=16236.44, stdev=217.30, samples=9 00:33:08.472 iops : min= 1980, max= 2068, avg=2029.56, stdev=27.16, samples=9 00:33:08.472 lat (msec) : 4=56.60%, 10=43.40% 00:33:08.472 cpu : usr=97.16%, sys=2.54%, ctx=11, majf=0, minf=53 00:33:08.472 IO depths : 1=0.1%, 2=0.8%, 4=66.9%, 8=32.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:08.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:08.472 complete : 0=0.0%, 4=95.7%, 8=4.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:08.472 issued rwts: total=10124,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:08.472 latency : target=0, window=0, percentile=100.00%, depth=8 00:33:08.472 filename1: (groupid=0, jobs=1): err= 0: pid=4175144: Tue May 14 04:30:22 2024 00:33:08.472 read: IOPS=1913, BW=15.0MiB/s (15.7MB/s)(74.8MiB/5002msec) 00:33:08.472 slat (nsec): min=7779, max=77384, avg=8895.56, stdev=2714.22 00:33:08.472 clat (usec): min=2261, max=45664, avg=4156.85, stdev=1346.12 00:33:08.472 lat (usec): min=2269, max=45699, avg=4165.74, stdev=1346.30 00:33:08.472 clat percentiles (usec): 00:33:08.472 | 1.00th=[ 2835], 5.00th=[ 3163], 10.00th=[ 3392], 20.00th=[ 3654], 00:33:08.472 | 30.00th=[ 3818], 40.00th=[ 3982], 50.00th=[ 4080], 60.00th=[ 4228], 00:33:08.472 | 70.00th=[ 4359], 80.00th=[ 4555], 90.00th=[ 4948], 95.00th=[ 5211], 00:33:08.472 | 99.00th=[ 5800], 99.50th=[ 6194], 99.90th=[ 6980], 99.95th=[45351], 00:33:08.472 | 99.99th=[45876] 00:33:08.472 bw ( KiB/s): min=14288, max=15904, per=22.50%, avg=15292.44, stdev=469.33, samples=9 00:33:08.472 iops : min= 1786, max= 1988, avg=1911.56, stdev=58.67, samples=9 00:33:08.472 lat (msec) : 4=41.81%, 10=58.11%, 50=0.08% 00:33:08.472 cpu : usr=97.46%, sys=2.22%, ctx=10, majf=0, minf=81 00:33:08.472 IO depths : 1=0.1%, 2=0.9%, 4=67.5%, 8=31.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:08.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:08.472 complete : 0=0.0%, 4=95.1%, 8=4.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:08.472 issued rwts: total=9573,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:08.472 latency : target=0, window=0, percentile=100.00%, depth=8 00:33:08.472 filename1: (groupid=0, jobs=1): err= 0: pid=4175145: Tue May 14 04:30:22 2024 00:33:08.472 read: IOPS=1999, BW=15.6MiB/s (16.4MB/s)(78.2MiB/5003msec) 00:33:08.472 slat (nsec): min=5338, max=77011, avg=8363.41, stdev=3027.96 00:33:08.472 clat (usec): min=2149, max=8178, avg=3979.85, stdev=618.65 00:33:08.472 lat (usec): min=2157, max=8210, avg=3988.21, stdev=618.61 00:33:08.472 clat percentiles (usec): 00:33:08.472 | 1.00th=[ 2737], 5.00th=[ 2999], 10.00th=[ 3228], 20.00th=[ 3490], 00:33:08.472 | 30.00th=[ 3687], 40.00th=[ 3785], 50.00th=[ 3982], 60.00th=[ 4080], 00:33:08.472 | 70.00th=[ 4228], 80.00th=[ 4424], 90.00th=[ 4817], 95.00th=[ 5080], 00:33:08.472 | 99.00th=[ 5669], 99.50th=[ 5932], 99.90th=[ 6587], 99.95th=[ 6849], 00:33:08.472 | 99.99th=[ 6915] 00:33:08.472 bw ( KiB/s): min=15775, max=16192, per=23.54%, avg=16001.50, stdev=122.16, samples=10 00:33:08.472 iops : min= 1971, max= 2024, avg=2000.10, stdev=15.45, samples=10 00:33:08.472 lat (msec) : 4=52.62%, 10=47.38% 00:33:08.472 cpu : usr=96.40%, sys=2.64%, ctx=220, majf=0, minf=122 00:33:08.472 IO depths : 1=0.2%, 2=0.9%, 4=66.7%, 8=32.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:08.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:08.472 complete : 0=0.0%, 4=95.9%, 8=4.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:08.472 issued rwts: total=10004,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:08.472 latency : target=0, window=0, percentile=100.00%, depth=8 00:33:08.472 00:33:08.472 Run status group 0 (all jobs): 00:33:08.472 READ: bw=66.4MiB/s (69.6MB/s), 15.0MiB/s-20.0MiB/s (15.7MB/s-21.0MB/s), io=332MiB (348MB), run=5002-5003msec 00:33:08.472 04:30:23 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:33:08.472 04:30:23 -- target/dif.sh@43 -- # local sub 00:33:08.472 04:30:23 -- target/dif.sh@45 -- # for sub in "$@" 00:33:08.472 04:30:23 -- target/dif.sh@46 -- # destroy_subsystem 0 00:33:08.472 04:30:23 -- target/dif.sh@36 -- # local sub_id=0 00:33:08.472 04:30:23 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:33:08.472 04:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:08.472 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.472 04:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:08.472 04:30:23 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:33:08.472 04:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:08.472 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.472 04:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:08.472 04:30:23 -- target/dif.sh@45 -- # for sub in "$@" 00:33:08.472 04:30:23 -- target/dif.sh@46 -- # destroy_subsystem 1 00:33:08.472 04:30:23 -- target/dif.sh@36 -- # local sub_id=1 00:33:08.472 04:30:23 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:33:08.472 04:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:08.472 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.472 04:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:08.472 04:30:23 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:33:08.472 04:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:08.472 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.472 04:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:08.472 00:33:08.472 real 0m24.444s 00:33:08.472 user 5m19.967s 00:33:08.472 sys 0m3.911s 00:33:08.472 04:30:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:08.472 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.472 ************************************ 00:33:08.472 END TEST fio_dif_rand_params 00:33:08.472 ************************************ 00:33:08.734 04:30:23 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:33:08.734 04:30:23 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:33:08.734 04:30:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:33:08.734 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.734 ************************************ 00:33:08.734 START TEST fio_dif_digest 00:33:08.734 ************************************ 00:33:08.734 04:30:23 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:33:08.734 04:30:23 -- target/dif.sh@123 -- # local NULL_DIF 00:33:08.734 04:30:23 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:33:08.734 04:30:23 -- target/dif.sh@125 -- # local hdgst ddgst 00:33:08.734 04:30:23 -- target/dif.sh@127 -- # NULL_DIF=3 00:33:08.734 04:30:23 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:33:08.734 04:30:23 -- target/dif.sh@127 -- # numjobs=3 00:33:08.734 04:30:23 -- target/dif.sh@127 -- # iodepth=3 00:33:08.734 04:30:23 -- target/dif.sh@127 -- # runtime=10 00:33:08.734 04:30:23 -- target/dif.sh@128 -- # hdgst=true 00:33:08.734 04:30:23 -- target/dif.sh@128 -- # ddgst=true 00:33:08.734 04:30:23 -- target/dif.sh@130 -- # create_subsystems 0 00:33:08.734 04:30:23 -- target/dif.sh@28 -- # local sub 00:33:08.734 04:30:23 -- target/dif.sh@30 -- # for sub in "$@" 00:33:08.734 04:30:23 -- target/dif.sh@31 -- # create_subsystem 0 00:33:08.734 04:30:23 -- target/dif.sh@18 -- # local sub_id=0 00:33:08.734 04:30:23 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:33:08.734 04:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:08.734 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.734 bdev_null0 00:33:08.734 04:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:08.734 04:30:23 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:33:08.734 04:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:08.734 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.734 04:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:08.734 04:30:23 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:33:08.734 04:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:08.734 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.734 04:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:08.734 04:30:23 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:33:08.734 04:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:08.734 04:30:23 -- common/autotest_common.sh@10 -- # set +x 00:33:08.734 [2024-05-14 04:30:23.154118] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:08.734 04:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:08.734 04:30:23 -- target/dif.sh@131 -- # fio /dev/fd/62 00:33:08.734 04:30:23 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:33:08.734 04:30:23 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:33:08.734 04:30:23 -- nvmf/common.sh@520 -- # config=() 00:33:08.734 04:30:23 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:08.734 04:30:23 -- nvmf/common.sh@520 -- # local subsystem config 00:33:08.735 04:30:23 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:08.735 04:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:33:08.735 04:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:33:08.735 { 00:33:08.735 "params": { 00:33:08.735 "name": "Nvme$subsystem", 00:33:08.735 "trtype": "$TEST_TRANSPORT", 00:33:08.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:08.735 "adrfam": "ipv4", 00:33:08.735 "trsvcid": "$NVMF_PORT", 00:33:08.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:08.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:08.735 "hdgst": ${hdgst:-false}, 00:33:08.735 "ddgst": ${ddgst:-false} 00:33:08.735 }, 00:33:08.735 "method": "bdev_nvme_attach_controller" 00:33:08.735 } 00:33:08.735 EOF 00:33:08.735 )") 00:33:08.735 04:30:23 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:33:08.735 04:30:23 -- target/dif.sh@82 -- # gen_fio_conf 00:33:08.735 04:30:23 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:33:08.735 04:30:23 -- target/dif.sh@54 -- # local file 00:33:08.735 04:30:23 -- common/autotest_common.sh@1318 -- # local sanitizers 00:33:08.735 04:30:23 -- target/dif.sh@56 -- # cat 00:33:08.735 04:30:23 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:08.735 04:30:23 -- common/autotest_common.sh@1320 -- # shift 00:33:08.735 04:30:23 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:33:08.735 04:30:23 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:33:08.735 04:30:23 -- nvmf/common.sh@542 -- # cat 00:33:08.735 04:30:23 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:08.735 04:30:23 -- target/dif.sh@72 -- # (( file = 1 )) 00:33:08.735 04:30:23 -- common/autotest_common.sh@1324 -- # grep libasan 00:33:08.735 04:30:23 -- target/dif.sh@72 -- # (( file <= files )) 00:33:08.735 04:30:23 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:33:08.735 04:30:23 -- nvmf/common.sh@544 -- # jq . 00:33:08.735 04:30:23 -- nvmf/common.sh@545 -- # IFS=, 00:33:08.735 04:30:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:33:08.735 "params": { 00:33:08.735 "name": "Nvme0", 00:33:08.735 "trtype": "tcp", 00:33:08.735 "traddr": "10.0.0.2", 00:33:08.735 "adrfam": "ipv4", 00:33:08.735 "trsvcid": "4420", 00:33:08.735 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:33:08.735 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:33:08.735 "hdgst": true, 00:33:08.735 "ddgst": true 00:33:08.735 }, 00:33:08.735 "method": "bdev_nvme_attach_controller" 00:33:08.735 }' 00:33:08.735 04:30:23 -- common/autotest_common.sh@1324 -- # asan_lib= 00:33:08.735 04:30:23 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:33:08.735 04:30:23 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:33:08.735 04:30:23 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:33:08.735 04:30:23 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:33:08.735 04:30:23 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:33:08.735 04:30:23 -- common/autotest_common.sh@1324 -- # asan_lib= 00:33:08.735 04:30:23 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:33:08.735 04:30:23 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:33:08.735 04:30:23 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:33:08.994 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:33:08.994 ... 00:33:08.994 fio-3.35 00:33:08.994 Starting 3 threads 00:33:09.253 EAL: No free 2048 kB hugepages reported on node 1 00:33:09.512 [2024-05-14 04:30:24.030301] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:33:09.512 [2024-05-14 04:30:24.030350] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:33:21.792 00:33:21.792 filename0: (groupid=0, jobs=1): err= 0: pid=4176676: Tue May 14 04:30:34 2024 00:33:21.792 read: IOPS=118, BW=14.9MiB/s (15.6MB/s)(149MiB/10007msec) 00:33:21.792 slat (nsec): min=5747, max=43672, avg=8441.12, stdev=1655.46 00:33:21.792 clat (msec): min=7, max=100, avg=25.23, stdev=20.67 00:33:21.792 lat (msec): min=7, max=100, avg=25.24, stdev=20.67 00:33:21.792 clat percentiles (msec): 00:33:21.792 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], 00:33:21.792 | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 15], 60.00th=[ 16], 00:33:21.792 | 70.00th=[ 18], 80.00th=[ 54], 90.00th=[ 56], 95.00th=[ 57], 00:33:21.792 | 99.00th=[ 96], 99.50th=[ 97], 99.90th=[ 100], 99.95th=[ 101], 00:33:21.792 | 99.99th=[ 101] 00:33:21.792 bw ( KiB/s): min= 9984, max=21248, per=33.11%, avg=15193.60, stdev=2787.41, samples=20 00:33:21.792 iops : min= 78, max= 166, avg=118.70, stdev=21.78, samples=20 00:33:21.792 lat (msec) : 10=8.49%, 20=63.92%, 50=0.42%, 100=27.08%, 250=0.08% 00:33:21.792 cpu : usr=96.49%, sys=2.81%, ctx=18, majf=0, minf=161 00:33:21.792 IO depths : 1=1.2%, 2=98.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:21.792 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:21.792 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:21.792 issued rwts: total=1189,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:21.792 latency : target=0, window=0, percentile=100.00%, depth=3 00:33:21.792 filename0: (groupid=0, jobs=1): err= 0: pid=4176677: Tue May 14 04:30:34 2024 00:33:21.792 read: IOPS=120, BW=15.1MiB/s (15.8MB/s)(152MiB/10051msec) 00:33:21.792 slat (nsec): min=5612, max=29761, avg=7707.23, stdev=1715.13 00:33:21.792 clat (usec): min=7925, max=97954, avg=24763.75, stdev=19703.31 00:33:21.792 lat (usec): min=7931, max=97960, avg=24771.46, stdev=19703.35 00:33:21.792 clat percentiles (usec): 00:33:21.792 | 1.00th=[ 8979], 5.00th=[10159], 10.00th=[10814], 20.00th=[11863], 00:33:21.792 | 30.00th=[12780], 40.00th=[13566], 50.00th=[14353], 60.00th=[15270], 00:33:21.792 | 70.00th=[16909], 80.00th=[53740], 90.00th=[55837], 95.00th=[56886], 00:33:21.792 | 99.00th=[94897], 99.50th=[95945], 99.90th=[98042], 99.95th=[98042], 00:33:21.792 | 99.99th=[98042] 00:33:21.792 bw ( KiB/s): min=11520, max=20224, per=33.84%, avg=15526.40, stdev=2450.23, samples=20 00:33:21.792 iops : min= 90, max= 158, avg=121.30, stdev=19.14, samples=20 00:33:21.792 lat (msec) : 10=4.28%, 20=69.22%, 50=0.25%, 100=26.26% 00:33:21.792 cpu : usr=96.64%, sys=3.07%, ctx=22, majf=0, minf=167 00:33:21.792 IO depths : 1=4.1%, 2=95.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:21.792 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:21.792 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:21.792 issued rwts: total=1215,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:21.792 latency : target=0, window=0, percentile=100.00%, depth=3 00:33:21.792 filename0: (groupid=0, jobs=1): err= 0: pid=4176678: Tue May 14 04:30:34 2024 00:33:21.792 read: IOPS=119, BW=14.9MiB/s (15.6MB/s)(150MiB/10049msec) 00:33:21.792 slat (nsec): min=5562, max=30712, avg=8459.94, stdev=1521.15 00:33:21.792 clat (usec): min=7325, max=98688, avg=25093.32, stdev=20758.85 00:33:21.792 lat (usec): min=7333, max=98697, avg=25101.78, stdev=20758.85 00:33:21.792 clat percentiles (usec): 00:33:21.792 | 1.00th=[ 8455], 5.00th=[ 9372], 10.00th=[10028], 20.00th=[11207], 00:33:21.792 | 30.00th=[12387], 40.00th=[13304], 50.00th=[14222], 60.00th=[15401], 00:33:21.792 | 70.00th=[17433], 80.00th=[53740], 90.00th=[55837], 95.00th=[56886], 00:33:21.792 | 99.00th=[95945], 99.50th=[96994], 99.90th=[98042], 99.95th=[99091], 00:33:21.792 | 99.99th=[99091] 00:33:21.792 bw ( KiB/s): min=11776, max=22016, per=33.36%, avg=15308.80, stdev=3163.38, samples=20 00:33:21.792 iops : min= 92, max= 172, avg=119.60, stdev=24.71, samples=20 00:33:21.792 lat (msec) : 10=9.76%, 20=62.89%, 50=0.50%, 100=26.86% 00:33:21.792 cpu : usr=97.26%, sys=2.48%, ctx=16, majf=0, minf=198 00:33:21.792 IO depths : 1=0.8%, 2=99.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:33:21.792 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:21.792 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:33:21.792 issued rwts: total=1199,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:33:21.792 latency : target=0, window=0, percentile=100.00%, depth=3 00:33:21.792 00:33:21.792 Run status group 0 (all jobs): 00:33:21.792 READ: bw=44.8MiB/s (47.0MB/s), 14.9MiB/s-15.1MiB/s (15.6MB/s-15.8MB/s), io=450MiB (472MB), run=10007-10051msec 00:33:21.792 04:30:34 -- target/dif.sh@132 -- # destroy_subsystems 0 00:33:21.792 04:30:34 -- target/dif.sh@43 -- # local sub 00:33:21.792 04:30:34 -- target/dif.sh@45 -- # for sub in "$@" 00:33:21.792 04:30:34 -- target/dif.sh@46 -- # destroy_subsystem 0 00:33:21.792 04:30:34 -- target/dif.sh@36 -- # local sub_id=0 00:33:21.792 04:30:34 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:33:21.792 04:30:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:21.792 04:30:34 -- common/autotest_common.sh@10 -- # set +x 00:33:21.792 04:30:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:21.792 04:30:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:33:21.792 04:30:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:21.792 04:30:34 -- common/autotest_common.sh@10 -- # set +x 00:33:21.792 04:30:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:21.792 00:33:21.792 real 0m11.242s 00:33:21.792 user 0m45.666s 00:33:21.792 sys 0m1.141s 00:33:21.792 04:30:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:21.793 04:30:34 -- common/autotest_common.sh@10 -- # set +x 00:33:21.793 ************************************ 00:33:21.793 END TEST fio_dif_digest 00:33:21.793 ************************************ 00:33:21.793 04:30:34 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:33:21.793 04:30:34 -- target/dif.sh@147 -- # nvmftestfini 00:33:21.793 04:30:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:21.793 04:30:34 -- nvmf/common.sh@116 -- # sync 00:33:21.793 04:30:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:21.793 04:30:34 -- nvmf/common.sh@119 -- # set +e 00:33:21.793 04:30:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:21.793 04:30:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:21.793 rmmod nvme_tcp 00:33:21.793 rmmod nvme_fabrics 00:33:21.793 rmmod nvme_keyring 00:33:21.793 04:30:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:21.793 04:30:34 -- nvmf/common.sh@123 -- # set -e 00:33:21.793 04:30:34 -- nvmf/common.sh@124 -- # return 0 00:33:21.793 04:30:34 -- nvmf/common.sh@477 -- # '[' -n 4165567 ']' 00:33:21.793 04:30:34 -- nvmf/common.sh@478 -- # killprocess 4165567 00:33:21.793 04:30:34 -- common/autotest_common.sh@926 -- # '[' -z 4165567 ']' 00:33:21.793 04:30:34 -- common/autotest_common.sh@930 -- # kill -0 4165567 00:33:21.793 04:30:34 -- common/autotest_common.sh@931 -- # uname 00:33:21.793 04:30:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:33:21.793 04:30:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4165567 00:33:21.793 04:30:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:33:21.793 04:30:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:33:21.793 04:30:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4165567' 00:33:21.793 killing process with pid 4165567 00:33:21.793 04:30:34 -- common/autotest_common.sh@945 -- # kill 4165567 00:33:21.793 04:30:34 -- common/autotest_common.sh@950 -- # wait 4165567 00:33:21.793 04:30:34 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:21.793 04:30:34 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:23.711 Waiting for block devices as requested 00:33:23.711 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:33:23.711 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:33:23.711 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:33:23.711 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:33:23.711 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:33:23.711 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:33:23.973 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:33:23.973 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:33:23.973 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:33:24.234 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:33:24.234 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:33:24.496 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:33:24.496 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:33:24.496 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:33:24.496 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:33:24.756 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:33:24.756 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:33:25.017 04:30:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:25.017 04:30:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:25.017 04:30:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:25.017 04:30:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:25.017 04:30:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:25.017 04:30:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:25.017 04:30:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:27.562 04:30:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:27.562 00:33:27.562 real 1m17.312s 00:33:27.562 user 8m7.362s 00:33:27.562 sys 0m18.763s 00:33:27.562 04:30:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:27.562 04:30:41 -- common/autotest_common.sh@10 -- # set +x 00:33:27.562 ************************************ 00:33:27.562 END TEST nvmf_dif 00:33:27.562 ************************************ 00:33:27.562 04:30:41 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:33:27.562 04:30:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:33:27.562 04:30:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:33:27.562 04:30:41 -- common/autotest_common.sh@10 -- # set +x 00:33:27.562 ************************************ 00:33:27.562 START TEST nvmf_abort_qd_sizes 00:33:27.562 ************************************ 00:33:27.562 04:30:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:33:27.562 * Looking for test storage... 00:33:27.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:33:27.562 04:30:41 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:33:27.562 04:30:41 -- nvmf/common.sh@7 -- # uname -s 00:33:27.562 04:30:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:33:27.562 04:30:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:33:27.562 04:30:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:33:27.562 04:30:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:33:27.562 04:30:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:33:27.562 04:30:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:33:27.562 04:30:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:33:27.562 04:30:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:33:27.562 04:30:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:33:27.562 04:30:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:33:27.562 04:30:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:33:27.562 04:30:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:33:27.562 04:30:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:33:27.562 04:30:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:33:27.562 04:30:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:33:27.562 04:30:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:27.562 04:30:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:33:27.562 04:30:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:27.562 04:30:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:27.562 04:30:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:27.562 04:30:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:27.562 04:30:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:27.562 04:30:41 -- paths/export.sh@5 -- # export PATH 00:33:27.562 04:30:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:27.562 04:30:41 -- nvmf/common.sh@46 -- # : 0 00:33:27.562 04:30:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:33:27.562 04:30:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:33:27.562 04:30:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:33:27.562 04:30:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:33:27.562 04:30:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:33:27.562 04:30:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:33:27.562 04:30:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:33:27.562 04:30:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:33:27.562 04:30:41 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:33:27.562 04:30:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:33:27.562 04:30:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:33:27.562 04:30:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:33:27.562 04:30:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:33:27.562 04:30:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:33:27.562 04:30:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:27.562 04:30:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:27.562 04:30:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:27.562 04:30:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:33:27.562 04:30:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:33:27.562 04:30:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:33:27.562 04:30:41 -- common/autotest_common.sh@10 -- # set +x 00:33:34.145 04:30:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:33:34.145 04:30:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:33:34.145 04:30:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:33:34.145 04:30:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:33:34.145 04:30:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:33:34.145 04:30:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:33:34.145 04:30:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:33:34.145 04:30:48 -- nvmf/common.sh@294 -- # net_devs=() 00:33:34.145 04:30:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:33:34.145 04:30:48 -- nvmf/common.sh@295 -- # e810=() 00:33:34.145 04:30:48 -- nvmf/common.sh@295 -- # local -ga e810 00:33:34.145 04:30:48 -- nvmf/common.sh@296 -- # x722=() 00:33:34.145 04:30:48 -- nvmf/common.sh@296 -- # local -ga x722 00:33:34.145 04:30:48 -- nvmf/common.sh@297 -- # mlx=() 00:33:34.145 04:30:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:33:34.145 04:30:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:33:34.145 04:30:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:33:34.145 04:30:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:33:34.145 04:30:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:33:34.145 04:30:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:33:34.145 04:30:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:33:34.145 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:33:34.145 04:30:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:33:34.145 04:30:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:33:34.145 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:33:34.145 04:30:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:33:34.145 04:30:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:33:34.145 04:30:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:34.145 04:30:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:33:34.145 04:30:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:34.145 04:30:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:33:34.145 Found net devices under 0000:4b:00.0: cvl_0_0 00:33:34.145 04:30:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:33:34.145 04:30:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:33:34.145 04:30:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:34.145 04:30:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:33:34.145 04:30:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:34.145 04:30:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:33:34.145 Found net devices under 0000:4b:00.1: cvl_0_1 00:33:34.145 04:30:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:33:34.145 04:30:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:33:34.145 04:30:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:33:34.145 04:30:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:33:34.145 04:30:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:33:34.145 04:30:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:33:34.145 04:30:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:33:34.145 04:30:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:33:34.145 04:30:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:33:34.145 04:30:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:33:34.145 04:30:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:33:34.145 04:30:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:33:34.145 04:30:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:33:34.145 04:30:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:33:34.145 04:30:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:33:34.145 04:30:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:33:34.145 04:30:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:33:34.145 04:30:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:33:34.145 04:30:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:33:34.145 04:30:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:33:34.145 04:30:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:33:34.145 04:30:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:33:34.145 04:30:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:33:34.145 04:30:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:33:34.145 04:30:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:33:34.145 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:33:34.145 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.682 ms 00:33:34.145 00:33:34.145 --- 10.0.0.2 ping statistics --- 00:33:34.145 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:33:34.145 rtt min/avg/max/mdev = 0.682/0.682/0.682/0.000 ms 00:33:34.145 04:30:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:33:34.145 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:33:34.145 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.338 ms 00:33:34.145 00:33:34.145 --- 10.0.0.1 ping statistics --- 00:33:34.145 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:33:34.145 rtt min/avg/max/mdev = 0.338/0.338/0.338/0.000 ms 00:33:34.145 04:30:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:33:34.145 04:30:48 -- nvmf/common.sh@410 -- # return 0 00:33:34.145 04:30:48 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:33:34.145 04:30:48 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:33:37.449 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:33:37.449 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:33:38.023 04:30:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:33:38.023 04:30:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:33:38.023 04:30:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:33:38.023 04:30:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:33:38.023 04:30:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:33:38.023 04:30:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:33:38.023 04:30:52 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:33:38.023 04:30:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:33:38.023 04:30:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:33:38.023 04:30:52 -- common/autotest_common.sh@10 -- # set +x 00:33:38.023 04:30:52 -- nvmf/common.sh@469 -- # nvmfpid=4186049 00:33:38.023 04:30:52 -- nvmf/common.sh@470 -- # waitforlisten 4186049 00:33:38.023 04:30:52 -- common/autotest_common.sh@819 -- # '[' -z 4186049 ']' 00:33:38.023 04:30:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:38.023 04:30:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:33:38.023 04:30:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:33:38.023 04:30:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:38.023 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:38.023 04:30:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:33:38.023 04:30:52 -- common/autotest_common.sh@10 -- # set +x 00:33:38.023 [2024-05-14 04:30:52.436256] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:33:38.023 [2024-05-14 04:30:52.436329] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:38.023 EAL: No free 2048 kB hugepages reported on node 1 00:33:38.023 [2024-05-14 04:30:52.507173] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:38.023 [2024-05-14 04:30:52.582601] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:33:38.023 [2024-05-14 04:30:52.582733] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:38.023 [2024-05-14 04:30:52.582743] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:38.023 [2024-05-14 04:30:52.582751] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:38.023 [2024-05-14 04:30:52.582805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:33:38.023 [2024-05-14 04:30:52.582916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:33:38.023 [2024-05-14 04:30:52.583059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:38.023 [2024-05-14 04:30:52.583060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:33:38.967 04:30:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:33:38.967 04:30:53 -- common/autotest_common.sh@852 -- # return 0 00:33:38.967 04:30:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:33:38.967 04:30:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:33:38.967 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:33:38.967 04:30:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:38.967 04:30:53 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:33:38.967 04:30:53 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:33:38.967 04:30:53 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:33:38.967 04:30:53 -- scripts/common.sh@311 -- # local bdf bdfs 00:33:38.967 04:30:53 -- scripts/common.sh@312 -- # local nvmes 00:33:38.967 04:30:53 -- scripts/common.sh@314 -- # [[ -n 0000:65:00.0 ]] 00:33:38.967 04:30:53 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:33:38.967 04:30:53 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:33:38.967 04:30:53 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:65:00.0 ]] 00:33:38.967 04:30:53 -- scripts/common.sh@322 -- # uname -s 00:33:38.967 04:30:53 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:33:38.967 04:30:53 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:33:38.967 04:30:53 -- scripts/common.sh@327 -- # (( 1 )) 00:33:38.967 04:30:53 -- scripts/common.sh@328 -- # printf '%s\n' 0000:65:00.0 00:33:38.967 04:30:53 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:33:38.967 04:30:53 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:65:00.0 00:33:38.967 04:30:53 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:33:38.967 04:30:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:33:38.967 04:30:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:33:38.967 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:33:38.967 ************************************ 00:33:38.967 START TEST spdk_target_abort 00:33:38.967 ************************************ 00:33:38.967 04:30:53 -- common/autotest_common.sh@1104 -- # spdk_target 00:33:38.967 04:30:53 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:33:38.967 04:30:53 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:33:38.967 04:30:53 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:65:00.0 -b spdk_target 00:33:38.967 04:30:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:38.967 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:33:39.228 spdk_targetn1 00:33:39.228 04:30:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:33:39.228 04:30:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:39.228 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:33:39.228 [2024-05-14 04:30:53.590258] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:33:39.228 04:30:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:33:39.228 04:30:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:39.228 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:33:39.228 04:30:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:33:39.228 04:30:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:39.228 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:33:39.228 04:30:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:33:39.228 04:30:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:39.228 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:33:39.228 [2024-05-14 04:30:53.630525] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:33:39.228 04:30:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@24 -- # local target r 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:39.228 04:30:53 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:39.228 EAL: No free 2048 kB hugepages reported on node 1 00:33:39.228 [2024-05-14 04:30:53.807177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:191 nsid:1 lba:528 len:8 PRP1 0x2000078c4000 PRP2 0x0 00:33:39.228 [2024-05-14 04:30:53.807199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:191 cdw0:0 sqhd:0043 p:1 m:0 dnr:0 00:33:39.228 [2024-05-14 04:30:53.813774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:189 nsid:1 lba:680 len:8 PRP1 0x2000078c4000 PRP2 0x0 00:33:39.228 [2024-05-14 04:30:53.813789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:189 cdw0:0 sqhd:0058 p:1 m:0 dnr:0 00:33:39.488 [2024-05-14 04:30:53.836815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:191 nsid:1 lba:1328 len:8 PRP1 0x2000078be000 PRP2 0x0 00:33:39.488 [2024-05-14 04:30:53.836836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:191 cdw0:0 sqhd:00a8 p:1 m:0 dnr:0 00:33:39.488 [2024-05-14 04:30:53.859741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:188 nsid:1 lba:1952 len:8 PRP1 0x2000078c2000 PRP2 0x0 00:33:39.488 [2024-05-14 04:30:53.859757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:188 cdw0:0 sqhd:00f8 p:1 m:0 dnr:0 00:33:39.488 [2024-05-14 04:30:53.860116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:191 nsid:1 lba:1984 len:8 PRP1 0x2000078c2000 PRP2 0x0 00:33:39.488 [2024-05-14 04:30:53.860127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:191 cdw0:0 sqhd:00f9 p:1 m:0 dnr:0 00:33:39.488 [2024-05-14 04:30:53.865680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:188 nsid:1 lba:2096 len:8 PRP1 0x2000078c2000 PRP2 0x0 00:33:39.488 [2024-05-14 04:30:53.865693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:188 cdw0:0 sqhd:0007 p:0 m:0 dnr:0 00:33:39.488 [2024-05-14 04:30:53.874753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:191 nsid:1 lba:2408 len:8 PRP1 0x2000078c2000 PRP2 0x0 00:33:39.488 [2024-05-14 04:30:53.874768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:191 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:33:39.488 [2024-05-14 04:30:53.899709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:190 nsid:1 lba:3248 len:8 PRP1 0x2000078be000 PRP2 0x0 00:33:39.488 [2024-05-14 04:30:53.899724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:190 cdw0:0 sqhd:0097 p:0 m:0 dnr:0 00:33:39.488 [2024-05-14 04:30:53.906746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:189 nsid:1 lba:3432 len:8 PRP1 0x2000078c0000 PRP2 0x0 00:33:39.488 [2024-05-14 04:30:53.906761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:189 cdw0:0 sqhd:00ae p:0 m:0 dnr:0 00:33:39.488 [2024-05-14 04:30:53.923108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:190 nsid:1 lba:3904 len:8 PRP1 0x2000078c4000 PRP2 0x0 00:33:39.488 [2024-05-14 04:30:53.923123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:190 cdw0:0 sqhd:00e9 p:0 m:0 dnr:0 00:33:42.791 Initializing NVMe Controllers 00:33:42.791 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:42.791 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:42.791 Initialization complete. Launching workers. 00:33:42.791 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 10905, failed: 10 00:33:42.791 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2669, failed to submit 8246 00:33:42.791 success 804, unsuccess 1865, failed 0 00:33:42.791 04:30:56 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:42.791 04:30:56 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:42.791 EAL: No free 2048 kB hugepages reported on node 1 00:33:42.791 [2024-05-14 04:30:57.013367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:168 nsid:1 lba:296 len:8 PRP1 0x200007c5a000 PRP2 0x0 00:33:42.791 [2024-05-14 04:30:57.013410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:168 cdw0:0 sqhd:0033 p:1 m:0 dnr:0 00:33:42.791 [2024-05-14 04:30:57.069474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:174 nsid:1 lba:1648 len:8 PRP1 0x200007c50000 PRP2 0x0 00:33:42.791 [2024-05-14 04:30:57.069499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:174 cdw0:0 sqhd:00d7 p:1 m:0 dnr:0 00:33:42.791 [2024-05-14 04:30:57.101348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:170 nsid:1 lba:2392 len:8 PRP1 0x200007c4e000 PRP2 0x0 00:33:42.791 [2024-05-14 04:30:57.101376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:170 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:33:42.791 [2024-05-14 04:30:57.117375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:188 nsid:1 lba:2832 len:8 PRP1 0x200007c52000 PRP2 0x0 00:33:42.791 [2024-05-14 04:30:57.117398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:188 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:33:46.124 Initializing NVMe Controllers 00:33:46.124 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:46.124 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:46.124 Initialization complete. Launching workers. 00:33:46.124 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8632, failed: 4 00:33:46.124 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1179, failed to submit 7457 00:33:46.124 success 352, unsuccess 827, failed 0 00:33:46.124 04:31:00 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:46.124 04:31:00 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:33:46.124 EAL: No free 2048 kB hugepages reported on node 1 00:33:46.124 [2024-05-14 04:31:00.340709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:178 nsid:1 lba:840 len:8 PRP1 0x200007908000 PRP2 0x0 00:33:46.124 [2024-05-14 04:31:00.340739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:178 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:33:46.124 [2024-05-14 04:31:00.371265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:191 nsid:1 lba:3744 len:8 PRP1 0x200007916000 PRP2 0x0 00:33:46.124 [2024-05-14 04:31:00.371283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:191 cdw0:0 sqhd:007c p:1 m:0 dnr:0 00:33:49.427 Initializing NVMe Controllers 00:33:49.427 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:49.427 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:49.427 Initialization complete. Launching workers. 00:33:49.427 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 39455, failed: 2 00:33:49.427 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2557, failed to submit 36900 00:33:49.427 success 724, unsuccess 1833, failed 0 00:33:49.427 04:31:03 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:33:49.427 04:31:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:49.427 04:31:03 -- common/autotest_common.sh@10 -- # set +x 00:33:49.427 04:31:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:49.427 04:31:03 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:33:49.427 04:31:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:33:49.427 04:31:03 -- common/autotest_common.sh@10 -- # set +x 00:33:50.811 04:31:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:33:50.811 04:31:05 -- target/abort_qd_sizes.sh@62 -- # killprocess 4186049 00:33:50.811 04:31:05 -- common/autotest_common.sh@926 -- # '[' -z 4186049 ']' 00:33:50.811 04:31:05 -- common/autotest_common.sh@930 -- # kill -0 4186049 00:33:50.811 04:31:05 -- common/autotest_common.sh@931 -- # uname 00:33:50.811 04:31:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:33:50.811 04:31:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4186049 00:33:50.811 04:31:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:33:50.811 04:31:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:33:50.811 04:31:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4186049' 00:33:50.811 killing process with pid 4186049 00:33:50.811 04:31:05 -- common/autotest_common.sh@945 -- # kill 4186049 00:33:50.811 04:31:05 -- common/autotest_common.sh@950 -- # wait 4186049 00:33:51.071 00:33:51.071 real 0m12.122s 00:33:51.071 user 0m48.049s 00:33:51.071 sys 0m2.281s 00:33:51.071 04:31:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:51.071 04:31:05 -- common/autotest_common.sh@10 -- # set +x 00:33:51.071 ************************************ 00:33:51.071 END TEST spdk_target_abort 00:33:51.071 ************************************ 00:33:51.071 04:31:05 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:33:51.071 04:31:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:33:51.071 04:31:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:33:51.071 04:31:05 -- common/autotest_common.sh@10 -- # set +x 00:33:51.071 ************************************ 00:33:51.071 START TEST kernel_target_abort 00:33:51.071 ************************************ 00:33:51.071 04:31:05 -- common/autotest_common.sh@1104 -- # kernel_target 00:33:51.071 04:31:05 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:33:51.071 04:31:05 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:33:51.071 04:31:05 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:33:51.071 04:31:05 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:33:51.071 04:31:05 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:33:51.071 04:31:05 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:51.071 04:31:05 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:33:51.071 04:31:05 -- nvmf/common.sh@627 -- # local block nvme 00:33:51.071 04:31:05 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:33:51.071 04:31:05 -- nvmf/common.sh@630 -- # modprobe nvmet 00:33:51.071 04:31:05 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:33:51.071 04:31:05 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:54.373 Waiting for block devices as requested 00:33:54.373 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:33:54.373 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:33:54.373 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:33:54.634 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:33:54.634 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:33:54.634 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:33:54.895 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:33:54.895 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:33:54.895 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:33:55.156 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:33:55.156 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:33:55.156 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:33:55.417 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:33:55.417 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:33:55.417 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:33:55.678 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:33:55.678 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:33:55.939 04:31:10 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:33:55.939 04:31:10 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:33:55.939 04:31:10 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:33:55.939 04:31:10 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:33:55.939 04:31:10 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:33:55.939 No valid GPT data, bailing 00:33:55.939 04:31:10 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:33:55.939 04:31:10 -- scripts/common.sh@393 -- # pt= 00:33:55.939 04:31:10 -- scripts/common.sh@394 -- # return 1 00:33:55.939 04:31:10 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:33:55.939 04:31:10 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:33:55.939 04:31:10 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:55.939 04:31:10 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:55.939 04:31:10 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:33:55.939 04:31:10 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:33:55.939 04:31:10 -- nvmf/common.sh@654 -- # echo 1 00:33:55.939 04:31:10 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:33:55.939 04:31:10 -- nvmf/common.sh@656 -- # echo 1 00:33:55.939 04:31:10 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:33:55.939 04:31:10 -- nvmf/common.sh@663 -- # echo tcp 00:33:55.939 04:31:10 -- nvmf/common.sh@664 -- # echo 4420 00:33:55.939 04:31:10 -- nvmf/common.sh@665 -- # echo ipv4 00:33:55.939 04:31:10 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:33:55.939 04:31:10 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -a 10.0.0.1 -t tcp -s 4420 00:33:55.939 00:33:55.939 Discovery Log Number of Records 2, Generation counter 2 00:33:55.939 =====Discovery Log Entry 0====== 00:33:55.939 trtype: tcp 00:33:55.939 adrfam: ipv4 00:33:55.939 subtype: current discovery subsystem 00:33:55.939 treq: not specified, sq flow control disable supported 00:33:55.939 portid: 1 00:33:55.939 trsvcid: 4420 00:33:55.939 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:33:55.939 traddr: 10.0.0.1 00:33:55.939 eflags: none 00:33:55.939 sectype: none 00:33:55.939 =====Discovery Log Entry 1====== 00:33:55.939 trtype: tcp 00:33:55.939 adrfam: ipv4 00:33:55.939 subtype: nvme subsystem 00:33:55.939 treq: not specified, sq flow control disable supported 00:33:55.939 portid: 1 00:33:55.939 trsvcid: 4420 00:33:55.939 subnqn: kernel_target 00:33:55.939 traddr: 10.0.0.1 00:33:55.939 eflags: none 00:33:55.939 sectype: none 00:33:55.939 04:31:10 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:33:55.939 04:31:10 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:33:55.939 04:31:10 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:33:55.939 04:31:10 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:33:55.939 04:31:10 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@24 -- # local target r 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:55.940 04:31:10 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:56.200 EAL: No free 2048 kB hugepages reported on node 1 00:33:59.500 Initializing NVMe Controllers 00:33:59.500 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:59.500 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:59.500 Initialization complete. Launching workers. 00:33:59.500 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 35463, failed: 0 00:33:59.500 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 35463, failed to submit 0 00:33:59.500 success 0, unsuccess 35463, failed 0 00:33:59.500 04:31:13 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:59.500 04:31:13 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:59.500 EAL: No free 2048 kB hugepages reported on node 1 00:34:02.801 Initializing NVMe Controllers 00:34:02.801 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:34:02.801 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:34:02.801 Initialization complete. Launching workers. 00:34:02.801 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 73863, failed: 0 00:34:02.801 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18606, failed to submit 55257 00:34:02.801 success 0, unsuccess 18606, failed 0 00:34:02.801 04:31:16 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:34:02.801 04:31:16 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:34:02.801 EAL: No free 2048 kB hugepages reported on node 1 00:34:05.350 Initializing NVMe Controllers 00:34:05.350 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:34:05.350 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:34:05.350 Initialization complete. Launching workers. 00:34:05.350 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 71661, failed: 0 00:34:05.350 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 17890, failed to submit 53771 00:34:05.350 success 0, unsuccess 17890, failed 0 00:34:05.350 04:31:19 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:34:05.350 04:31:19 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:34:05.350 04:31:19 -- nvmf/common.sh@677 -- # echo 0 00:34:05.350 04:31:19 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:34:05.350 04:31:19 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:34:05.350 04:31:19 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:34:05.350 04:31:19 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:34:05.350 04:31:19 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:34:05.350 04:31:19 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:34:05.350 00:34:05.350 real 0m14.397s 00:34:05.350 user 0m5.444s 00:34:05.350 sys 0m4.113s 00:34:05.350 04:31:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:34:05.350 04:31:19 -- common/autotest_common.sh@10 -- # set +x 00:34:05.350 ************************************ 00:34:05.350 END TEST kernel_target_abort 00:34:05.350 ************************************ 00:34:05.350 04:31:19 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:34:05.350 04:31:19 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:34:05.350 04:31:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:34:05.350 04:31:19 -- nvmf/common.sh@116 -- # sync 00:34:05.350 04:31:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:34:05.350 04:31:19 -- nvmf/common.sh@119 -- # set +e 00:34:05.350 04:31:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:34:05.350 04:31:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:34:05.350 rmmod nvme_tcp 00:34:05.350 rmmod nvme_fabrics 00:34:05.350 rmmod nvme_keyring 00:34:05.350 04:31:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:34:05.611 04:31:19 -- nvmf/common.sh@123 -- # set -e 00:34:05.611 04:31:19 -- nvmf/common.sh@124 -- # return 0 00:34:05.611 04:31:19 -- nvmf/common.sh@477 -- # '[' -n 4186049 ']' 00:34:05.611 04:31:19 -- nvmf/common.sh@478 -- # killprocess 4186049 00:34:05.611 04:31:19 -- common/autotest_common.sh@926 -- # '[' -z 4186049 ']' 00:34:05.611 04:31:19 -- common/autotest_common.sh@930 -- # kill -0 4186049 00:34:05.611 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (4186049) - No such process 00:34:05.611 04:31:19 -- common/autotest_common.sh@953 -- # echo 'Process with pid 4186049 is not found' 00:34:05.611 Process with pid 4186049 is not found 00:34:05.611 04:31:19 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:34:05.611 04:31:19 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:34:08.949 0000:80:01.6 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:80:01.7 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:80:01.4 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:80:01.5 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:80:01.2 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:80:01.3 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:80:01.0 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:80:01.1 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:65:00.0 (144d a80a): Already using the nvme driver 00:34:08.949 0000:00:01.6 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:00:01.7 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:00:01.4 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:00:01.5 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:00:01.2 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:00:01.3 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:00:01.0 (8086 0b00): Already using the ioatdma driver 00:34:08.949 0000:00:01.1 (8086 0b00): Already using the ioatdma driver 00:34:09.208 04:31:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:34:09.208 04:31:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:34:09.208 04:31:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:34:09.209 04:31:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:34:09.209 04:31:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:34:09.209 04:31:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:34:09.209 04:31:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:34:11.757 04:31:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:34:11.757 00:34:11.757 real 0m44.268s 00:34:11.757 user 0m58.612s 00:34:11.757 sys 0m16.560s 00:34:11.757 04:31:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:34:11.757 04:31:25 -- common/autotest_common.sh@10 -- # set +x 00:34:11.757 ************************************ 00:34:11.757 END TEST nvmf_abort_qd_sizes 00:34:11.757 ************************************ 00:34:11.757 04:31:25 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:34:11.757 04:31:25 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:34:11.757 04:31:25 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:34:11.757 04:31:25 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:34:11.757 04:31:25 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:34:11.758 04:31:25 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:34:11.758 04:31:25 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:34:11.758 04:31:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:34:11.758 04:31:25 -- common/autotest_common.sh@10 -- # set +x 00:34:11.758 04:31:25 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:34:11.758 04:31:25 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:34:11.758 04:31:25 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:34:11.758 04:31:25 -- common/autotest_common.sh@10 -- # set +x 00:34:19.906 INFO: APP EXITING 00:34:19.906 INFO: killing all VMs 00:34:19.906 INFO: killing vhost app 00:34:19.906 WARN: no vhost pid file found 00:34:19.906 INFO: EXIT DONE 00:34:22.474 0000:80:01.6 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:80:01.7 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:80:01.4 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:80:01.5 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:80:01.2 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:80:01.3 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:80:01.0 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:80:01.1 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:65:00.0 (144d a80a): Already using the nvme driver 00:34:22.474 0000:00:01.6 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:00:01.7 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:00:01.4 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:00:01.5 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:00:01.2 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:00:01.3 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:00:01.0 (8086 0b00): Already using the ioatdma driver 00:34:22.474 0000:00:01.1 (8086 0b00): Already using the ioatdma driver 00:34:26.683 Cleaning 00:34:26.683 Removing: /var/run/dpdk/spdk0/config 00:34:26.683 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:34:26.683 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:34:26.683 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:34:26.683 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:34:26.683 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:34:26.684 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:34:26.684 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:34:26.684 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:34:26.684 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:34:26.684 Removing: /var/run/dpdk/spdk0/hugepage_info 00:34:26.684 Removing: /var/run/dpdk/spdk1/config 00:34:26.684 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:34:26.684 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:34:26.684 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:34:26.684 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:34:26.684 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:34:26.684 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:34:26.684 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:34:26.684 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:34:26.684 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:34:26.684 Removing: /var/run/dpdk/spdk1/hugepage_info 00:34:26.684 Removing: /var/run/dpdk/spdk1/mp_socket 00:34:26.684 Removing: /var/run/dpdk/spdk2/config 00:34:26.684 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:34:26.684 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:34:26.684 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:34:26.684 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:34:26.684 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:34:26.684 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:34:26.684 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:34:26.684 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:34:26.684 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:34:26.684 Removing: /var/run/dpdk/spdk2/hugepage_info 00:34:26.684 Removing: /var/run/dpdk/spdk3/config 00:34:26.684 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:34:26.684 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:34:26.684 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:34:26.684 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:34:26.684 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:34:26.684 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:34:26.684 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:34:26.684 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:34:26.684 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:34:26.684 Removing: /var/run/dpdk/spdk3/hugepage_info 00:34:26.684 Removing: /var/run/dpdk/spdk4/config 00:34:26.684 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:34:26.684 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:34:26.684 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:34:26.684 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:34:26.684 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:34:26.684 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:34:26.684 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:34:26.684 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:34:26.684 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:34:26.684 Removing: /var/run/dpdk/spdk4/hugepage_info 00:34:26.684 Removing: /dev/shm/bdev_svc_trace.1 00:34:26.684 Removing: /dev/shm/nvmf_trace.0 00:34:26.684 Removing: /dev/shm/spdk_tgt_trace.pid3726742 00:34:26.684 Removing: /var/run/dpdk/spdk0 00:34:26.684 Removing: /var/run/dpdk/spdk1 00:34:26.684 Removing: /var/run/dpdk/spdk2 00:34:26.684 Removing: /var/run/dpdk/spdk3 00:34:26.684 Removing: /var/run/dpdk/spdk4 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3725208 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3726742 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3727299 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3728439 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3729195 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3729465 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3729703 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3730082 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3730475 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3730828 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3730977 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3731241 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3732759 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3736573 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3736869 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3737240 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3737576 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3737955 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3738139 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3738666 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3738680 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3739042 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3739338 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3739423 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3739752 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3740188 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3740494 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3740734 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3740990 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3741034 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3741316 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3741451 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3741756 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3742096 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3742450 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3742585 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3742824 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3743158 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3743507 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3743700 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3743889 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3744222 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3744571 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3744803 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3744973 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3745281 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3745632 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3745921 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3746095 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3746342 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3746690 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3747030 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3747241 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3747403 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3747752 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3748094 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3748399 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3748534 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3748820 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3749155 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3749506 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3749658 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3749880 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3750219 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3750573 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3750800 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3750990 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3751288 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3751641 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3751990 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3752159 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3752415 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3752789 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3757062 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3855182 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3860268 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3870943 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3877819 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3882879 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3883663 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3894029 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3894399 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3899483 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3906249 00:34:26.684 Removing: /var/run/dpdk/spdk_pid3909318 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3921427 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3932568 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3934676 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3935873 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3956039 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3960737 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3966085 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3967967 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3970239 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3970554 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3970623 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3970945 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3971668 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3973758 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3974807 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3975519 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3982639 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3989240 00:34:26.946 Removing: /var/run/dpdk/spdk_pid3995172 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4040666 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4045519 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4052461 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4053969 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4055615 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4060627 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4065536 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4074464 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4074466 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4080080 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4080177 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4080454 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4080941 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4081022 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4082312 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4084281 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4086224 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4088251 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4090276 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4092301 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4099381 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4100094 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4101082 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4101937 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4108105 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4111197 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4117643 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4125077 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4131904 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4132595 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4133286 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4134017 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4135050 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4135739 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4136469 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4137211 00:34:26.946 Removing: /var/run/dpdk/spdk_pid4142219 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4142537 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4149654 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4149992 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4152528 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4159997 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4160002 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4165906 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4168131 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4170645 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4171975 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4174990 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4176222 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4186255 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4186926 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4187602 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4190439 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4190931 00:34:27.208 Removing: /var/run/dpdk/spdk_pid4191611 00:34:27.208 Clean 00:34:27.208 killing process with pid 3668598 00:34:37.220 killing process with pid 3668595 00:34:37.220 killing process with pid 3668597 00:34:37.484 killing process with pid 3668596 00:34:37.484 04:31:51 -- common/autotest_common.sh@1436 -- # return 0 00:34:37.484 04:31:51 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:34:37.484 04:31:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:34:37.484 04:31:51 -- common/autotest_common.sh@10 -- # set +x 00:34:37.484 04:31:51 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:34:37.484 04:31:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:34:37.484 04:31:51 -- common/autotest_common.sh@10 -- # set +x 00:34:37.484 04:31:51 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:37.484 04:31:51 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:34:37.484 04:31:51 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:34:37.484 04:31:51 -- spdk/autotest.sh@394 -- # hash lcov 00:34:37.484 04:31:51 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:34:37.484 04:31:51 -- spdk/autotest.sh@396 -- # hostname 00:34:37.484 04:31:51 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-cyp-09 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:34:37.783 geninfo: WARNING: invalid characters removed from testname! 00:34:59.752 04:32:13 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:02.300 04:32:16 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:03.243 04:32:17 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:04.629 04:32:19 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:06.544 04:32:20 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:07.930 04:32:22 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:35:09.318 04:32:23 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:35:09.318 04:32:23 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:35:09.318 04:32:23 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:35:09.318 04:32:23 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:35:09.318 04:32:23 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:35:09.318 04:32:23 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:09.318 04:32:23 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:09.318 04:32:23 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:09.318 04:32:23 -- paths/export.sh@5 -- $ export PATH 00:35:09.318 04:32:23 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:09.318 04:32:23 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:35:09.318 04:32:23 -- common/autobuild_common.sh@435 -- $ date +%s 00:35:09.318 04:32:23 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1715653943.XXXXXX 00:35:09.318 04:32:23 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1715653943.664Gzn 00:35:09.318 04:32:23 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:35:09.318 04:32:23 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:35:09.318 04:32:23 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:35:09.318 04:32:23 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:35:09.318 04:32:23 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:35:09.318 04:32:23 -- common/autobuild_common.sh@451 -- $ get_config_params 00:35:09.318 04:32:23 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:35:09.318 04:32:23 -- common/autotest_common.sh@10 -- $ set +x 00:35:09.318 04:32:23 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:35:09.318 04:32:23 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j144 00:35:09.318 04:32:23 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:35:09.318 04:32:23 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:35:09.318 04:32:23 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:35:09.318 04:32:23 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:35:09.318 04:32:23 -- spdk/autopackage.sh@19 -- $ timing_finish 00:35:09.318 04:32:23 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:35:09.318 04:32:23 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:35:09.318 04:32:23 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:35:09.318 04:32:23 -- spdk/autopackage.sh@20 -- $ exit 0 00:35:09.318 + [[ -n 3626292 ]] 00:35:09.318 + sudo kill 3626292 00:35:09.329 [Pipeline] } 00:35:09.345 [Pipeline] // stage 00:35:09.350 [Pipeline] } 00:35:09.365 [Pipeline] // timeout 00:35:09.371 [Pipeline] } 00:35:09.387 [Pipeline] // catchError 00:35:09.391 [Pipeline] } 00:35:09.407 [Pipeline] // wrap 00:35:09.412 [Pipeline] } 00:35:09.431 [Pipeline] // catchError 00:35:09.444 [Pipeline] stage 00:35:09.447 [Pipeline] { (Epilogue) 00:35:09.463 [Pipeline] catchError 00:35:09.465 [Pipeline] { 00:35:09.500 [Pipeline] echo 00:35:09.505 Cleanup processes 00:35:09.514 [Pipeline] sh 00:35:09.822 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:35:09.822 14606 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:35:09.837 [Pipeline] sh 00:35:10.157 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:35:10.157 ++ grep -v 'sudo pgrep' 00:35:10.157 ++ awk '{print $1}' 00:35:10.157 + sudo kill -9 00:35:10.157 + true 00:35:10.171 [Pipeline] sh 00:35:10.459 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:35:22.712 [Pipeline] sh 00:35:23.001 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:35:23.001 Artifacts sizes are good 00:35:23.018 [Pipeline] archiveArtifacts 00:35:23.027 Archiving artifacts 00:35:23.276 [Pipeline] sh 00:35:23.573 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:35:23.594 [Pipeline] cleanWs 00:35:23.602 [WS-CLEANUP] Deleting project workspace... 00:35:23.602 [WS-CLEANUP] Deferred wipeout is used... 00:35:23.608 [WS-CLEANUP] done 00:35:23.609 [Pipeline] } 00:35:23.620 [Pipeline] // catchError 00:35:23.631 [Pipeline] sh 00:35:23.914 + logger -p user.info -t JENKINS-CI 00:35:23.927 [Pipeline] } 00:35:23.943 [Pipeline] // stage 00:35:23.948 [Pipeline] } 00:35:23.964 [Pipeline] // node 00:35:23.969 [Pipeline] End of Pipeline 00:35:24.007 Finished: SUCCESS